2024 Server CPUs

2 x Intel Xeon 6780E testing with a Quanta Cloud QuantaGrid D55Q-2U S7Q-MB-MPS-MDP (2A05.QCT001 BIOS) and ASPEED on Ubuntu 24.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2406049-NE-2024SERVE17
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

AV1 2 Tests
BLAS (Basic Linear Algebra Sub-Routine) Tests 4 Tests
C++ Boost Tests 5 Tests
Chess Test Suite 2 Tests
Timed Code Compilation 8 Tests
C/C++ Compiler Tests 16 Tests
Compression Tests 3 Tests
CPU Massive 25 Tests
Creator Workloads 23 Tests
Cryptography 5 Tests
Database Test Suite 5 Tests
Encoding 7 Tests
Fortran Tests 7 Tests
Game Development 5 Tests
HPC - High Performance Computing 29 Tests
Imaging 3 Tests
Common Kernel Benchmarks 3 Tests
LAPACK (Linear Algebra Pack) Tests 3 Tests
Linear Algebra 2 Tests
Machine Learning 7 Tests
Molecular Dynamics 10 Tests
MPI Benchmarks 10 Tests
Multi-Core 44 Tests
NVIDIA GPU Compute 3 Tests
Intel oneAPI 7 Tests
OpenMPI Tests 18 Tests
Programmer / Developer System Benchmarks 12 Tests
Python 2 Tests
Raytracing 2 Tests
Renderers 5 Tests
Scientific Computing 15 Tests
Software Defined Radio 2 Tests
Server 7 Tests
Server CPU Tests 17 Tests
Single-Threaded 2 Tests
Video Encoding 7 Tests
Common Workstation Benchmarks 3 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable
Show Perf Per RAM Channel Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
Xeon Platinum 8490H
April 16
  22 Hours, 19 Minutes
Xeon Platinum 8490H 2P
April 17
  23 Hours
Xeon Platinum 8592+
April 11
  22 Hours, 9 Minutes
Xeon Platinum 8592+ 2P
April 08
  23 Hours, 49 Minutes
Xeon Max 9468
April 21
  1 Day, 3 Hours, 43 Minutes
Xeon Max 9468 2P
April 22
  1 Day, 34 Minutes
Xeon Max 9480
April 26
  1 Day, 1 Hour, 37 Minutes
Xeon Max 9480 2P
April 27
  1 Day, 6 Hours, 26 Minutes
Xeon Platinum 8380 2P
May 07
  1 Day, 5 Hours, 29 Minutes
Xeon Platinum 8380
May 09
  1 Day, 7 Hours, 15 Minutes
EPYC 9684X 2P
May 11
  1 Day, 4 Hours, 57 Minutes
EPYC 9684X
May 12
  1 Day, 27 Minutes
EPYC 9654
May 13
  1 Day, 1 Hour, 48 Minutes
EPYC 9654 2P
May 14
  1 Day, 6 Hours, 48 Minutes
EPYC 9754
May 15
  1 Day, 6 Hours
EPYC 9754 2P
May 17
  1 Day, 9 Hours, 52 Minutes
EPYC 8534P
May 18
  1 Day, 3 Hours, 8 Minutes
EPYC 8534PN
May 19
  1 Day, 3 Hours, 48 Minutes
Xeon 6766E 2P
May 24
  1 Day, 3 Hours, 18 Minutes
Xeon 6766E
May 25
  18 Hours, 24 Minutes
Xeon 6780E
May 26
  17 Hours, 33 Minutes
Xeon 6780E 2P
May 27
  23 Hours, 13 Minutes
Invert Hiding All Results Option
  1 Day, 2 Hours, 10 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

Xeon Platinum 8490H

Processor: Intel Xeon Platinum 8490H @ 3.50GHz (60 Cores / 120 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 512GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Xeon Platinum 8490H 2P

Changed Processor to 2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads).

Changed Memory to 1008GB.

Xeon Platinum 8592+

Changed Processor to INTEL XEON PLATINUM 8592+ @ 3.90GHz (64 Cores / 128 Threads).

Changed Memory to 512GB.

Processor Change: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200

Xeon Platinum 8592+ 2P

Changed Processor to 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads).

Changed Memory to 1008GB.

Xeon Max 9468

Changed Processor to Intel Xeon Max 9468 @ 3.50GHz (48 Cores / 96 Threads).

Changed Memory to 576GB.

Processor Change: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290

Xeon Max 9468 2P

Changed Processor to 2 x Intel Xeon Max 9468 @ 3.50GHz (96 Cores / 192 Threads).

Changed Memory to 1136GB.

Xeon Max 9480

Changed Processor to Intel Xeon Max 9480 @ 3.50GHz (56 Cores / 112 Threads).

Changed Memory to 576GB.

Xeon Max 9480 2P

Changed Processor to 2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads).

Changed Memory to 1136GB.

Xeon Platinum 8380 2P

Processor: 2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads), Motherboard: Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS), Chipset: Intel Ice Lake IEH, Memory: 512GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1080

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd0003d1
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Mitigation of Microcode + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Xeon Platinum 8380

Changed Processor to Intel Xeon Platinum 8380 @ 3.40GHz (40 Cores / 80 Threads).

Changed Memory to 256GB.

EPYC 9684X 2P

Processor: 2 x AMD EPYC 9684X 96-Core @ 2.55GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

EPYC 9684X

Changed Processor to AMD EPYC 9684X 96-Core @ 2.55GHz (96 Cores / 192 Threads).

Changed Memory to 12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEG.

EPYC 9654

Changed Processor to AMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads).

EPYC 9654 2P

Changed Processor to 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads).

Changed Memory to 1520GB.

EPYC 9754

Changed Processor to AMD EPYC 9754 128-Core @ 2.25GHz (128 Cores / 256 Threads).

Changed Memory to 12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEG.

Processor Change: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00116

EPYC 9754 2P

Changed Processor to 2 x AMD EPYC 9754 128-Core @ 2.25GHz (256 Cores / 512 Threads).

Changed Memory to 1520GB.

EPYC 8534P

Processor: AMD EPYC 8534P 64-Core @ 2.30GHz (64 Cores / 128 Threads), Motherboard: AMD Cinnabar (RCB1009C BIOS), Chipset: AMD Device 14a4, Memory: 6 x 32GB DDR5-4800MT/s Samsung M321R4GA0BB0-CQKMG, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92 + 2000GB Corsair MP700 PRO, Graphics: ASPEED, Network: 2 x Broadcom NetXtreme BCM5720 PCIe

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00213
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

EPYC 8534PN

Changed Processor to AMD EPYC 8534PN 64-Core @ 2.00GHz (64 Cores / 128 Threads).

Changed Disk to 2 x 1920GB KIOXIA KCD8XPUG1T92.

Xeon 6766E 2P

Processor: 2 x Intel Xeon 6766E @ 2.70GHz (288 Cores), Motherboard: Quanta Cloud QuantaGrid D55Q-2U S7Q-MB-MPS-MDP (2A05.QCT001 BIOS), Chipset: Intel Ice Lake IEH, Memory: 512GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS + 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: 2 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Xeon 6766E

Changed Processor to Intel Xeon 6766E @ 2.70GHz (144 Cores).

Changed Memory to 256GB.

Changed Disk to 2 x 1920GB KIOXIA KCD8XPUG1T92 + 3201GB Micron_7450_MTFDKCB3T2TFS.

Xeon 6780E

Changed Processor to Intel Xeon 6780E @ 3.00GHz (144 Cores).

Changed Disk to 3201GB Micron_7450_MTFDKCB3T2TFS + 2 x 1920GB KIOXIA KCD8XPUG1T92.

Xeon 6780E 2P

Changed Processor to 2 x Intel Xeon 6780E @ 3.00GHz (288 Cores).

Changed Memory to 512GB.

2024 Server CPUsProcessorMotherboardChipsetMemoryDiskGraphicsNetworkMonitorOSKernelCompilerFile-SystemScreen ResolutionXeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8380 2PXeon Platinum 8380EPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon 6766E 2PXeon 6766EXeon 6780EXeon 6780E 2PIntel Xeon Platinum 8490H @ 3.50GHz (60 Cores / 120 Threads)Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS)Intel Device 1bce512GB2 x 1920GB KIOXIA KCD8XPUG1T92ASPEEDUbuntu 24.046.9.0-060900rc3-generic (x86_64)GCC 13.2.0ext41920x12002 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads)1008GB2 x Intel X710 for 10GBASE-TINTEL XEON PLATINUM 8592+ @ 3.90GHz (64 Cores / 128 Threads)512GB2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads)1008GB2 x Intel X710 for 10GBASE-TIntel Xeon Max 9468 @ 3.50GHz (48 Cores / 96 Threads)576GB2 x Intel Xeon Max 9468 @ 3.50GHz (96 Cores / 192 Threads)1136GB2 x Intel X710 for 10GBASE-TIntel Xeon Max 9480 @ 3.50GHz (56 Cores / 112 Threads)576GB2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads)1136GB2 x Intel X710 for 10GBASE-T2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads)Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS)Intel Ice Lake IEH512GBVE2282 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP1920x1080Intel Xeon Platinum 8380 @ 3.40GHz (40 Cores / 80 Threads)256GB2 x AMD EPYC 9684X 96-Core @ 2.55GHz (192 Cores / 384 Threads)AMD Titanite_4G (RTI1007B BIOS)AMD Device 14a41520GBBroadcom NetXtreme BCM5720 PCIe1920x1200AMD EPYC 9684X 96-Core @ 2.55GHz (96 Cores / 192 Threads)12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEGAMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads)2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads)1520GBAMD EPYC 9754 128-Core @ 2.25GHz (128 Cores / 256 Threads)12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEG2 x AMD EPYC 9754 128-Core @ 2.25GHz (256 Cores / 512 Threads)1520GBAMD EPYC 8534P 64-Core @ 2.30GHz (64 Cores / 128 Threads)AMD Cinnabar (RCB1009C BIOS)6 x 32GB DDR5-4800MT/s Samsung M321R4GA0BB0-CQKMG2 x 1920GB KIOXIA KCD8XPUG1T92 + 2000GB Corsair MP700 PRO2 x Broadcom NetXtreme BCM5720 PCIeAMD EPYC 8534PN 64-Core @ 2.00GHz (64 Cores / 128 Threads)2 x 1920GB KIOXIA KCD8XPUG1T922 x Intel Xeon 6766E @ 2.70GHz (288 Cores)Quanta Cloud QuantaGrid D55Q-2U S7Q-MB-MPS-MDP (2A05.QCT001 BIOS)Intel Ice Lake IEH512GB3201GB Micron_7450_MTFDKCB3T2TFS + 2 x 1920GB KIOXIA KCD8XPUG1T922 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMAIntel Xeon 6766E @ 2.70GHz (144 Cores)256GB2 x 1920GB KIOXIA KCD8XPUG1T92 + 3201GB Micron_7450_MTFDKCB3T2TFSIntel Xeon 6780E @ 3.00GHz (144 Cores)3201GB Micron_7450_MTFDKCB3T2TFS + 2 x 1920GB KIOXIA KCD8XPUG1T922 x Intel Xeon 6780E @ 3.00GHz (288 Cores)512GBOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Details- Xeon Platinum 8490H: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590- Xeon Platinum 8490H 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590- Xeon Platinum 8592+: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200- Xeon Platinum 8592+ 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200- Xeon Max 9468: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290- Xeon Max 9468 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290- Xeon Max 9480: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290- Xeon Max 9480 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290- Xeon Platinum 8380 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd0003d1- Xeon Platinum 8380: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd0003d1- EPYC 9684X 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144- EPYC 9684X: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144- EPYC 9654: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144- EPYC 9654 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144- EPYC 9754: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00116- EPYC 9754 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00116- EPYC 8534P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00213- EPYC 8534PN: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00213- Xeon 6766E 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131- Xeon 6766E: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131- Xeon 6780E: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131- Xeon 6780E 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131Java Details- OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Details- Python 3.12.2Security Details- Xeon Platinum 8490H: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Platinum 8490H 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Platinum 8592+: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Platinum 8592+ 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Max 9468: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Max 9468 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Max 9480: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Max 9480 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Platinum 8380 2P: gather_data_sampling: Mitigation of Microcode + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Platinum 8380: gather_data_sampling: Mitigation of Microcode + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9684X 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9684X: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9654: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9654 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9754: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9754 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 8534P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 8534PN: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Xeon 6766E 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Xeon 6766E: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Xeon 6780E: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Xeon 6780E 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

WRF

WRF, the Weather Research and Forecasting Model, is a "next-generation mesoscale numerical weather prediction system designed for both atmospheric research and operational forecasting applications. It features two dynamical cores, a data assimilation system, and a software architecture supporting parallel computation and system extensibility." Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterWRF 4.2.2Input: conus 2.5kmEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9654 2PXeon Max 9468 2PEPYC 9754 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+EPYC 9754Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PEPYC 8534PEPYC 8534PNXeon Platinum 83804K8K12K16K20K4431.345601.106674.126840.066918.027157.967365.867885.1610176.8610602.4111895.4111980.8112410.2913273.6914030.5116147.0016609.7818998.821. (F9X) gfortran options: -O2 -ftree-vectorize -funroll-loops -ffree-form -fconvert=big-endian -frecord-marker=4 -fallow-invalid-boz -lesmf_time -lwrfio_nf -lnetcdff -lnetcdf -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
OpenBenchmarking.orgWatts, Fewer Is BetterWRF 4.2.2CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon Platinum 8380EPYC 9754EPYC 9654Xeon Max 9468Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 9684XXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2P140280420560700Min: 16.84 / Avg: 129.9 / Max: 140.42Min: 15.64 / Avg: 145.37 / Max: 162.49Min: 49.71 / Avg: 269.24 / Max: 290.56Min: 22.35 / Avg: 281.34 / Max: 344.56Min: 30.34 / Avg: 300.18 / Max: 350.9Min: 74.03 / Avg: 344.06 / Max: 376.25Min: 33.93 / Avg: 346.87 / Max: 375.36Min: 58.32 / Avg: 348.04 / Max: 365.29Min: 72.74 / Avg: 348.35 / Max: 374.75Min: 32.73 / Avg: 373.92 / Max: 409.63Min: 102.38 / Avg: 532.99 / Max: 577.35Min: 40.85 / Avg: 632.77 / Max: 699.19Min: 57.5 / Avg: 658.99 / Max: 714.2Min: 178.83 / Avg: 696.45 / Max: 735.81Min: 78.57 / Avg: 696.98 / Max: 753.43Min: 198.38 / Avg: 697.18 / Max: 737.76Min: 198.27 / Avg: 697.26 / Max: 746.77Min: 65.98 / Avg: 789.57 / Max: 825.39

OpenVKL

OpenVKL is the Intel Open Volume Kernel Library that offers high-performance volume computation kernels and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9684XXeon 6780E 2PEPYC 9654Xeon 6766E 2PXeon Platinum 8592+Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8380 2PXeon 6780EXeon Max 9480Xeon 6766EEPYC 8534PXeon Max 9468EPYC 8534PNXeon Platinum 83809001800270036004500SE +/- 26.33, N = 3SE +/- 5.36, N = 3SE +/- 8.67, N = 3SE +/- 13.62, N = 3SE +/- 6.74, N = 3SE +/- 0.88, N = 3SE +/- 1.00, N = 3SE +/- 3.61, N = 3SE +/- 1.20, N = 3SE +/- 7.31, N = 3SE +/- 2.08, N = 3SE +/- 4.36, N = 3SE +/- 8.62, N = 3SE +/- 1.53, N = 3SE +/- 12.02, N = 3SE +/- 0.67, N = 3SE +/- 13.96, N = 3SE +/- 0.58, N = 3SE +/- 1.20, N = 3SE +/- 6.66, N = 3SE +/- 8.17, N = 3SE +/- 6.81, N = 3401239063335322227162508239622282077202020041852177617341527139113561267126612431177869
OpenBenchmarking.orgItems / Sec Per Watt, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCEPYC 8534PNEPYC 9754EPYC 8534PEPYC 9754 2PEPYC 9654Xeon 6766EEPYC 9684XXeon Platinum 8592+Xeon 6780EEPYC 9654 2PXeon 6766E 2PEPYC 9684X 2PXeon 6780E 2PXeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9468 2P36912159.7809.4579.1637.6737.6017.1966.8616.2616.2336.1025.7865.7635.4165.3915.1064.2874.1293.7983.5273.1622.8532.745
OpenBenchmarking.orgWatts, Fewer Is BetterOpenVKL 2.0.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Platinum 8380EPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon 6766E 2PEPYC 9684XXeon 6780E 2PXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P140280420560700Min: 18.05 / Avg: 120.35 / Max: 144.9Min: 16.98 / Avg: 138.16 / Max: 167.46Min: 43.67 / Avg: 176.07 / Max: 237.02Min: 43.61 / Avg: 223.17 / Max: 308.98Min: 51.77 / Avg: 246.36 / Max: 292Min: 21.69 / Avg: 265.2 / Max: 336.16Min: 28.49 / Avg: 273.27 / Max: 332.24Min: 35.93 / Avg: 320.1 / Max: 378.34Min: 57.62 / Avg: 321.66 / Max: 378.49Min: 75.39 / Avg: 327.25 / Max: 376.15Min: 78.05 / Avg: 328.39 / Max: 378.11Min: 106.2 / Avg: 349.12 / Max: 504.22Min: 33.91 / Avg: 349.21 / Max: 411.78Min: 63.56 / Avg: 411.4 / Max: 636.51Min: 102.24 / Avg: 482.91 / Max: 579.87Min: 40.48 / Avg: 522.89 / Max: 678.27Min: 57.11 / Avg: 546.55 / Max: 678.78Min: 79.05 / Avg: 630.97 / Max: 751.76Min: 172.02 / Avg: 633.5 / Max: 755.3Min: 209.11 / Avg: 647.03 / Max: 756.03Min: 190.07 / Avg: 649.08 / Max: 754.84Min: 67.14 / Avg: 677.76 / Max: 821.931. EPYC 8534PN: Approximate power consumption of 87497 Joules per run.2. EPYC 8534P: Approximate power consumption of 105048 Joules per run.3. Xeon 6766E: Approximate power consumption of 131997 Joules per run.4. Xeon 6780E: Approximate power consumption of 166042 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 163338 Joules per run.6. EPYC 9754: Approximate power consumption of 199964 Joules per run.7. EPYC 9654: Approximate power consumption of 206499 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 211480 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 224091 Joules per run.10. Xeon Max 9468: Approximate power consumption of 222423 Joules per run.11. Xeon Max 9480: Approximate power consumption of 218486 Joules per run.12. Xeon 6766E 2P: Approximate power consumption of 331661 Joules per run.13. EPYC 9684X: Approximate power consumption of 255739 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 384386 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 348663 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 401053 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 405538 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 436629 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 456330 Joules per run.20. Xeon Max 9468 2P: Approximate power consumption of 477509 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 469714 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 500410 Joules per run.

RELION

RELION - REgularised LIkelihood OptimisatioN - is a stand-alone computer program for Maximum A Posteriori refinement of (multiple) 3D reconstructions or 2D class averages in cryo-electron microscopy (cryo-EM). It is developed in the research group of Sjors Scheres at the MRC Laboratory of Molecular Biology. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterRELION 4.0.1Test: Basic - Device: CPUEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9754 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+EPYC 9754Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 8380150300450600750SE +/- 1.27, N = 15SE +/- 2.11, N = 12SE +/- 1.41, N = 3SE +/- 2.17, N = 3SE +/- 4.04, N = 12SE +/- 2.66, N = 12SE +/- 2.65, N = 3SE +/- 3.24, N = 12SE +/- 2.95, N = 3SE +/- 2.68, N = 7SE +/- 7.69, N = 9SE +/- 0.35, N = 3SE +/- 7.14, N = 9SE +/- 4.65, N = 9SE +/- 2.98, N = 3SE +/- 4.63, N = 3SE +/- 6.20, N = 3SE +/- 7.86, N = 993.17145.65155.74176.42201.27201.38203.41214.42238.88290.45360.21368.22373.18384.38412.37468.69496.24705.581. (CXX) g++ options: -fopenmp -std=c++11 -O3 -rdynamic -ldl -ltiff -lfftw3f -lfftw3 -lpng -ljpeg -lmpi_cxx -lmpi
OpenBenchmarking.orgWatts, Fewer Is BetterRELION 4.0.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon Platinum 8380EPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9684XXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2P140280420560700Min: 17.41 / Avg: 148.71 / Max: 151.06Min: 18.83 / Avg: 163.61 / Max: 166.72Min: 53.81 / Avg: 267.6 / Max: 290.36Min: 21.86 / Avg: 270.75 / Max: 336.67Min: 28.15 / Avg: 320.59 / Max: 347.29Min: 22.57 / Avg: 341.82 / Max: 377.61Min: 50.74 / Avg: 344.24 / Max: 377.4Min: 73.36 / Avg: 344.98 / Max: 377.25Min: 73.55 / Avg: 345.11 / Max: 376.88Min: 32.42 / Avg: 394.87 / Max: 409.71Min: 103.02 / Avg: 531.46 / Max: 582.55Min: 42.44 / Avg: 553.69 / Max: 696.76Min: 52.45 / Avg: 622.74 / Max: 703.72Min: 77.4 / Avg: 665.17 / Max: 755.23Min: 170.14 / Avg: 679.44 / Max: 754.54Min: 195.56 / Avg: 682.36 / Max: 754.93Min: 199.08 / Avg: 683.82 / Max: 754.9Min: 63.79 / Avg: 752.52 / Max: 819.671. EPYC 8534PN: Approximate power consumption of 74158 Joules per run.2. EPYC 8534P: Approximate power consumption of 77059 Joules per run.3. Xeon Platinum 8380: Approximate power consumption of 189610 Joules per run.4. EPYC 9754: Approximate power consumption of 98100 Joules per run.5. EPYC 9654: Approximate power consumption of 77584 Joules per run.6. Xeon Platinum 8592+: Approximate power consumption of 100496 Joules per run.7. Xeon Platinum 8490H: Approximate power consumption of 129663 Joules per run.8. Xeon Max 9480: Approximate power consumption of 133775 Joules per run.9. Xeon Max 9468: Approximate power consumption of 143452 Joules per run.10. EPYC 9684X: Approximate power consumption of 70814 Joules per run.11. Xeon Platinum 8380 2P: Approximate power consumption of 197525 Joules per run.12. EPYC 9754 2P: Approximate power consumption of 112537 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 92269 Joules per run.14. Xeon Platinum 8592+ 2P: Approximate power consumption of 106428 Joules per run.15. Xeon Platinum 8490H 2P: Approximate power consumption of 141097 Joules per run.16. Xeon Max 9480 2P: Approximate power consumption of 139714 Joules per run.17. Xeon Max 9468 2P: Approximate power consumption of 148959 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 72192 Joules per run.

NWChem

NWChem is an open-source high performance computational chemistry package. Per NWChem's documentation, "NWChem aims to provide its users with computational chemistry tools that are scalable both in their ability to treat large scientific computational chemistry problems efficiently, and in their use of available parallel computing resources from high-performance parallel supercomputers to conventional workstation clusters." Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterNWChem 7.0.2Input: C240 BuckyballEPYC 9684X 2PEPYC 9684XEPYC 9654 2PEPYC 9654EPYC 9754EPYC 9754 2PXeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8592+Xeon Platinum 8490H 2PEPYC 8534PXeon Platinum 8490HXeon Platinum 8380 2PEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon Platinum 838080016002400320040001429.91450.51558.41575.51700.01712.61785.01809.71873.11878.31960.92024.72070.32170.02224.62245.22530.53576.41. (F9X) gfortran options: -lnwctask -lccsd -lmcscf -lselci -lmp2 -lmoints -lstepper -ldriver -loptim -lnwdft -lgradients -lcphf -lesp -lddscf -ldangchang -lguess -lhessian -lvib -lnwcutil -lrimp2 -lproperty -lsolvation -lnwints -lprepar -lnwmd -lnwpw -lofpw -lpaw -lpspw -lband -lnwpwlib -lcafe -lspace -lanalyze -lqhop -lpfft -ldplot -ldrdy -lvscf -lqmmm -lqmd -letrans -ltce -lbq -lmm -lcons -lperfm -ldntmc -lccca -ldimqm -lga -larmci -lpeigs -l64to32 -lopenblas -lpthread -lrt -llapack -lnwcblas -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz -lcomex -m64 -ffast-math -std=legacy -fdefault-integer-8 -finline-functions -O2
OpenBenchmarking.orgWatts, Fewer Is BetterNWChem 7.0.2CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon Platinum 8380EPYC 9754Xeon Max 9468EPYC 9654Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+EPYC 9684XXeon Platinum 8380 2PXeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P140280420560700Min: 16.6 / Avg: 137.83 / Max: 143.42Min: 17.73 / Avg: 162.23 / Max: 167.7Min: 53.43 / Avg: 268.9 / Max: 289.67Min: 20.56 / Avg: 342.47 / Max: 349.62Min: 77 / Avg: 343.96 / Max: 375.55Min: 28.93 / Avg: 345.69 / Max: 353.42Min: 76.13 / Avg: 345.72 / Max: 372.41Min: 58.95 / Avg: 346.91 / Max: 374.9Min: 27.38 / Avg: 347.16 / Max: 374.58Min: 33.55 / Avg: 406.11 / Max: 409.55Min: 99.59 / Avg: 537.29 / Max: 578.14Min: 207.71 / Avg: 692.7 / Max: 743.72Min: 75.96 / Avg: 694.86 / Max: 743.81Min: 212.08 / Avg: 695.19 / Max: 738.13Min: 161.62 / Avg: 695.26 / Max: 738.23Min: 40.49 / Avg: 698.14 / Max: 712.22Min: 55.46 / Avg: 703.69 / Max: 717.5Min: 59.96 / Avg: 811.84 / Max: 819.7

High Performance Conjugate Gradient

HPCG is the High Performance Conjugate Gradient and is a new scientific benchmark from Sandia National Lans focused for super-computer testing with modern real-world workloads compared to HPCC. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 144 144 144 - RT: 60Xeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Platinum 8380 2PEPYC 9654EPYC 9684XXeon Max 9468EPYC 9754EPYC 8534PEPYC 8534PNXeon Platinum 83801530456075SE +/- 0.94, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.29, N = 3SE +/- 0.51, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.37, N = 3SE +/- 0.34, N = 9SE +/- 0.05, N = 3SE +/- 0.28, N = 5SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 369.3062.6460.8554.4144.9542.5241.8735.1431.0730.5930.1128.3227.5825.2423.6322.2022.1320.411. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi
OpenBenchmarking.orgGFLOP/s Per Watt, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 144 144 144 - RT: 60EPYC 8534PNEPYC 8534PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9754Xeon Max 9480 2PXeon Platinum 8490HXeon Max 9480Xeon Platinum 8490H 2PEPYC 9684XXeon Max 9468 2PXeon Platinum 8380EPYC 9754 2PXeon Max 9468EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380 2P0.0380.0760.1140.1520.190.1690.1560.1040.1030.1010.0990.0920.0900.0890.0880.0840.0790.0770.0740.0730.0690.0620.057
OpenBenchmarking.orgWatts, Fewer Is BetterHigh Performance Conjugate Gradient 3.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PEPYC 9754Xeon Platinum 8380EPYC 9654EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9684X 2P140280420560700Min: 18.07 / Avg: 131.23 / Max: 136.75Min: 18.73 / Avg: 141.98 / Max: 160.79Min: 16.99 / Avg: 238.17 / Max: 311.47Min: 52.91 / Avg: 266.5 / Max: 286.68Min: 28.57 / Avg: 273.24 / Max: 316.28Min: 33.89 / Avg: 330.25 / Max: 391.86Min: 24.94 / Avg: 340.38 / Max: 366.08Min: 62.11 / Avg: 344.43 / Max: 357.3Min: 74.31 / Avg: 344.79 / Max: 363.36Min: 76.3 / Avg: 345.19 / Max: 369.22Min: 101.77 / Avg: 529.99 / Max: 565.31Min: 42.67 / Avg: 563.2 / Max: 666.57Min: 55.46 / Avg: 612.13 / Max: 685.77Min: 208.84 / Avg: 683.79 / Max: 753.27Min: 78.99 / Avg: 685.14 / Max: 717.63Min: 162.34 / Avg: 688.79 / Max: 719.93Min: 192.7 / Avg: 690.6 / Max: 722.1Min: 67.43 / Avg: 722.2 / Max: 816.311. EPYC 8534PN: Approximate power consumption of 74580 Joules per run.2. EPYC 8534P: Approximate power consumption of 80504 Joules per run.3. EPYC 9754: Approximate power consumption of 248649 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 102958 Joules per run.5. EPYC 9654: Approximate power consumption of 178697 Joules per run.6. EPYC 9684X: Approximate power consumption of 219090 Joules per run.7. Xeon Platinum 8592+: Approximate power consumption of 122989 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 131457 Joules per run.9. Xeon Max 9468: Approximate power consumption of 129756 Joules per run.10. Xeon Max 9480: Approximate power consumption of 126110 Joules per run.11. Xeon Platinum 8380 2P: Approximate power consumption of 278539 Joules per run.12. EPYC 9754 2P: Approximate power consumption of 665513 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 529289 Joules per run.14. Xeon Max 9480 2P: Approximate power consumption of 248670 Joules per run.15. Xeon Platinum 8592+ 2P: Approximate power consumption of 253732 Joules per run.16. Xeon Platinum 8490H 2P: Approximate power consumption of 271612 Joules per run.17. Xeon Max 9468 2P: Approximate power consumption of 244012 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 586185 Joules per run.

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: ResNet-50Xeon Platinum 8490H 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490HXeon Max 9468 2PXeon Platinum 8592+EPYC 9654Xeon Max 9480 2PEPYC 9684X 2PEPYC 9754Xeon Platinum 8380 2PXeon Max 9480Xeon 6780E 2PEPYC 9684XXeon Max 9468Xeon 6766E 2PEPYC 8534PXeon 6780EEPYC 8534PNXeon 6766EXeon Platinum 83804080120160200SE +/- 1.39, N = 3SE +/- 0.81, N = 3SE +/- 0.61, N = 3SE +/- 1.83, N = 3SE +/- 0.01, N = 3SE +/- 0.79, N = 3SE +/- 0.48, N = 3SE +/- 0.34, N = 3SE +/- 1.80, N = 3SE +/- 0.31, N = 3SE +/- 1.62, N = 4SE +/- 0.21, N = 3SE +/- 0.61, N = 3SE +/- 1.22, N = 3SE +/- 1.42, N = 4SE +/- 1.17, N = 3SE +/- 0.93, N = 9SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3174.95174.93169.75161.90148.45145.29140.53140.01138.39137.50135.17127.97125.14124.60121.96117.53113.42101.1797.6795.6391.9691.75
OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: ResNet-50EPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon 6766EXeon Platinum 8490HEPYC 9684XXeon 6780EEPYC 9754 2PXeon Max 9480Xeon Platinum 8380Xeon Max 9468EPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9684X 2PXeon Max 9468 2PXeon Max 9480 2P0.160.320.480.640.80.7110.6590.5530.4870.4690.4410.4330.3850.3830.3660.3640.3490.3430.2960.2900.2580.2570.2540.2460.2270.2120.202
OpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.16.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EXeon Platinum 8380EPYC 9654Xeon Platinum 8592+EPYC 9684XXeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon 6766E 2PEPYC 9754 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P130260390520650Min: 16.14 / Avg: 134.5 / Max: 142.97Min: 18.7 / Avg: 153.51 / Max: 165.78Min: 43.69 / Avg: 208.71 / Max: 235.06Min: 20.9 / Avg: 244.22 / Max: 295.24Min: 43.51 / Avg: 255.22 / Max: 299.17Min: 53.71 / Avg: 263.16 / Max: 276.44Min: 30.39 / Avg: 287.56 / Max: 321.33Min: 33.86 / Avg: 299.63 / Max: 330.67Min: 35.54 / Avg: 316.96 / Max: 353.37Min: 74.91 / Avg: 342.39 / Max: 362.9Min: 61.57 / Avg: 342.65 / Max: 363.24Min: 85.58 / Avg: 343.75 / Max: 366.49Min: 106.33 / Avg: 441.95 / Max: 500.12Min: 40.89 / Avg: 478.51 / Max: 540.78Min: 102.54 / Avg: 504.58 / Max: 542.99Min: 108.05 / Avg: 506.95 / Max: 588.39Min: 59.62 / Avg: 547.08 / Max: 589.2Min: 83.43 / Avg: 585.9 / Max: 658.36Min: 66.7 / Avg: 606.04 / Max: 658.36Min: 161.89 / Avg: 678.16 / Max: 719.66Min: 208.64 / Avg: 684.02 / Max: 721.63Min: 207.09 / Avg: 684.53 / Max: 724.921. EPYC 8534PN: Approximate power consumption of 81147 Joules per run.2. EPYC 8534P: Approximate power consumption of 87397 Joules per run.3. Xeon 6766E: Approximate power consumption of 132047 Joules per run.4. EPYC 9754: Approximate power consumption of 102574 Joules per run.5. Xeon 6780E: Approximate power consumption of 152029 Joules per run.6. Xeon Platinum 8380: Approximate power consumption of 164827 Joules per run.7. EPYC 9654: Approximate power consumption of 117803 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 124546 Joules per run.9. EPYC 9684X: Approximate power consumption of 148177 Joules per run.10. Xeon Max 9468: Approximate power consumption of 170850 Joules per run.11. Xeon Platinum 8490H: Approximate power consumption of 134663 Joules per run.12. Xeon Max 9480: Approximate power consumption of 161103 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 234921 Joules per run.14. EPYC 9754 2P: Approximate power consumption of 161257 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 232275 Joules per run.16. Xeon 6780E 2P: Approximate power consumption of 245873 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 196584 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 205455 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 254737 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 232837 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 296866 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 279287 Joules per run.

BRL-CAD

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.38.2VGR Performance MetricEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 9654EPYC 9684XXeon 6780E 2PXeon Platinum 8380 2PXeon 6766E 2PXeon 6780EXeon 6766EXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon Platinum 83801.3M2.6M3.9M5.2M6.5M6193921616222858617505186677413696940753423658790348447731612163122574244933423009472239294164092115084539169048519978338927713527678127139374308851. (CXX) g++ options: -std=c++17 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lnetpbm -lregex_brl -lz_brl -lassimp -ldl -lm -ltk8.6
OpenBenchmarking.orgVGR Performance Metric Per Watt, More Is BetterBRL-CAD 7.38.2VGR Performance MetricEPYC 9754Xeon 6780EXeon 6766EEPYC 9654EPYC 9754 2PEPYC 9684XEPYC 9654 2PEPYC 9684X 2PXeon 6780E 2PXeon 6766E 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 83808K16K24K32K40K37864.3032830.8431502.6829152.6027017.5825526.5124316.7822179.7919660.2318379.5216724.4412829.7111028.5610350.369409.685662.825198.182664.372427.742224.182072.641618.73
OpenBenchmarking.orgWatts, Fewer Is BetterBRL-CAD 7.38.2CPU Power Consumption MonitorXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon 6766E 2PEPYC 9684XXeon 6780E 2PEPYC 8534PNEPYC 8534PXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8380EPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Max 9468Xeon Max 9480Xeon Max 9468 2PXeon Max 9480 2P120240360480600Min: 25.35 / Avg: 47.88 / Max: 126.8Min: 25.76 / Avg: 49.98 / Max: 125.15Min: 22.32 / Avg: 92.03 / Max: 203.56Min: 28.28 / Avg: 108.44 / Max: 203.49Min: 105.15 / Avg: 121.84 / Max: 271.57Min: 34.41 / Avg: 122.33 / Max: 239.91Min: 57.85 / Avg: 124.58 / Max: 275.76Min: 17.89 / Avg: 136.21 / Max: 145.86Min: 18.92 / Avg: 163.9 / Max: 176.64Min: 103.18 / Avg: 208.64 / Max: 389.7Min: 38.73 / Avg: 216.96 / Max: 349.83Min: 57.06 / Avg: 253.41 / Max: 398.05Min: 52.77 / Avg: 266.19 / Max: 290.62Min: 66.5 / Avg: 279.26 / Max: 433.32Min: 79.71 / Avg: 310.13 / Max: 513.39Min: 160.81 / Avg: 322.45 / Max: 464.17Min: 55.92 / Avg: 343.48 / Max: 378.71Min: 34.18 / Avg: 344.14 / Max: 378.43Min: 74.08 / Avg: 344.46 / Max: 376.78Min: 92.69 / Avg: 345.21 / Max: 376.35Min: 215.09 / Avg: 388.83 / Max: 623.48Min: 205.29 / Avg: 393.74 / Max: 656.23

Xcompact3d Incompact3d

Xcompact3d Incompact3d is a Fortran-MPI based, finite difference high-performance code for solving the incompressible Navier-Stokes equation and as many as you need scalar transport equations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: X3D-benchmarking input.i3dEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8380 2PEPYC 9684XXeon Platinum 8592+Xeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 9654EPYC 9754Xeon Platinum 8380EPYC 8534PEPYC 8534PN120240360480600SE +/- 2.20, N = 12SE +/- 0.37, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 3.26, N = 9SE +/- 9.13, N = 9SE +/- 1.19, N = 3SE +/- 3.06, N = 9SE +/- 2.51, N = 3SE +/- 0.14, N = 3SE +/- 3.88, N = 4SE +/- 1.25, N = 3SE +/- 4.73, N = 3SE +/- 5.39, N = 3SE +/- 0.13, N = 3SE +/- 0.92, N = 3SE +/- 0.22, N = 3167.13171.38187.22189.69196.81248.87253.32292.03309.85323.25351.64357.01407.59466.55534.06558.38567.29568.251. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
OpenBenchmarking.orgWatts, Fewer Is BetterXcompact3d Incompact3d 2021-03-11CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon Platinum 8380EPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Max 9468Xeon Platinum 8490HXeon Max 9480EPYC 9684XXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P140280420560700Min: 16.95 / Avg: 129.67 / Max: 136.25Min: 19.39 / Avg: 140.74 / Max: 150Min: 52.82 / Avg: 267.65 / Max: 283.3Min: 11.29 / Avg: 271.32 / Max: 306.5Min: 30.46 / Avg: 296.94 / Max: 321.61Min: 23.89 / Avg: 333.9 / Max: 356.36Min: 73.01 / Avg: 342.5 / Max: 356.35Min: 59.93 / Avg: 344.75 / Max: 358.18Min: 80.13 / Avg: 345.35 / Max: 367.23Min: 33.87 / Avg: 359.91 / Max: 399.74Min: 101.33 / Avg: 531.6 / Max: 556.64Min: 38.21 / Avg: 591.17 / Max: 651.55Min: 56.03 / Avg: 638.9 / Max: 677.63Min: 77.71 / Avg: 675.14 / Max: 722.78Min: 158.32 / Avg: 681.46 / Max: 722.98Min: 203.67 / Avg: 685.84 / Max: 731.99Min: 201.23 / Avg: 686.09 / Max: 746.29Min: 66.18 / Avg: 750.96 / Max: 804.81. EPYC 8534PN: Approximate power consumption of 74775 Joules per run.2. EPYC 8534P: Approximate power consumption of 80973 Joules per run.3. Xeon Platinum 8380: Approximate power consumption of 151490 Joules per run.4. EPYC 9754: Approximate power consumption of 146786 Joules per run.5. EPYC 9654: Approximate power consumption of 140452 Joules per run.6. Xeon Platinum 8592+: Approximate power consumption of 110187 Joules per run.7. Xeon Max 9468: Approximate power consumption of 141796 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 125920 Joules per run.9. Xeon Max 9480: Approximate power consumption of 123521 Joules per run.10. EPYC 9684X: Approximate power consumption of 113971 Joules per run.11. Xeon Platinum 8380 2P: Approximate power consumption of 158948 Joules per run.12. EPYC 9754 2P: Approximate power consumption of 157054 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 164481 Joules per run.14. Xeon Platinum 8592+ 2P: Approximate power consumption of 121975 Joules per run.15. Xeon Platinum 8490H 2P: Approximate power consumption of 141289 Joules per run.16. Xeon Max 9468 2P: Approximate power consumption of 135111 Joules per run.17. Xeon Max 9480 2P: Approximate power consumption of 134016 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 132043 Joules per run.

CloverLeaf

CloverLeaf is a Lagrangian-Eulerian hydrodynamics benchmark. This test profile currently makes use of CloverLeaf's OpenMP version. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm16Xeon Platinum 8490H 2PEPYC 9684X 2PXeon 6766E 2PXeon 6780E 2PEPYC 9684XXeon Max 9468 2PEPYC 9654 2PXeon Max 9480 2PXeon Platinum 8380 2PXeon 6780EXeon 6766EXeon Platinum 8490HEPYC 9654EPYC 9754 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon Platinum 8380110220330440550SE +/- 0.74, N = 3SE +/- 0.59, N = 3SE +/- 1.60, N = 12SE +/- 2.04, N = 3SE +/- 2.24, N = 3SE +/- 1.56, N = 3SE +/- 0.12, N = 3SE +/- 2.11, N = 9SE +/- 3.41, N = 3SE +/- 0.00, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 3SE +/- 3.79, N = 9SE +/- 1.02, N = 3SE +/- 1.43, N = 3SE +/- 2.03, N = 3SE +/- 2.02, N = 3SE +/- 4.99, N = 9SE +/- 0.54, N = 3SE +/- 0.79, N = 3SE +/- 1.08, N = 3SE +/- 1.58, N = 3214.80223.54226.60236.81245.82263.33266.10269.20295.30313.50314.88328.47334.30349.67351.29357.57378.05400.52410.59495.25498.22512.361. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
OpenBenchmarking.orgWatts, Fewer Is BetterCloverLeaf 1.3CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EEPYC 9654Xeon Platinum 8380Xeon Platinum 8592+EPYC 9684XXeon Max 9468Xeon Platinum 8490HXeon Max 9480EPYC 9754 2PXeon 6766E 2PXeon 6780E 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2P130260390520650Min: 18.03 / Avg: 132.66 / Max: 136.36Min: 18.26 / Avg: 143.82 / Max: 147.88Min: 43.58 / Avg: 186.46 / Max: 191.98Min: 19.15 / Avg: 200.7 / Max: 237.69Min: 43.52 / Avg: 205.96 / Max: 212.24Min: 28.5 / Avg: 250.17 / Max: 287.09Min: 48.92 / Avg: 267.62 / Max: 276.86Min: 33.19 / Avg: 289.13 / Max: 310.83Min: 34.9 / Avg: 301.76 / Max: 361.01Min: 71.71 / Avg: 345.92 / Max: 368.64Min: 57.58 / Avg: 346.05 / Max: 371.34Min: 75.8 / Avg: 346.15 / Max: 373.49Min: 42.42 / Avg: 388.45 / Max: 400.3Min: 105.62 / Avg: 440.67 / Max: 468.45Min: 107.68 / Avg: 466.63 / Max: 492.37Min: 57.96 / Avg: 483.81 / Max: 500.79Min: 76.61 / Avg: 524.03 / Max: 570.93Min: 105.53 / Avg: 529.36 / Max: 542.31Min: 66.27 / Avg: 538.72 / Max: 566.53Min: 198.24 / Avg: 677.8 / Max: 709.86Min: 200.21 / Avg: 680.25 / Max: 711.02Min: 171.76 / Avg: 685.99 / Max: 712.371. EPYC 8534PN: Approximate power consumption of 66418 Joules per run.2. EPYC 8534P: Approximate power consumption of 71572 Joules per run.3. Xeon 6766E: Approximate power consumption of 59418 Joules per run.4. EPYC 9754: Approximate power consumption of 80950 Joules per run.5. Xeon 6780E: Approximate power consumption of 65291 Joules per run.6. EPYC 9654: Approximate power consumption of 84308 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 137915 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 119603 Joules per run.9. EPYC 9684X: Approximate power consumption of 75239 Joules per run.10. Xeon Max 9468: Approximate power consumption of 122685 Joules per run.11. Xeon Platinum 8490H: Approximate power consumption of 114774 Joules per run.12. Xeon Max 9480: Approximate power consumption of 124846 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 136735 Joules per run.14. Xeon 6766E 2P: Approximate power consumption of 101538 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 112457 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 129983 Joules per run.17. Xeon Platinum 8592+ 2P: Approximate power consumption of 200007 Joules per run.18. Xeon Platinum 8380 2P: Approximate power consumption of 158279 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 121929 Joules per run.20. Xeon Max 9468 2P: Approximate power consumption of 180972 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 185480 Joules per run.22. Xeon Platinum 8490H 2P: Approximate power consumption of 150460 Joules per run.

ASKAP

ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMillion Grid Points Per Second, More Is BetterASKAP 1.0Test: tConvolve MT - GriddingEPYC 9684XEPYC 9684X 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9754 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 8534PEPYC 8534PNXeon Platinum 8380 2PXeon Platinum 8380Xeon Platinum 8592+Xeon Max 9480 2PXeon Max 9480Xeon Max 9468Xeon Max 9468 2P3K6K9K12K15KSE +/- 262.30, N = 12SE +/- 204.28, N = 3SE +/- 2.09, N = 3SE +/- 141.43, N = 5SE +/- 59.24, N = 3SE +/- 21.01, N = 3SE +/- 4.15, N = 3SE +/- 75.19, N = 5SE +/- 60.72, N = 3SE +/- 0.88, N = 3SE +/- 0.88, N = 3SE +/- 19.36, N = 3SE +/- 6.18, N = 3SE +/- 54.27, N = 5SE +/- 195.28, N = 8SE +/- 32.87, N = 12SE +/- 87.89, N = 12SE +/- 23.56, N = 314955.6014185.1012731.8012708.5012394.6011208.708088.117630.066038.925826.445821.465279.075172.965062.074382.973406.963375.323347.931. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

OpenBenchmarking.orgMillion Grid Points Per Second, More Is BetterASKAP 1.0Test: tConvolve MT - DegriddingEPYC 9684X 2PEPYC 9654EPYC 9684XEPYC 9754 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9754Xeon Platinum 8380EPYC 8534PNEPYC 8534P4K8K12K16K20KSE +/- 889.21, N = 3SE +/- 128.32, N = 3SE +/- 212.00, N = 12SE +/- 345.37, N = 3SE +/- 267.65, N = 5SE +/- 322.56, N = 3SE +/- 25.80, N = 3SE +/- 3.76, N = 3SE +/- 0.54, N = 3SE +/- 34.17, N = 316906.2014217.1014143.1013455.0011941.309893.329839.647425.227421.237382.431. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
OpenBenchmarking.orgMillion Grid Points Per Second Per Watt, More Is BetterASKAP 1.0Test: tConvolve MT - DegriddingEPYC 9654EPYC 8534PNEPYC 8534PEPYC 9684XEPYC 9754EPYC 9754 2PEPYC 9684X 2PXeon Platinum 8380EPYC 9654 2PXeon Platinum 8380 2P2040608010089.4585.7379.9576.9276.5650.1846.1940.3936.6830.49
OpenBenchmarking.orgWatts, Fewer Is BetterASKAP 1.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8380EPYC 9684XEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2P120240360480600Min: 16.96 / Avg: 86.56 / Max: 131.98Min: 18.79 / Avg: 92.34 / Max: 148.64Min: 22.06 / Avg: 128.52 / Max: 260.19Min: 28.79 / Avg: 158.94 / Max: 298.53Min: 52.13 / Avg: 183.83 / Max: 281.05Min: 33.59 / Avg: 183.88 / Max: 366.01Min: 41.03 / Avg: 268.12 / Max: 506.15Min: 103.44 / Avg: 324.5 / Max: 557.49Min: 56.13 / Avg: 325.56 / Max: 537.83Min: 66.87 / Avg: 365.98 / Max: 703.861. EPYC 8534PN: Approximate power consumption of 18755 Joules per run.2. EPYC 8534P: Approximate power consumption of 20068 Joules per run.3. EPYC 9754: Approximate power consumption of 44082 Joules per run.4. EPYC 9654: Approximate power consumption of 34597 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 25614 Joules per run.6. EPYC 9684X: Approximate power consumption of 38813 Joules per run.7. EPYC 9754 2P: Approximate power consumption of 176601 Joules per run.8. Xeon Platinum 8380 2P: Approximate power consumption of 84478 Joules per run.9. EPYC 9654 2P: Approximate power consumption of 144095 Joules per run.10. EPYC 9684X 2P: Approximate power consumption of 150783 Joules per run.

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 256 - Model: ResNet-152Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8380Xeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8380 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654Xeon 6780EEPYC 8534PEPYC 8534PNXeon 6766EEPYC 9754EPYC 9654 2PEPYC 9684X 2PXeon 6780E 2PXeon 6766E 2PEPYC 9754 2P612182430SE +/- 0.29, N = 3SE +/- 0.08, N = 3SE +/- 0.15, N = 3SE +/- 0.15, N = 3SE +/- 0.05, N = 3SE +/- 0.09, N = 3SE +/- 0.16, N = 3SE +/- 0.18, N = 4SE +/- 0.08, N = 3SE +/- 0.20, N = 3SE +/- 0.13, N = 7SE +/- 0.11, N = 3SE +/- 0.19, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.15, N = 3SE +/- 0.13, N = 9SE +/- 0.13, N = 9SE +/- 0.04, N = 3SE +/- 0.06, N = 9SE +/- 0.12, N = 923.3320.2519.5819.2017.7016.3016.0014.9214.8814.0814.0813.9513.6413.2613.1811.8811.017.147.026.616.115.71
OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 256 - Model: ResNet-152EPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon 6780EXeon 6766EXeon Platinum 8380Xeon Platinum 8490HEPYC 9654Xeon Max 9480Xeon Max 9468EPYC 9754EPYC 9684XXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon 6780E 2PXeon 6766E 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P0.02840.05680.08520.11360.1420.1260.1140.0880.0800.0800.0800.0760.0680.0680.0680.0670.0570.0430.0300.0270.0270.0250.0190.0190.0180.0180.015
OpenBenchmarking.orgWatts, Fewer Is BetterPyTorch 2.2.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EEPYC 9654Xeon Platinum 8380EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9754 2PXeon 6766E 2PXeon 6780E 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2P110220330440550Min: 16.06 / Avg: 104.56 / Max: 112.26Min: 20.38 / Avg: 115.97 / Max: 125.68Min: 43.61 / Avg: 148.21 / Max: 158.39Min: 21.41 / Avg: 165.14 / Max: 176.25Min: 43.46 / Avg: 170.76 / Max: 186.26Min: 27.5 / Avg: 205.23 / Max: 220.66Min: 54.09 / Avg: 220.44 / Max: 241.42Min: 34.62 / Avg: 245.31 / Max: 264.74Min: 33.57 / Avg: 265.19 / Max: 292.3Min: 59.27 / Avg: 266.18 / Max: 295.86Min: 77.22 / Avg: 282.52 / Max: 309.36Min: 76.6 / Avg: 288.21 / Max: 321.16Min: 40.42 / Avg: 321.8 / Max: 358.12Min: 105.8 / Avg: 329.47 / Max: 356.81Min: 107.99 / Avg: 344.44 / Max: 394.7Min: 102.28 / Avg: 349.96 / Max: 424.69Min: 56.85 / Avg: 395.96 / Max: 433.04Min: 63.41 / Avg: 457.61 / Max: 501.36Min: 161.77 / Avg: 525.94 / Max: 589.73Min: 78.85 / Avg: 540.82 / Max: 576.97Min: 199.23 / Avg: 598.06 / Max: 629.15Min: 199.11 / Avg: 604.22 / Max: 644.891. EPYC 8534PN: Approximate power consumption of 17218 Joules per run.2. EPYC 8534P: Approximate power consumption of 19096 Joules per run.3. Xeon 6766E: Approximate power consumption of 27320 Joules per run.4. EPYC 9754: Approximate power consumption of 31707 Joules per run.5. Xeon 6780E: Approximate power consumption of 28062 Joules per run.6. EPYC 9654: Approximate power consumption of 32221 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 26527 Joules per run.8. EPYC 9684X: Approximate power consumption of 38023 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 25370 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 31587 Joules per run.11. Xeon Max 9468: Approximate power consumption of 34750 Joules per run.12. Xeon Max 9480: Approximate power consumption of 41598 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 118923 Joules per run.14. Xeon 6766E 2P: Approximate power consumption of 137572 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 226871 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 52610 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 117160 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 137689 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 83774 Joules per run.20. Xeon Platinum 8592+ 2P: Approximate power consumption of 76436 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 82532 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 97732 Joules per run.

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average LatencyEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9754EPYC 9654 2PEPYC 9754 2PEPYC 8534PEPYC 8534PNXeon Platinum 8380 2PXeon 6780EXeon Max 9468Xeon Platinum 8490HXeon 6766EXeon Platinum 8380Xeon Platinum 8592+Xeon Max 9480Xeon 6780E 2PXeon 6766E 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2P0.29090.58180.87271.16361.4545SE +/- 0.002, N = 3SE +/- 0.003, N = 3SE +/- 0.006, N = 12SE +/- 0.001, N = 3SE +/- 0.004, N = 12SE +/- 0.001, N = 3SE +/- 0.002, N = 3SE +/- 0.001, N = 3SE +/- 0.022, N = 9SE +/- 0.006, N = 5SE +/- 0.008, N = 12SE +/- 0.007, N = 3SE +/- 0.007, N = 3SE +/- 0.005, N = 3SE +/- 0.005, N = 12SE +/- 0.007, N = 3SE +/- 0.008, N = 12SE +/- 0.009, N = 12SE +/- 0.017, N = 9SE +/- 0.038, N = 9SE +/- 0.040, N = 12SE +/- 0.030, N = 120.2510.2780.2890.2920.2930.3290.3840.4140.5250.5420.5590.5720.5720.5810.5890.6220.7750.8151.0271.0981.1491.2931. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgWatts, Fewer Is BetterPostgreSQL 16CPU Power Consumption MonitorEPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EXeon Platinum 8380Xeon 6766E 2PEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon 6780E 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9684XEPYC 9754 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P120240360480600Min: 15.23 / Avg: 121.21 / Max: 140.08Min: 43.55 / Avg: 127.3 / Max: 157.98Min: 18.63 / Avg: 138.72 / Max: 161.44Min: 43.45 / Avg: 153.46 / Max: 193.17Min: 54.25 / Avg: 239.92 / Max: 291.32Min: 55.77 / Avg: 244.42 / Max: 350.99Min: 21.35 / Avg: 253.4 / Max: 320.46Min: 27.65 / Avg: 271.07 / Max: 317.83Min: 31.51 / Avg: 271.55 / Max: 343.13Min: 107.71 / Avg: 276.72 / Max: 373.07Min: 56.77 / Avg: 302.76 / Max: 366.57Min: 71.87 / Avg: 311.81 / Max: 377.7Min: 78.53 / Avg: 316.32 / Max: 367.54Min: 33.83 / Avg: 355.49 / Max: 410.22Min: 40.49 / Avg: 404.84 / Max: 498.33Min: 104.48 / Avg: 468.46 / Max: 563.8Min: 70.21 / Avg: 487.56 / Max: 585.59Min: 53.13 / Avg: 495.05 / Max: 595.37Min: 163.81 / Avg: 544.97 / Max: 640.25Min: 136.51 / Avg: 563.23 / Max: 663.44Min: 199.74 / Avg: 578.23 / Max: 678.5Min: 61.31 / Avg: 584.31 / Max: 698.791. EPYC 8534PN: Approximate power consumption of 17374 Joules per run.2. Xeon 6766E: Approximate power consumption of 18247 Joules per run.3. EPYC 8534P: Approximate power consumption of 19884 Joules per run.4. Xeon 6780E: Approximate power consumption of 21883 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 34149 Joules per run.6. Xeon 6766E 2P: Approximate power consumption of 35604 Joules per run.7. EPYC 9754: Approximate power consumption of 36236 Joules per run.8. EPYC 9654: Approximate power consumption of 38673 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 38130 Joules per run.10. Xeon 6780E 2P: Approximate power consumption of 40079 Joules per run.11. Xeon Platinum 8490H: Approximate power consumption of 42588 Joules per run.12. Xeon Max 9468: Approximate power consumption of 43913 Joules per run.13. Xeon Max 9480: Approximate power consumption of 44496 Joules per run.14. EPYC 9684X: Approximate power consumption of 50242 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 57757 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 66625 Joules per run.17. Xeon Platinum 8592+ 2P: Approximate power consumption of 68218 Joules per run.18. EPYC 9654 2P: Approximate power consumption of 69967 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 76387 Joules per run.20. Xeon Max 9468 2P: Approximate power consumption of 79415 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 81659 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 82534 Joules per run.

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read OnlyEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon Platinum 8380 2PXeon 6780EXeon Max 9468Xeon 6766EXeon Platinum 8490HXeon Platinum 8380Xeon Platinum 8592+Xeon Max 9480Xeon 6780E 2PXeon 6766E 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2P900K1800K2700K3600K4500KSE +/- 27594.68, N = 3SE +/- 39970.22, N = 3SE +/- 71870.42, N = 12SE +/- 41074.86, N = 12SE +/- 15503.17, N = 3SE +/- 13473.87, N = 3SE +/- 11512.67, N = 3SE +/- 4774.62, N = 3SE +/- 74539.48, N = 9SE +/- 19583.16, N = 5SE +/- 24978.23, N = 12SE +/- 20221.52, N = 3SE +/- 20350.34, N = 3SE +/- 13469.59, N = 3SE +/- 13863.97, N = 12SE +/- 17697.00, N = 3SE +/- 13233.94, N = 12SE +/- 13874.42, N = 12SE +/- 16726.04, N = 9SE +/- 36627.33, N = 9SE +/- 30933.90, N = 12SE +/- 18635.21, N = 123989358360326134809093422731342249230446202606500241637519300061846080179263617486581748146172076216990461607424129212212296499760359207258818817781411. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: ResNet-50Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8380 2PEPYC 9754Xeon Max 9480EPYC 9684XEPYC 9684X 2PXeon Max 9468Xeon 6780E 2PXeon 6766E 2PEPYC 8534PEPYC 8534PNXeon 6780EXeon Platinum 8380Xeon 6766E4080120160200SE +/- 1.57, N = 3SE +/- 0.21, N = 3SE +/- 0.03, N = 3SE +/- 1.40, N = 3SE +/- 0.66, N = 3SE +/- 1.04, N = 12SE +/- 0.57, N = 3SE +/- 0.18, N = 3SE +/- 0.58, N = 3SE +/- 0.46, N = 3SE +/- 2.00, N = 12SE +/- 0.63, N = 3SE +/- 1.39, N = 4SE +/- 0.50, N = 3SE +/- 0.14, N = 3SE +/- 0.54, N = 3SE +/- 0.48, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3161.06150.33143.67141.95138.11135.28133.87131.38129.02125.91125.76123.69123.37120.11119.73115.12103.2298.7092.8292.4291.6587.17
OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: ResNet-50EPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon 6766EXeon Platinum 8490HEPYC 9684XXeon 6780EXeon Max 9480Xeon Max 9468Xeon Platinum 8380EPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PEPYC 9654 2PXeon 6766E 2PXeon Platinum 8490H 2PXeon 6780E 2PXeon Max 9468 2PEPYC 9684X 2PXeon Max 9480 2P0.15550.3110.46650.6220.77750.6910.6460.5250.4850.4630.4380.4250.3850.3820.3630.3540.3520.2910.2780.2540.2520.2470.2430.2420.2100.2030.200
OpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.16.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EXeon Platinum 8380Xeon Platinum 8592+EPYC 9654EPYC 9684XXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon 6766E 2PEPYC 9754 2PXeon 6780E 2PXeon Platinum 8380 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P130260390520650Min: 16.01 / Avg: 134.32 / Max: 142.38Min: 18.72 / Avg: 152.81 / Max: 164.9Min: 43.62 / Avg: 198.95 / Max: 223.14Min: 20.95 / Avg: 239.33 / Max: 288.65Min: 43.44 / Avg: 241.64 / Max: 277.25Min: 54.97 / Avg: 260.49 / Max: 276.51Min: 33.15 / Avg: 278.36 / Max: 312.29Min: 29.3 / Avg: 284.71 / Max: 314.17Min: 33.82 / Avg: 320.09 / Max: 348.64Min: 59.06 / Avg: 338.33 / Max: 360.73Min: 73.46 / Avg: 338.38 / Max: 359.94Min: 77.09 / Avg: 340.59 / Max: 361.18Min: 104.82 / Avg: 417.33 / Max: 477.08Min: 43.33 / Avg: 451.33 / Max: 504.94Min: 107.7 / Avg: 475.01 / Max: 547.45Min: 100.88 / Avg: 496.59 / Max: 533.47Min: 53.87 / Avg: 531.98 / Max: 578.15Min: 84.37 / Avg: 540.26 / Max: 604.56Min: 58.73 / Avg: 590.53 / Max: 641.68Min: 163.23 / Avg: 663.98 / Max: 713.39Min: 203.91 / Avg: 674.94 / Max: 716.61Min: 196.92 / Avg: 674.95 / Max: 729.371. EPYC 8534PN: Approximate power consumption of 42266 Joules per run.2. EPYC 8534P: Approximate power consumption of 45284 Joules per run.3. Xeon 6766E: Approximate power consumption of 67311 Joules per run.4. EPYC 9754: Approximate power consumption of 55424 Joules per run.5. Xeon 6780E: Approximate power consumption of 77084 Joules per run.6. Xeon Platinum 8380: Approximate power consumption of 82748 Joules per run.7. Xeon Platinum 8592+: Approximate power consumption of 64116 Joules per run.8. EPYC 9654: Approximate power consumption of 60832 Joules per run.9. EPYC 9684X: Approximate power consumption of 76021 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 70035 Joules per run.11. Xeon Max 9468: Approximate power consumption of 84933 Joules per run.12. Xeon Max 9480: Approximate power consumption of 82649 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 123112 Joules per run.14. EPYC 9754 2P: Approximate power consumption of 102754 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 127620 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 118851 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 117567 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 109132 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 144483 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 126378 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 143762 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 152651 Joules per run.

OpenSSL

OpenBenchmarking.orgverify/s, More Is BetterOpenSSL 3.3Algorithm: RSA4096EPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754Xeon 6780E 2PXeon Max 9480 2PEPYC 9684XXeon 6766E 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8380 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PXeon 6780EXeon Max 9480EPYC 8534PNXeon 6766EXeon Max 9468Xeon Platinum 8380800K1600K2400K3200K4000KSE +/- 2222.55, N = 3SE +/- 6125.37, N = 3SE +/- 5.26, N = 3SE +/- 6745.42, N = 3SE +/- 862.96, N = 3SE +/- 444.74, N = 3SE +/- 205.33, N = 3SE +/- 277.84, N = 3SE +/- 1576.96, N = 3SE +/- 37.76, N = 3SE +/- 149.48, N = 3SE +/- 355.69, N = 3SE +/- 40228.60, N = 3SE +/- 92.62, N = 3SE +/- 92.46, N = 3SE +/- 126.84, N = 3SE +/- 23.84, N = 3SE +/- 200.66, N = 3SE +/- 136.07, N = 3SE +/- 9.55, N = 3SE +/- 165.80, N = 3SE +/- 198.68, N = 33729470.83214376.32861959.82057021.61916162.91872096.11644363.71627941.41613828.71479879.01436324.91395446.41099481.51036735.6974189.9881480.8826049.5813667.6810291.8743282.7697707.2587354.81. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenBenchmarking.orgverify/s Per Watt, More Is BetterOpenSSL 3.3Algorithm: RSA4096EPYC 8534PNEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 9654EPYC 9654 2PXeon 6766EEPYC 9684XEPYC 9684X 2PXeon 6766E 2PXeon 6780EXeon 6780E 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9480 2PXeon Max 9468Xeon Platinum 8380Xeon Max 9468 2PXeon Platinum 8380 2P140028004200560070006595.715836.735696.675691.684919.814728.284295.144121.234099.334004.983735.683600.283030.662997.552907.572791.772489.802430.792306.662215.622215.412079.56
OpenBenchmarking.orgWatts, Fewer Is BetterOpenSSL 3.3CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Platinum 8380EPYC 9654Xeon Max 9468EPYC 9754Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+Xeon 6766E 2PEPYC 9684XXeon 6780E 2PXeon Platinum 8380 2PEPYC 9654 2PXeon Max 9468 2PEPYC 9754 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684X 2P140280420560700Min: 16.2 / Avg: 122.85 / Max: 135.57Min: 15.75 / Avg: 154.87 / Max: 162.9Min: 43.61 / Avg: 173.05 / Max: 179.47Min: 43.31 / Avg: 221.12 / Max: 231.86Min: 52.16 / Avg: 265.1 / Max: 290.58Min: 27.6 / Avg: 291.95 / Max: 323.61Min: 73.89 / Avg: 302.47 / Max: 335.7Min: 19.93 / Avg: 320.74 / Max: 351.44Min: 74.71 / Avg: 326.8 / Max: 367.81Min: 56.91 / Avg: 335.05 / Max: 351.44Min: 32.63 / Avg: 342.08 / Max: 377.97Min: 104.34 / Avg: 369.51 / Max: 384.07Min: 32.96 / Avg: 391.59 / Max: 411.04Min: 107.48 / Avg: 456.73 / Max: 473.49Min: 99.67 / Avg: 528.71 / Max: 581.74Min: 59.69 / Avg: 605.29 / Max: 659.72Min: 198.5 / Avg: 629.88 / Max: 694.83Min: 43.66 / Avg: 654.68 / Max: 716.5Min: 199.02 / Avg: 669.72 / Max: 754.93Min: 70.64 / Avg: 686.24 / Max: 753.6Min: 165.7 / Avg: 686.36 / Max: 737.53Min: 64.61 / Avg: 784.12 / Max: 822.11. EPYC 8534PN: Approximate power consumption of 38412 Joules per run.2. EPYC 8534P: Approximate power consumption of 48165 Joules per run.3. Xeon 6766E: Approximate power consumption of 54684 Joules per run.4. Xeon 6780E: Approximate power consumption of 69875 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 82622 Joules per run.6. EPYC 9654: Approximate power consumption of 90796 Joules per run.7. Xeon Max 9468: Approximate power consumption of 93969 Joules per run.8. EPYC 9754: Approximate power consumption of 99538 Joules per run.9. Xeon Max 9480: Approximate power consumption of 101853 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 104090 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 106730 Joules per run.12. Xeon 6766E 2P: Approximate power consumption of 116888 Joules per run.13. EPYC 9684X: Approximate power consumption of 121131 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 143414 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 164957 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 187638 Joules per run.17. Xeon Max 9468 2P: Approximate power consumption of 196103 Joules per run.18. EPYC 9754 2P: Approximate power consumption of 203168 Joules per run.19. Xeon Max 9480 2P: Approximate power consumption of 208059 Joules per run.20. Xeon Platinum 8592+ 2P: Approximate power consumption of 213419 Joules per run.21. Xeon Platinum 8490H 2P: Approximate power consumption of 214145 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 241771 Joules per run.

OpenBenchmarking.orgsign/s, More Is BetterOpenSSL 3.3Algorithm: RSA4096EPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9684XXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PXeon Max 9480Xeon 6780E 2PXeon Max 9468Xeon 6766E 2PEPYC 8534PNXeon Platinum 8380Xeon 6780EXeon 6766E20K40K60K80K100KSE +/- 80.37, N = 3SE +/- 247.60, N = 3SE +/- 81.38, N = 3SE +/- 56.68, N = 3SE +/- 14.34, N = 3SE +/- 27.42, N = 3SE +/- 98.71, N = 3SE +/- 83.09, N = 3SE +/- 6.92, N = 3SE +/- 108.70, N = 3SE +/- 29.11, N = 3SE +/- 15.15, N = 3SE +/- 9.84, N = 3SE +/- 22.17, N = 3SE +/- 20.13, N = 3SE +/- 8.20, N = 3SE +/- 19.45, N = 3SE +/- 8.25, N = 3SE +/- 12.56, N = 3SE +/- 40.37, N = 3SE +/- 1.63, N = 3SE +/- 1.37, N = 3107830.698237.071942.061499.654601.153966.948996.848534.845531.036371.635964.931594.427431.125894.625441.525098.022861.022587.421047.518389.312610.811348.51. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

Timed Linux Kernel Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: allmodconfigXeon 6780E 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon 6766E 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon 6780EXeon 6766EEPYC 9684XEPYC 9654Xeon Platinum 8592+EPYC 9754Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480EPYC 8534PXeon Max 9468EPYC 8534PNXeon Platinum 8380130260390520650SE +/- 0.90, N = 3SE +/- 0.98, N = 3SE +/- 0.56, N = 3SE +/- 0.81, N = 3SE +/- 0.49, N = 3SE +/- 1.31, N = 3SE +/- 0.86, N = 3SE +/- 0.73, N = 3SE +/- 0.56, N = 3SE +/- 0.67, N = 3SE +/- 0.76, N = 3SE +/- 0.37, N = 3SE +/- 0.49, N = 3SE +/- 0.72, N = 3SE +/- 1.05, N = 3SE +/- 0.92, N = 3SE +/- 0.80, N = 3SE +/- 0.67, N = 3SE +/- 0.91, N = 3SE +/- 0.61, N = 3SE +/- 0.78, N = 3SE +/- 0.35, N = 3174.27182.00189.74192.10197.63210.20218.57231.03246.94251.20274.86290.34311.83316.90337.69356.99362.45384.06406.41428.39438.17612.78
OpenBenchmarking.orgWatts, Fewer Is BetterTimed Linux Kernel Compilation 6.8CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Platinum 8380EPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon 6766E 2PEPYC 9684XXeon 6780E 2PEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Max 9480 2PXeon Max 9468 2P150300450600750Min: 16.08 / Avg: 129.6 / Max: 144.82Min: 16.91 / Avg: 150.79 / Max: 171.19Min: 43.57 / Avg: 201.59 / Max: 252.67Min: 43.47 / Avg: 255.14 / Max: 329.17Min: 50.2 / Avg: 256.23 / Max: 291.69Min: 19.75 / Avg: 262.8 / Max: 335.9Min: 27.23 / Avg: 282.28 / Max: 331.17Min: 25.82 / Avg: 317.64 / Max: 378.37Min: 56.91 / Avg: 323.36 / Max: 378.1Min: 81.1 / Avg: 330.36 / Max: 377.46Min: 70.17 / Avg: 330.93 / Max: 375.87Min: 104.5 / Avg: 339.12 / Max: 521.39Min: 34.02 / Avg: 348.42 / Max: 413.49Min: 106.41 / Avg: 416.56 / Max: 664.2Min: 40.54 / Avg: 484.57 / Max: 689.98Min: 99.55 / Avg: 491.75 / Max: 583.83Min: 54.45 / Avg: 525.29 / Max: 678.52Min: 85.15 / Avg: 585.62 / Max: 755.31Min: 162.47 / Avg: 610.89 / Max: 756.51Min: 63.59 / Avg: 621.64 / Max: 829.42Min: 185.35 / Avg: 634.18 / Max: 755.16Min: 200.9 / Avg: 639.43 / Max: 753.881. EPYC 8534PN: Approximate power consumption of 58837 Joules per run.2. EPYC 8534P: Approximate power consumption of 63736 Joules per run.3. Xeon 6766E: Approximate power consumption of 58662 Joules per run.4. Xeon 6780E: Approximate power consumption of 67953 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 160230 Joules per run.6. EPYC 9754: Approximate power consumption of 92857 Joules per run.7. EPYC 9654: Approximate power consumption of 91929 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 104399 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 121368 Joules per run.10. Xeon Max 9480: Approximate power consumption of 130824 Joules per run.11. Xeon Max 9468: Approximate power consumption of 145718 Joules per run.12. Xeon 6766E 2P: Approximate power consumption of 71668 Joules per run.13. EPYC 9684X: Approximate power consumption of 105921 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 80397 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 109513 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 181782 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 111186 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 118490 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 141727 Joules per run.20. EPYC 9684X 2P: Approximate power consumption of 121842 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 154530 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 166040 Joules per run.

Stockfish

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 16.1Chess BenchmarkEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon 6780E 2PXeon 6766E 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654EPYC 9754Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon 6780EXeon 6766EXeon Platinum 8592+Xeon Platinum 8380 2PEPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon Platinum 838090M180M270M360M450MSE +/- 919073.22, N = 3SE +/- 2356843.91, N = 3SE +/- 7961094.38, N = 12SE +/- 3095674.84, N = 3SE +/- 2692064.58, N = 4SE +/- 2482737.87, N = 3SE +/- 2268830.04, N = 3SE +/- 3170744.86, N = 15SE +/- 4652276.19, N = 12SE +/- 2148606.38, N = 4SE +/- 2925715.37, N = 11SE +/- 4344961.90, N = 10SE +/- 1441726.26, N = 3SE +/- 3565305.92, N = 15SE +/- 2966712.90, N = 9SE +/- 1325249.25, N = 3SE +/- 2397455.91, N = 12SE +/- 1304590.97, N = 3SE +/- 2147688.02, N = 12SE +/- 629927.17, N = 3SE +/- 1751369.24, N = 12SE +/- 1466028.98, N = 93991242233707515303012022322669198252354454992226103782145246591977083501897637991877617691494090821379772031251940661227942461097663451045972009919814496887479906581567359223068019088510995451. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver
OpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterStockfish 16.1Chess BenchmarkEPYC 8534PNEPYC 9754EPYC 9654EPYC 8534PEPYC 9684XEPYC 9654 2PEPYC 9684X 2PXeon 6766EXeon 6766E 2PEPYC 9754 2PXeon 6780E 2PXeon 6780EXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Platinum 8380 2PXeon Max 9468Xeon Platinum 8380130K260K390K520K650K621037.11571475.98569277.48568916.36555213.84540060.41520707.98509643.71496138.40470216.10431231.39403742.35331127.60325017.74285328.34276776.39219573.26215737.78202981.45201379.09199243.06193986.52
OpenBenchmarking.orgWatts, Fewer Is BetterStockfish 16.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon 6780EEPYC 9754Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9654EPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654 2PEPYC 9684X 2P140280420560700Min: 16.19 / Avg: 145.98 / Max: 155.71Min: 17.26 / Avg: 174.36 / Max: 184.62Min: 43.78 / Avg: 240.94 / Max: 270.17Min: 53.05 / Avg: 263.42 / Max: 290.77Min: 43.61 / Avg: 310.08 / Max: 337.09Min: 21.51 / Avg: 332.06 / Max: 363.69Min: 22.35 / Avg: 337.72 / Max: 370.84Min: 56.83 / Avg: 339.56 / Max: 379.91Min: 74.29 / Avg: 341.12 / Max: 366.15Min: 71.31 / Avg: 341.39 / Max: 379.06Min: 30.05 / Avg: 347.3 / Max: 373.1Min: 35.5 / Avg: 386.38 / Max: 410.66Min: 105.79 / Avg: 474.56 / Max: 541.15Min: 100.78 / Avg: 519.4 / Max: 581.59Min: 109.43 / Avg: 618.97 / Max: 701.47Min: 37.25 / Avg: 640.56 / Max: 735.74Min: 78.55 / Avg: 672.28 / Max: 755.5Min: 166.29 / Avg: 678.39 / Max: 758.17Min: 203.83 / Avg: 679.75 / Max: 756.48Min: 195.85 / Avg: 680.45 / Max: 758.53Min: 57.4 / Avg: 686.5 / Max: 751.79Min: 70.77 / Avg: 766.5 / Max: 822.061. EPYC 8534PN: Approximate power consumption of 19208 Joules per run.2. EPYC 8534P: Approximate power consumption of 20371 Joules per run.3. Xeon 6766E: Approximate power consumption of 27740 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 40040 Joules per run.5. Xeon 6780E: Approximate power consumption of 28528 Joules per run.6. EPYC 9754: Approximate power consumption of 41673 Joules per run.7. Xeon Platinum 8592+: Approximate power consumption of 41915 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 44483 Joules per run.9. Xeon Max 9480: Approximate power consumption of 47870 Joules per run.10. Xeon Max 9468: Approximate power consumption of 48989 Joules per run.11. EPYC 9654: Approximate power consumption of 31720 Joules per run.12. EPYC 9684X: Approximate power consumption of 32714 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 56116 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 64926 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 67055 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 77348 Joules per run.17. Xeon Platinum 8592+ 2P: Approximate power consumption of 80225 Joules per run.18. Xeon Platinum 8490H 2P: Approximate power consumption of 85138 Joules per run.19. Xeon Max 9468 2P: Approximate power consumption of 84357 Joules per run.20. Xeon Max 9480 2P: Approximate power consumption of 89882 Joules per run.21. EPYC 9654 2P: Approximate power consumption of 62700 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 63364 Joules per run.

Apache IoTDB

Apache IotDB is a time series database and this benchmark is facilitated using the IoT Benchmaark [https://github.com/thulab/iot-benchmark/]. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100EPYC 9684XEPYC 9654EPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon 6780EXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon 6766EXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8380Xeon 6780E 2PXeon Platinum 8380 2PXeon 6766E 2P20406080100SE +/- 0.23, N = 3SE +/- 0.31, N = 3SE +/- 0.10, N = 3SE +/- 0.65, N = 12SE +/- 0.59, N = 12SE +/- 0.03, N = 3SE +/- 0.31, N = 3SE +/- 0.79, N = 12SE +/- 0.68, N = 3SE +/- 0.80, N = 7SE +/- 0.15, N = 3SE +/- 0.15, N = 3SE +/- 0.87, N = 3SE +/- 0.48, N = 3SE +/- 0.11, N = 3SE +/- 1.18, N = 3SE +/- 1.01, N = 3SE +/- 1.11, N = 4SE +/- 0.43, N = 3SE +/- 0.65, N = 3SE +/- 0.53, N = 3SE +/- 1.37, N = 352.9353.7758.1161.0761.4664.9365.6666.5481.7382.7384.5985.1689.5390.0290.3192.2394.8495.39100.29101.49102.67107.28
OpenBenchmarking.orgWatts, Fewer Is BetterApache IoTDB 1.2CPU Power Consumption MonitorEPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8592+Xeon Platinum 8380Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8490HEPYC 9754 2PXeon Max 9468Xeon Max 9480EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P120240360480600Min: 16.39 / Avg: 76.32 / Max: 126.8Min: 33.17 / Avg: 80.98 / Max: 175.95Min: 17.66 / Avg: 82.51 / Max: 146.09Min: 43.43 / Avg: 87.52 / Max: 193.65Min: 21.8 / Avg: 110.92 / Max: 210.79Min: 25.56 / Avg: 138.03 / Max: 271.74Min: 34.95 / Avg: 157 / Max: 310.81Min: 33.72 / Avg: 171.59 / Max: 347.45Min: 55.72 / Avg: 176.97 / Max: 287.98Min: 104.7 / Avg: 186.81 / Max: 319.27Min: 60.48 / Avg: 192.21 / Max: 328.62Min: 60.93 / Avg: 216.73 / Max: 347.32Min: 41.52 / Avg: 220.99 / Max: 367.41Min: 72.55 / Avg: 249.87 / Max: 361.66Min: 86.91 / Avg: 254.04 / Max: 360.99Min: 56.18 / Avg: 264.94 / Max: 455.88Min: 74.41 / Avg: 298.36 / Max: 505.37Min: 106.1 / Avg: 305.48 / Max: 479.29Min: 77 / Avg: 337.01 / Max: 603.62Min: 171.93 / Avg: 425.12 / Max: 596.94Min: 212.09 / Avg: 494.07 / Max: 662.92Min: 218.55 / Avg: 495.29 / Max: 662.81. EPYC 8534PN: Approximate power consumption of 14653 Joules per run.2. Xeon 6766E: Approximate power consumption of 20137 Joules per run.3. EPYC 8534P: Approximate power consumption of 16172 Joules per run.4. Xeon 6780E: Approximate power consumption of 20831 Joules per run.5. EPYC 9754: Approximate power consumption of 19855 Joules per run.6. EPYC 9654: Approximate power consumption of 22913 Joules per run.7. EPYC 9684X: Approximate power consumption of 26009 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 39352 Joules per run.9. Xeon Platinum 8380: Approximate power consumption of 47075 Joules per run.10. Xeon 6766E 2P: Approximate power consumption of 55110 Joules per run.11. Xeon 6780E 2P: Approximate power consumption of 54780 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 49992 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 35249 Joules per run.14. Xeon Max 9468: Approximate power consumption of 61718 Joules per run.15. Xeon Max 9480: Approximate power consumption of 62409 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 39411 Joules per run.17. EPYC 9684X 2P: Approximate power consumption of 44779 Joules per run.18. Xeon Platinum 8380 2P: Approximate power consumption of 83294 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 67451 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 107414 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 129776 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 122214 Joules per run.

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100EPYC 9684XEPYC 9654EPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon 6780EXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon 6766EXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8380Xeon 6780E 2PXeon Platinum 8380 2PXeon 6766E 2P30M60M90M120M150MSE +/- 538692.55, N = 3SE +/- 665173.47, N = 3SE +/- 263772.09, N = 3SE +/- 1249999.63, N = 12SE +/- 1058559.19, N = 12SE +/- 41021.96, N = 3SE +/- 576868.09, N = 3SE +/- 1225528.40, N = 12SE +/- 739343.51, N = 3SE +/- 862582.24, N = 7SE +/- 174748.00, N = 3SE +/- 276414.35, N = 3SE +/- 782176.98, N = 3SE +/- 435900.66, N = 3SE +/- 84917.07, N = 3SE +/- 928557.10, N = 3SE +/- 594234.55, N = 3SE +/- 872659.60, N = 4SE +/- 306106.55, N = 3SE +/- 207721.96, N = 3SE +/- 365828.34, N = 3SE +/- 769517.20, N = 31447604481421022541317813091255956071249472881178849771168797991153178349461680792771639909734149087177086354518857445428511789783651785807704658013956676729495757401397517848071664005

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 512 - Model: ResNet-152Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8380Xeon Max 9468 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XXeon 6780EEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754EPYC 9654 2PEPYC 9684X 2PXeon 6780E 2PXeon 6766E 2PEPYC 9754 2P612182430SE +/- 0.16, N = 3SE +/- 0.04, N = 3SE +/- 0.18, N = 7SE +/- 0.18, N = 7SE +/- 0.13, N = 3SE +/- 0.09, N = 3SE +/- 0.18, N = 3SE +/- 0.17, N = 3SE +/- 0.16, N = 3SE +/- 0.09, N = 3SE +/- 0.18, N = 3SE +/- 0.12, N = 3SE +/- 0.19, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.14, N = 3SE +/- 0.02, N = 3SE +/- 0.14, N = 9SE +/- 0.13, N = 9SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.11, N = 923.4120.4619.4719.2917.5516.6816.1714.7614.7414.5914.0513.9513.6113.2813.2811.7410.917.207.076.656.335.75
OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 512 - Model: ResNet-152EPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon 6780EXeon Platinum 8380Xeon 6766EXeon Platinum 8490HXeon Max 9468EPYC 9654EPYC 9754Xeon Max 9480EPYC 9684XXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P0.02860.05720.08580.11440.1430.1270.1140.0880.0800.0800.0790.0770.0690.0680.0660.0660.0570.0420.0300.0290.0280.0240.0190.0180.0180.0180.016
OpenBenchmarking.orgWatts, Fewer Is BetterPyTorch 2.2.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EEPYC 9654Xeon Platinum 8380EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9754 2PXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2P110220330440550Min: 17.18 / Avg: 104.85 / Max: 112.82Min: 20.79 / Avg: 116.41 / Max: 125.98Min: 43.61 / Avg: 148.25 / Max: 158.74Min: 22.02 / Avg: 164.54 / Max: 175.34Min: 43.48 / Avg: 170.8 / Max: 185.92Min: 29.11 / Avg: 205.3 / Max: 221.54Min: 55.66 / Avg: 220.18 / Max: 241.46Min: 35.28 / Avg: 245.06 / Max: 264.04Min: 33.85 / Avg: 264.62 / Max: 291.43Min: 60.34 / Avg: 265.81 / Max: 296.61Min: 74.15 / Avg: 282.4 / Max: 310.35Min: 70.87 / Avg: 291.39 / Max: 322.93Min: 40.81 / Avg: 321.68 / Max: 356.16Min: 104.97 / Avg: 340.5 / Max: 358.58Min: 96.51 / Avg: 349.52 / Max: 424.02Min: 108.01 / Avg: 376.47 / Max: 395.86Min: 57.69 / Avg: 396.9 / Max: 434.4Min: 66.98 / Avg: 454.4 / Max: 498.76Min: 167.37 / Avg: 511.16 / Max: 589.71Min: 83.37 / Avg: 541.35 / Max: 576.05Min: 204.68 / Avg: 599.73 / Max: 629.45Min: 191.23 / Avg: 602.51 / Max: 639.791. EPYC 8534PN: Approximate power consumption of 17230 Joules per run.2. EPYC 8534P: Approximate power consumption of 19091 Joules per run.3. Xeon 6766E: Approximate power consumption of 27525 Joules per run.4. EPYC 9754: Approximate power consumption of 31976 Joules per run.5. Xeon 6780E: Approximate power consumption of 28125 Joules per run.6. EPYC 9654: Approximate power consumption of 32028 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 26642 Joules per run.8. EPYC 9684X: Approximate power consumption of 38230 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 25315 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 31543 Joules per run.11. Xeon Max 9468: Approximate power consumption of 34856 Joules per run.12. Xeon Max 9480: Approximate power consumption of 38713 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 116840 Joules per run.14. Xeon 6766E 2P: Approximate power consumption of 120877 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 52195 Joules per run.16. Xeon 6780E 2P: Approximate power consumption of 126872 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 116336 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 135007 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 79059 Joules per run.20. Xeon Platinum 8592+ 2P: Approximate power consumption of 75248 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 80164 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 100218 Joules per run.

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-152Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8380Xeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8380 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNXeon 6780EXeon 6766EEPYC 9754EPYC 9684X 2PEPYC 9654 2PXeon 6780E 2PXeon 6766E 2PEPYC 9754 2P612182430SE +/- 0.34, N = 3SE +/- 0.18, N = 3SE +/- 0.17, N = 12SE +/- 0.19, N = 5SE +/- 0.05, N = 3SE +/- 0.15, N = 12SE +/- 0.21, N = 3SE +/- 0.12, N = 3SE +/- 0.05, N = 3SE +/- 0.17, N = 3SE +/- 0.10, N = 3SE +/- 0.17, N = 3SE +/- 0.16, N = 3SE +/- 0.03, N = 3SE +/- 0.13, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.15, N = 9SE +/- 0.13, N = 9SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 323.4920.1319.2419.0117.7316.2515.8415.1114.9614.0313.8913.8413.1913.1513.0011.9510.887.087.046.596.155.79
OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-152EPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon 6766EXeon Platinum 8380Xeon 6780EXeon Platinum 8490HEPYC 9654Xeon Max 9468EPYC 9754Xeon Max 9480EPYC 9684XXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P0.02840.05680.08520.11360.1420.1260.1140.0890.0810.0800.0760.0760.0680.0670.0660.0660.0570.0430.0300.0270.0270.0250.0190.0180.0180.0180.016
OpenBenchmarking.orgWatts, Fewer Is BetterPyTorch 2.2.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EEPYC 9654Xeon Platinum 8380EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9754 2PXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2P110220330440550Min: 15.84 / Avg: 103.98 / Max: 111.57Min: 17.98 / Avg: 115.9 / Max: 125.2Min: 43.61 / Avg: 148.31 / Max: 158.76Min: 21.08 / Avg: 164.98 / Max: 175.44Min: 43.44 / Avg: 170.28 / Max: 183.58Min: 26.78 / Avg: 205 / Max: 221.09Min: 55.98 / Avg: 220.28 / Max: 241.66Min: 32.56 / Avg: 244.28 / Max: 263Min: 34.31 / Avg: 264.8 / Max: 291.45Min: 59.17 / Avg: 265.52 / Max: 295.66Min: 73.58 / Avg: 282.03 / Max: 308.67Min: 77.61 / Avg: 291.69 / Max: 322.84Min: 40.59 / Avg: 320.17 / Max: 358.77Min: 104.9 / Avg: 330.33 / Max: 356.82Min: 100.57 / Avg: 349.16 / Max: 423.16Min: 107.82 / Avg: 374.58 / Max: 394.46Min: 39.14 / Avg: 396.83 / Max: 432.36Min: 64.18 / Avg: 455.72 / Max: 501.58Min: 161.59 / Avg: 520.21 / Max: 588.55Min: 76.4 / Avg: 541.7 / Max: 581.39Min: 211.71 / Avg: 595.73 / Max: 626.88Min: 193.13 / Avg: 605.19 / Max: 641.471. EPYC 8534PN: Approximate power consumption of 17157 Joules per run.2. EPYC 8534P: Approximate power consumption of 19084 Joules per run.3. Xeon 6766E: Approximate power consumption of 27290 Joules per run.4. EPYC 9754: Approximate power consumption of 32116 Joules per run.5. Xeon 6780E: Approximate power consumption of 28948 Joules per run.6. EPYC 9654: Approximate power consumption of 32526 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 26360 Joules per run.8. EPYC 9684X: Approximate power consumption of 38352 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 25156 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 31685 Joules per run.11. Xeon Max 9468: Approximate power consumption of 35141 Joules per run.12. Xeon Max 9480: Approximate power consumption of 39184 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 116329 Joules per run.14. Xeon 6766E 2P: Approximate power consumption of 139949 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 52025 Joules per run.16. Xeon 6780E 2P: Approximate power consumption of 129353 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 119577 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 134488 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 83234 Joules per run.20. Xeon Platinum 8592+ 2P: Approximate power consumption of 75793 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 84594 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 96024 Joules per run.

SecureMark

SecureMark is an objective, standardized benchmarking framework for measuring the efficiency of cryptographic processing solutions developed by EEMBC. SecureMark-TLS is benchmarking Transport Layer Security performance with a focus on IoT/edge computing. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmarks, More Is BetterSecureMark 1.0.4Benchmark: SecureMark-TLSXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9684XEPYC 9654 2PEPYC 9654Xeon Max 9468Xeon Max 9468 2PXeon Max 9480 2PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9754EPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon Platinum 8380 2PXeon 6780EXeon 6780E 2PXeon 6766E 2PXeon 6766E70K140K210K280K350KSE +/- 209.97, N = 3SE +/- 411.11, N = 3SE +/- 809.90, N = 3SE +/- 415.71, N = 3SE +/- 389.81, N = 3SE +/- 361.20, N = 3SE +/- 256.85, N = 3SE +/- 384.08, N = 3SE +/- 196.24, N = 3SE +/- 670.43, N = 3SE +/- 625.56, N = 3SE +/- 330.95, N = 3SE +/- 553.62, N = 3SE +/- 457.42, N = 3SE +/- 542.88, N = 3SE +/- 372.96, N = 3SE +/- 372.88, N = 3SE +/- 285.52, N = 3SE +/- 406.59, N = 3SE +/- 1219.44, N = 3SE +/- 722.69, N = 3SE +/- 553.57, N = 33098963084343017403008332996102983412776472775892772982772602772052754722510752506952501622500242313572310762200512175361972981967401. (CC) gcc options: -pedantic -O3
OpenBenchmarking.orgmarks Per Watt, More Is BetterSecureMark 1.0.4Benchmark: SecureMark-TLSXeon 6780EEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8592+EPYC 9754EPYC 9654Xeon Platinum 8490HEPYC 9684XXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon 6780E 2PXeon 6766E 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Max 9468 2PXeon Max 9480 2P110022003300440055004990.154781.864697.254501.163643.383204.233034.033029.202686.162364.522308.762198.712010.971847.991278.591272.881242.561197.701185.321152.38986.37973.55
OpenBenchmarking.orgWatts, Fewer Is BetterSecureMark 1.0.4CPU Power Consumption MonitorXeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9754Xeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380EPYC 9654Xeon 6766E 2PXeon 6780E 2PEPYC 9684XXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PEPYC 9754 2PXeon Platinum 8490H 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Max 9468 2PXeon Max 9480 2P60120180240300Min: 43.5 / Avg: 43.71 / Max: 45.5Min: 43.33 / Avg: 44.1 / Max: 46.18Min: 14.73 / Avg: 52.31 / Max: 55.82Min: 16.16 / Avg: 53.23 / Max: 56.82Min: 18.81 / Avg: 78.24 / Max: 81.48Min: 33.51 / Avg: 85.06 / Max: 96.45Min: 53.54 / Avg: 91.51 / Max: 104.77Min: 49.93 / Avg: 97.85 / Max: 101.93Min: 28.33 / Avg: 98.33 / Max: 101.2Min: 103.87 / Avg: 106.76 / Max: 110.05Min: 106.5 / Avg: 108.17 / Max: 111.72Min: 31.06 / Avg: 111.99 / Max: 116.51Min: 74.22 / Avg: 120.26 / Max: 126.65Min: 85.74 / Avg: 126.1 / Max: 134.53Min: 97.89 / Avg: 192.93 / Max: 216.11Min: 41.92 / Avg: 196.37 / Max: 200.73Min: 171.99 / Avg: 232.4 / Max: 318.93Min: 56.74 / Avg: 235.38 / Max: 240.55Min: 78.38 / Avg: 248.23 / Max: 290.1Min: 60.77 / Avg: 261.84 / Max: 267.2Min: 137.33 / Avg: 281.43 / Max: 342.59Min: 124.02 / Avg: 284.83 / Max: 338.051. Xeon 6766E: Approximate power consumption of 12442 Joules per run.2. Xeon 6780E: Approximate power consumption of 12612 Joules per run.3. EPYC 8534PN: Approximate power consumption of 14892 Joules per run.4. EPYC 8534P: Approximate power consumption of 15134 Joules per run.5. EPYC 9754: Approximate power consumption of 22298 Joules per run.6. Xeon Platinum 8592+: Approximate power consumption of 24241 Joules per run.7. Xeon Platinum 8490H: Approximate power consumption of 26081 Joules per run.8. Xeon Platinum 8380: Approximate power consumption of 27919 Joules per run.9. EPYC 9654: Approximate power consumption of 27959 Joules per run.10. Xeon 6766E 2P: Approximate power consumption of 30392 Joules per run.11. Xeon 6780E 2P: Approximate power consumption of 30794 Joules per run.12. EPYC 9684X: Approximate power consumption of 31844 Joules per run.13. Xeon Max 9468: Approximate power consumption of 34394 Joules per run.14. Xeon Max 9480: Approximate power consumption of 35939 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 54922 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 55769 Joules per run.17. Xeon Platinum 8490H 2P: Approximate power consumption of 66467 Joules per run.18. EPYC 9654 2P: Approximate power consumption of 66691 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 70661 Joules per run.20. EPYC 9684X 2P: Approximate power consumption of 74101 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 80019 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 81083 Joules per run.

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third RunEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9480 2PXeon Max 9468EPYC 9754Xeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9754 2PXeon 6780EXeon 6766EXeon Platinum 8380EPYC 8534PXeon 6780E 2PEPYC 8534PNXeon 6766E 2PXeon Platinum 8380 2P130260390520650SE +/- 4.34, N = 3SE +/- 4.03, N = 3SE +/- 2.03, N = 3SE +/- 10.00, N = 3SE +/- 2.55, N = 3SE +/- 3.08, N = 3SE +/- 3.45, N = 3SE +/- 3.60, N = 3SE +/- 3.54, N = 12SE +/- 6.03, N = 3SE +/- 3.32, N = 3SE +/- 3.62, N = 6SE +/- 5.39, N = 5SE +/- 6.21, N = 5SE +/- 1.22, N = 3SE +/- 2.14, N = 3SE +/- 4.79, N = 3SE +/- 1.77, N = 3SE +/- 3.52, N = 3SE +/- 5.23, N = 3SE +/- 1.59, N = 3SE +/- 1.27, N = 3595.19559.55526.36525.23501.63501.07481.66476.91471.79470.02458.96458.23438.60427.95400.52379.92342.99338.84337.75335.46320.87295.06
OpenBenchmarking.orgQueries Per Minute, Geo Mean Per Watt, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third RunXeon 6766EXeon 6780EEPYC 8534PNEPYC 9754EPYC 8534PEPYC 9654EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon 6780E 2PXeon 6766E 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8380EPYC 9654 2PEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8380 2PXeon Max 9480 2P1.10632.21263.31894.42525.53154.9174.7374.3664.1824.0854.0533.7092.5992.3412.0492.0381.9741.9671.9661.8701.8571.6761.2891.2651.0681.0431.012
OpenBenchmarking.orgWatts, Fewer Is BetterClickHouse 22.12.3.5CPU Power Consumption MonitorEPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EEPYC 9754EPYC 9654Xeon 6766E 2PEPYC 9684XXeon 6780E 2PXeon Platinum 8380Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9754 2PXeon Max 9468Xeon Max 9480EPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P130260390520650Min: 15.83 / Avg: 76.83 / Max: 137.9Min: 43.57 / Avg: 77.27 / Max: 231.46Min: 18.06 / Avg: 82.96 / Max: 166.09Min: 43.42 / Avg: 84.55 / Max: 263.64Min: 20.77 / Avg: 109.76 / Max: 265.96Min: 28.3 / Avg: 138.04 / Max: 305.03Min: 62.49 / Avg: 157.43 / Max: 363.95Min: 29.83 / Avg: 160.48 / Max: 343.21Min: 107.74 / Avg: 164.81 / Max: 404.79Min: 52.36 / Avg: 174.43 / Max: 288.3Min: 26.54 / Avg: 176.29 / Max: 377.99Min: 52.84 / Avg: 205.71 / Max: 375.59Min: 40.81 / Avg: 230.4 / Max: 456.57Min: 70.28 / Avg: 238.9 / Max: 367.38Min: 77.89 / Avg: 241.61 / Max: 372.85Min: 54.72 / Avg: 280.91 / Max: 531.55Min: 101.69 / Avg: 282.88 / Max: 572.19Min: 64.74 / Avg: 314 / Max: 643.44Min: 77.74 / Avg: 340.3 / Max: 642.4Min: 157.92 / Avg: 396.39 / Max: 673.71Min: 199.33 / Avg: 466.07 / Max: 698.95Min: 199.78 / Avg: 469.37 / Max: 713.861. EPYC 8534PN: Approximate power consumption of 18517 Joules per run.2. Xeon 6766E: Approximate power consumption of 22718 Joules per run.3. EPYC 8534P: Approximate power consumption of 19163 Joules per run.4. Xeon 6780E: Approximate power consumption of 22406 Joules per run.5. EPYC 9754: Approximate power consumption of 24183 Joules per run.6. EPYC 9654: Approximate power consumption of 26320 Joules per run.7. Xeon 6766E 2P: Approximate power consumption of 54629 Joules per run.8. EPYC 9684X: Approximate power consumption of 29474 Joules per run.9. Xeon 6780E 2P: Approximate power consumption of 52573 Joules per run.10. Xeon Platinum 8380: Approximate power consumption of 40178 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 32820 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 40594 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 55572 Joules per run.14. Xeon Max 9468: Approximate power consumption of 47939 Joules per run.15. Xeon Max 9480: Approximate power consumption of 47516 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 56275 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 71568 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 63743 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 69558 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 87339 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 106496 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 104983 Joules per run.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second RunEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9480 2PXeon Max 9468Xeon Platinum 8592+EPYC 9754Xeon Platinum 8592+ 2PEPYC 9754 2PXeon 6780EXeon 6766EXeon Platinum 8380Xeon 6780E 2PEPYC 8534PNEPYC 8534PXeon 6766E 2PXeon Platinum 8380 2P130260390520650SE +/- 0.42, N = 3SE +/- 3.14, N = 3SE +/- 8.37, N = 3SE +/- 6.78, N = 3SE +/- 3.26, N = 3SE +/- 0.19, N = 3SE +/- 2.93, N = 3SE +/- 4.95, N = 3SE +/- 3.17, N = 12SE +/- 1.94, N = 3SE +/- 2.86, N = 6SE +/- 9.26, N = 3SE +/- 3.10, N = 5SE +/- 4.85, N = 5SE +/- 2.12, N = 3SE +/- 3.34, N = 3SE +/- 0.73, N = 3SE +/- 3.25, N = 3SE +/- 5.72, N = 3SE +/- 2.99, N = 3SE +/- 1.53, N = 3SE +/- 3.61, N = 3597.73562.50529.80528.21507.56499.18486.05474.68467.96465.06455.79450.12443.58420.35403.96381.05339.67339.50337.44337.32320.17295.43

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold CacheEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9654 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9480 2PXeon Max 9468Xeon Platinum 8592+EPYC 9754Xeon Platinum 8592+ 2PEPYC 9754 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon Platinum 8380EPYC 8534PEPYC 8534PNXeon 6766E 2PXeon Platinum 8380 2P120240360480600SE +/- 7.88, N = 3SE +/- 5.33, N = 3SE +/- 4.34, N = 3SE +/- 6.05, N = 3SE +/- 1.35, N = 3SE +/- 4.37, N = 3SE +/- 3.41, N = 3SE +/- 5.88, N = 3SE +/- 3.85, N = 12SE +/- 2.85, N = 3SE +/- 4.18, N = 6SE +/- 2.78, N = 3SE +/- 4.12, N = 5SE +/- 4.49, N = 5SE +/- 1.12, N = 3SE +/- 2.21, N = 3SE +/- 3.71, N = 3SE +/- 1.56, N = 3SE +/- 1.57, N = 3SE +/- 1.88, N = 3SE +/- 1.51, N = 3SE +/- 1.56, N = 3566.31536.82513.92504.84491.89485.63465.50461.62460.66446.40437.20433.79423.30411.26388.29365.62333.06326.65323.59322.69311.63285.17

Apache IoTDB

Apache IotDB is a time series database and this benchmark is facilitated using the IoT Benchmaark [https://github.com/thulab/iot-benchmark/]. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400EPYC 9684XEPYC 9654EPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon 6780EXeon Max 9480Xeon 6766EXeon Max 9468Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Platinum 8380Xeon Max 9468 2PXeon Platinum 8380 2PXeon 6780E 2PXeon 6766E 2P80160240320400SE +/- 1.71, N = 3SE +/- 1.96, N = 3SE +/- 1.41, N = 3SE +/- 3.49, N = 3SE +/- 1.87, N = 3SE +/- 0.82, N = 3SE +/- 0.38, N = 3SE +/- 2.16, N = 15SE +/- 3.41, N = 3SE +/- 3.40, N = 12SE +/- 2.20, N = 3SE +/- 4.45, N = 3SE +/- 5.07, N = 3SE +/- 1.12, N = 3SE +/- 5.15, N = 3SE +/- 3.79, N = 8SE +/- 3.74, N = 12SE +/- 4.06, N = 3SE +/- 2.59, N = 12SE +/- 3.47, N = 3SE +/- 5.20, N = 3SE +/- 3.93, N = 12209.68211.85227.40240.43246.08251.05251.47253.13280.26286.78294.33296.36309.03312.32314.44317.36325.97326.53328.41349.42377.58380.33
OpenBenchmarking.orgWatts, Fewer Is BetterApache IoTDB 1.2CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8592+Xeon Platinum 8380Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8490HEPYC 9754 2PXeon Max 9468Xeon Max 9480EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P120240360480600Min: 17.44 / Avg: 68.28 / Max: 132.65Min: 15.92 / Avg: 72.92 / Max: 146.34Min: 43.59 / Avg: 76.38 / Max: 156.34Min: 43.44 / Avg: 82.74 / Max: 200.76Min: 21.99 / Avg: 100.77 / Max: 212.81Min: 30.38 / Avg: 122.12 / Max: 263.01Min: 35.8 / Avg: 141.12 / Max: 306.16Min: 33.32 / Avg: 159.48 / Max: 348.24Min: 51.86 / Avg: 163.52 / Max: 286.64Min: 61.74 / Avg: 182.78 / Max: 332.16Min: 95.98 / Avg: 192.34 / Max: 351.09Min: 58.74 / Avg: 204.83 / Max: 345.97Min: 43.37 / Avg: 215.97 / Max: 369.95Min: 75.58 / Avg: 242.09 / Max: 358.23Min: 74.42 / Avg: 245.7 / Max: 359.89Min: 52.66 / Avg: 254.51 / Max: 448.61Min: 68.46 / Avg: 291.76 / Max: 496.27Min: 105.33 / Avg: 293.48 / Max: 476.12Min: 76.05 / Avg: 329.73 / Max: 605.38Min: 174.02 / Avg: 422.43 / Max: 631.3Min: 207 / Avg: 485.64 / Max: 662.26Min: 204.98 / Avg: 492.49 / Max: 690.421. EPYC 8534PN: Approximate power consumption of 10424 Joules per run.2. EPYC 8534P: Approximate power consumption of 11327 Joules per run.3. Xeon 6766E: Approximate power consumption of 14105 Joules per run.4. Xeon 6780E: Approximate power consumption of 14369 Joules per run.5. EPYC 9754: Approximate power consumption of 14578 Joules per run.6. EPYC 9654: Approximate power consumption of 16731 Joules per run.7. EPYC 9684X: Approximate power consumption of 19051 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 26155 Joules per run.9. Xeon Platinum 8380: Approximate power consumption of 30414 Joules per run.10. Xeon 6766E 2P: Approximate power consumption of 31590 Joules per run.11. Xeon 6780E 2P: Approximate power consumption of 41674 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 35573 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 26650 Joules per run.14. Xeon Max 9468: Approximate power consumption of 43414 Joules per run.15. Xeon Max 9480: Approximate power consumption of 43735 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 39025 Joules per run.17. EPYC 9684X 2P: Approximate power consumption of 43570 Joules per run.18. Xeon Platinum 8380 2P: Approximate power consumption of 56838 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 45448 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 66269 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 74505 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 74324 Joules per run.

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400EPYC 9684XEPYC 9654EPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 8534PEPYC 8534PNEPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon 6780EXeon Max 9480Xeon Max 9468Xeon 6766EXeon Platinum 8490H 2PXeon Platinum 8380Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380 2PXeon 6780E 2PXeon 6766E 2P30M60M90M120M150MSE +/- 371659.60, N = 3SE +/- 255887.16, N = 3SE +/- 68559.13, N = 3SE +/- 1152766.29, N = 3SE +/- 353097.82, N = 3SE +/- 13050.78, N = 3SE +/- 412757.79, N = 3SE +/- 666882.79, N = 15SE +/- 746822.47, N = 3SE +/- 761276.42, N = 12SE +/- 308756.34, N = 3SE +/- 441557.52, N = 3SE +/- 1037167.36, N = 3SE +/- 662950.65, N = 3SE +/- 111181.55, N = 3SE +/- 692701.79, N = 8SE +/- 88241.50, N = 3SE +/- 574699.97, N = 12SE +/- 565297.90, N = 12SE +/- 661234.22, N = 3SE +/- 796440.21, N = 3SE +/- 531367.14, N = 121261610281255620601166853261088215801067783791054328621051385511036304839270975189231850877972068719039783475645824556648190047780169620788231127805772877501248746530076832080067599793

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1MEPYC 9684X 2PEPYC 9684XEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 9654Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9754EPYC 8534PEPYC 8534PNXeon Platinum 838070140210280350SE +/- 0.46, N = 3SE +/- 0.49, N = 3SE +/- 0.71, N = 12SE +/- 0.14, N = 3SE +/- 1.00, N = 10SE +/- 0.11, N = 3SE +/- 0.14, N = 3SE +/- 0.13, N = 3SE +/- 0.20, N = 3SE +/- 1.51, N = 8SE +/- 0.78, N = 3SE +/- 0.15, N = 3SE +/- 0.18, N = 3SE +/- 0.08, N = 3SE +/- 1.11, N = 3SE +/- 0.47, N = 3SE +/- 0.50, N = 3SE +/- 0.13, N = 349.5577.3277.6486.9393.99115.89117.91125.15157.56176.14185.03207.20212.99228.74231.96297.25300.69343.16
OpenBenchmarking.orgWatts, Fewer Is BetterOpenRadioss 2023.09.15CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PEPYC 9754Xeon Platinum 8380EPYC 9654EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P140280420560700Min: 17.52 / Avg: 128.33 / Max: 140.79Min: 18.8 / Avg: 143.22 / Max: 157.87Min: 21.25 / Avg: 249.04 / Max: 321.21Min: 52.15 / Avg: 250.92 / Max: 289.23Min: 28.56 / Avg: 270.92 / Max: 332.67Min: 33.17 / Avg: 309.02 / Max: 409.54Min: 33.32 / Avg: 313.77 / Max: 375.72Min: 59.23 / Avg: 321.19 / Max: 377.05Min: 72.8 / Avg: 328.51 / Max: 377.04Min: 83.35 / Avg: 329.11 / Max: 376.3Min: 42.16 / Avg: 450.48 / Max: 658.58Min: 105.1 / Avg: 469.12 / Max: 579.49Min: 59.6 / Avg: 495.69 / Max: 689.03Min: 68.17 / Avg: 526.7 / Max: 819.28Min: 82.45 / Avg: 561.7 / Max: 752.76Min: 168.54 / Avg: 600.33 / Max: 753.81Min: 213.51 / Avg: 619.95 / Max: 751.65Min: 197.55 / Avg: 624.98 / Max: 753.941. EPYC 8534PN: Approximate power consumption of 43333 Joules per run.2. EPYC 8534P: Approximate power consumption of 47882 Joules per run.3. EPYC 9754: Approximate power consumption of 69483 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 96186 Joules per run.5. EPYC 9654: Approximate power consumption of 57638 Joules per run.6. EPYC 9684X: Approximate power consumption of 35331 Joules per run.7. Xeon Platinum 8592+: Approximate power consumption of 57524 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 76444 Joules per run.9. Xeon Max 9468: Approximate power consumption of 84536 Joules per run.10. Xeon Max 9480: Approximate power consumption of 79096 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 69374 Joules per run.12. Xeon Platinum 8380 2P: Approximate power consumption of 108055 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 61259 Joules per run.14. EPYC 9684X 2P: Approximate power consumption of 50387 Joules per run.15. Xeon Platinum 8592+ 2P: Approximate power consumption of 67779 Joules per run.16. Xeon Platinum 8490H 2P: Approximate power consumption of 91850 Joules per run.17. Xeon Max 9480 2P: Approximate power consumption of 95886 Joules per run.18. Xeon Max 9468 2P: Approximate power consumption of 99788 Joules per run.

NAMD

NAMD is a parallel molecular dynamics code designed for high-performance simulation of large biomolecular systems. NAMD was developed by the Theoretical and Computational Biophysics Group in the Beckman Institute for Advanced Science and Technology at the University of Illinois at Urbana-Champaign. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: STMV with 1,066,628 AtomsEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8380 2PEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 9468Xeon Platinum 8592+Xeon Platinum 8380Xeon Platinum 8490H 2PXeon Platinum 8490HXeon 6766E 2PXeon 6780E 2PXeon 6780EXeon 6766E246810SE +/- 0.01739, N = 3SE +/- 0.00332, N = 3SE +/- 0.02927, N = 3SE +/- 0.00206, N = 3SE +/- 0.00847, N = 3SE +/- 0.00537, N = 3SE +/- 0.08185, N = 13SE +/- 0.05644, N = 12SE +/- 0.05463, N = 15SE +/- 0.00911, N = 3SE +/- 0.00440, N = 3SE +/- 0.05862, N = 15SE +/- 0.00540, N = 3SE +/- 0.05087, N = 15SE +/- 0.02648, N = 15SE +/- 0.00653, N = 3SE +/- 0.04403, N = 15SE +/- 0.01396, N = 15SE +/- 0.04439, N = 8SE +/- 0.03216, N = 9SE +/- 0.00540, N = 3SE +/- 0.00423, N = 36.383435.836065.278393.410852.888692.878772.254221.886791.767781.612321.519011.502141.461631.452231.437871.110561.109001.052740.707570.576940.567170.52357
OpenBenchmarking.orgns/day Per Watt, More Is BetterNAMD 3.0b6Input: STMV with 1,066,628 AtomsEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 8534PNEPYC 8534PEPYC 9654EPYC 9684XXeon Platinum 8592+Xeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon 6780EXeon 6766EXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490HXeon 6766E 2PXeon Max 9480 2PXeon Max 9468 2PXeon 6780E 2PXeon Platinum 8490H 2P0.00520.01040.01560.02080.0260.0230.0190.0180.0140.0130.0120.0120.0120.0060.0050.0050.0050.0040.0040.0040.0040.0040.0030.0030.0030.0020.002
OpenBenchmarking.orgWatts, Fewer Is BetterNAMD 3.0b6CPU Power Consumption MonitorEPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EEPYC 9754Xeon Platinum 8380EPYC 9654Xeon 6766E 2PEPYC 9754 2PXeon Platinum 8592+Xeon 6780E 2PXeon Platinum 8490HEPYC 9684XXeon Max 9468EPYC 9654 2PXeon Max 9480EPYC 9684X 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P140280420560700Min: 15.81 / Avg: 114.62 / Max: 140.3Min: 43.64 / Avg: 119.15 / Max: 229.24Min: 18.33 / Avg: 130.18 / Max: 164.25Min: 43.54 / Avg: 140.31 / Max: 283.29Min: 21.48 / Avg: 206.2 / Max: 309.47Min: 51.87 / Avg: 233.31 / Max: 276.8Min: 28.55 / Avg: 235.77 / Max: 330Min: 104.7 / Avg: 241.31 / Max: 387.86Min: 42.36 / Avg: 249.94 / Max: 651.86Min: 33.09 / Avg: 260.62 / Max: 349.3Min: 62.83 / Avg: 273.53 / Max: 463.21Min: 55.23 / Avg: 273.91 / Max: 344.33Min: 32.28 / Avg: 274.76 / Max: 406.72Min: 71.79 / Avg: 281.33 / Max: 364.12Min: 57.51 / Avg: 289.28 / Max: 672.46Min: 72.24 / Avg: 295.54 / Max: 371.41Min: 65.49 / Avg: 343.59 / Max: 811.63Min: 103.57 / Avg: 411.33 / Max: 527.15Min: 73.13 / Avg: 510.74 / Max: 686.96Min: 163.14 / Avg: 552.42 / Max: 653.46Min: 192.28 / Avg: 560.13 / Max: 714.79Min: 194.25 / Avg: 565.07 / Max: 686.051. EPYC 8534PN: Approximate power consumption of 4929 Joules per run.2. Xeon 6766E: Approximate power consumption of 30186 Joules per run.3. EPYC 8534P: Approximate power consumption of 5511 Joules per run.4. Xeon 6780E: Approximate power consumption of 35171 Joules per run.5. EPYC 9754: Approximate power consumption of 6186 Joules per run.6. Xeon Platinum 8380: Approximate power consumption of 17032 Joules per run.7. EPYC 9654: Approximate power consumption of 6680 Joules per run.8. Xeon 6766E 2P: Approximate power consumption of 68621 Joules per run.9. EPYC 9754 2P: Approximate power consumption of 25827 Joules per run.10. Xeon Platinum 8592+: Approximate power consumption of 18956 Joules per run.11. Xeon 6780E 2P: Approximate power consumption of 76709 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 26587 Joules per run.13. EPYC 9684X: Approximate power consumption of 7144 Joules per run.14. Xeon Max 9468: Approximate power consumption of 20743 Joules per run.15. EPYC 9654 2P: Approximate power consumption of 29217 Joules per run.16. Xeon Max 9480: Approximate power consumption of 17713 Joules per run.17. EPYC 9684X 2P: Approximate power consumption of 38825 Joules per run.18. Xeon Platinum 8380 2P: Approximate power consumption of 46618 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 50760 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 63270 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 37202 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 43661 Joules per run.

Timed Gem5 Compilation

This test times how long it takes to compile Gem5. Gem5 is a simulator for computer system architecture research. Gem5 is widely used for computer architecture research within the industry, academia, and more. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 23.0.1Time To CompileXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9684XXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+EPYC 9754 2PXeon Platinum 8490HEPYC 9754Xeon Max 9480Xeon Platinum 8380 2PXeon Max 9468Xeon 6780E 2PXeon 6780EEPYC 8534PEPYC 8534PNXeon 6766E 2PXeon 6766EXeon Platinum 838060120180240300SE +/- 0.89, N = 3SE +/- 1.16, N = 3SE +/- 0.72, N = 3SE +/- 2.15, N = 3SE +/- 0.58, N = 3SE +/- 1.01, N = 3SE +/- 1.72, N = 3SE +/- 2.24, N = 4SE +/- 2.17, N = 3SE +/- 1.73, N = 3SE +/- 0.92, N = 3SE +/- 1.88, N = 3SE +/- 2.11, N = 6SE +/- 1.04, N = 3SE +/- 2.59, N = 4SE +/- 2.61, N = 3SE +/- 1.47, N = 3SE +/- 1.99, N = 9SE +/- 0.97, N = 3SE +/- 0.78, N = 3SE +/- 3.60, N = 3SE +/- 3.88, N = 3157.36161.94164.90176.88178.28181.63184.30185.30187.51192.98210.93212.55215.50219.67220.57233.21238.43242.93251.61252.97267.95275.71
OpenBenchmarking.orgWatts, Fewer Is BetterTimed Gem5 Compilation 23.0.1CPU Power Consumption MonitorEPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EEPYC 9754Xeon 6766E 2PEPYC 9654Xeon 6780E 2PXeon Platinum 8380EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9754 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P140280420560700Min: 16.66 / Avg: 87.52 / Max: 141.58Min: 43.55 / Avg: 90.66 / Max: 234.37Min: 17.32 / Avg: 96.65 / Max: 166.6Min: 43.31 / Avg: 103.5 / Max: 281.26Min: 21.18 / Avg: 144.58 / Max: 331.44Min: 104.15 / Avg: 164.39 / Max: 501.65Min: 29.61 / Avg: 170.81 / Max: 332.22Min: 55.47 / Avg: 178.9 / Max: 585.97Min: 50.89 / Avg: 194.29 / Max: 291.11Min: 29.1 / Avg: 201.66 / Max: 413.09Min: 33.1 / Avg: 215.42 / Max: 377.33Min: 55.65 / Avg: 228.11 / Max: 376.67Min: 67.72 / Avg: 254.21 / Max: 375.35Min: 40.79 / Avg: 257.31 / Max: 376.35Min: 40.43 / Avg: 270.24 / Max: 677.31Min: 55.44 / Avg: 320.45 / Max: 676.84Min: 97.98 / Avg: 327.07 / Max: 580.5Min: 65.57 / Avg: 360.36 / Max: 822.7Min: 43.96 / Avg: 377.81 / Max: 753.32Min: 160.34 / Avg: 415.56 / Max: 738.65Min: 191.44 / Avg: 472.13 / Max: 747.43Min: 177.84 / Avg: 479.92 / Max: 746.221. EPYC 8534PN: Approximate power consumption of 22523 Joules per run.2. Xeon 6766E: Approximate power consumption of 24811 Joules per run.3. EPYC 8534P: Approximate power consumption of 24022 Joules per run.4. Xeon 6780E: Approximate power consumption of 25219 Joules per run.5. EPYC 9754: Approximate power consumption of 31566 Joules per run.6. Xeon 6766E 2P: Approximate power consumption of 42633 Joules per run.7. EPYC 9654: Approximate power consumption of 32540 Joules per run.8. Xeon 6780E 2P: Approximate power consumption of 42875 Joules per run.9. Xeon Platinum 8380: Approximate power consumption of 54854 Joules per run.10. EPYC 9684X: Approximate power consumption of 36701 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 41503 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 49424 Joules per run.13. Xeon Max 9480: Approximate power consumption of 56012 Joules per run.14. Xeon Max 9468: Approximate power consumption of 58024 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 53598 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 54477 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 73591 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 60180 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 61457 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 76602 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 88446 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 91024 Joules per run.

LAMMPS Molecular Dynamics Simulator

LAMMPS is a classical molecular dynamics code, and an acronym for Large-scale Atomic/Molecular Massively Parallel Simulator. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: 20k AtomsEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 83801428425670SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 0.13, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.19, N = 3SE +/- 0.30, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 362.0058.8457.1056.4051.8250.5247.9946.8946.7142.5137.4635.7034.8932.1628.2827.5325.3321.381. (CXX) g++ options: -O3 -lm -ldl
OpenBenchmarking.orgns/day Per Watt, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: 20k AtomsEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HEPYC 9754 2PXeon Max 9480EPYC 9654 2PXeon Platinum 8592+ 2PXeon Max 9468Xeon Platinum 8380EPYC 9684X 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8380 2P0.04320.08640.12960.17280.2160.1920.1800.1510.1330.1170.1100.1020.0940.0930.0900.0840.0820.0800.0790.0760.0740.0680.067
OpenBenchmarking.orgWatts, Fewer Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon Platinum 8380EPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9684XXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2P140280420560700Min: 15.43 / Avg: 132.09 / Max: 137.27Min: 15.99 / Avg: 153.16 / Max: 156.26Min: 52.92 / Avg: 266.98 / Max: 289.96Min: 19.76 / Avg: 318.23 / Max: 330.98Min: 29.12 / Avg: 318.64 / Max: 329.98Min: 22.64 / Avg: 341.9 / Max: 376.37Min: 61.2 / Avg: 343.29 / Max: 376.01Min: 77.1 / Avg: 344.05 / Max: 376.79Min: 75.25 / Avg: 345.23 / Max: 374.68Min: 31.69 / Avg: 399.48 / Max: 409.61Min: 97.85 / Avg: 530.19 / Max: 581.83Min: 40.67 / Avg: 624.63 / Max: 672.65Min: 55.66 / Avg: 633.05 / Max: 669.84Min: 65.48 / Avg: 673.08 / Max: 752.97Min: 165.47 / Avg: 680.62 / Max: 754.38Min: 192.84 / Avg: 682.64 / Max: 752.01Min: 186.6 / Avg: 685.33 / Max: 753.98Min: 64.31 / Avg: 785.79 / Max: 819.571. EPYC 8534PN: Approximate power consumption of 45659 Joules per run.2. EPYC 8534P: Approximate power consumption of 48757 Joules per run.3. Xeon Platinum 8380: Approximate power consumption of 109018 Joules per run.4. EPYC 9754: Approximate power consumption of 58873 Joules per run.5. EPYC 9654: Approximate power consumption of 66170 Joules per run.6. Xeon Platinum 8592+: Approximate power consumption of 80803 Joules per run.7. Xeon Platinum 8490H: Approximate power consumption of 86738 Joules per run.8. Xeon Max 9480: Approximate power consumption of 94269 Joules per run.9. Xeon Max 9468: Approximate power consumption of 107137 Joules per run.10. EPYC 9684X: Approximate power consumption of 75235 Joules per run.11. Xeon Platinum 8380 2P: Approximate power consumption of 130956 Joules per run.12. EPYC 9754 2P: Approximate power consumption of 98899 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 100445 Joules per run.14. Xeon Platinum 8592+ 2P: Approximate power consumption of 108814 Joules per run.15. Xeon Platinum 8490H 2P: Approximate power consumption of 121832 Joules per run.16. Xeon Max 9480 2P: Approximate power consumption of 118552 Joules per run.17. Xeon Max 9468 2P: Approximate power consumption of 130897 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 115511 Joules per run.

Timed Node.js Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 21.7.2Time To CompileEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9684XEPYC 9654Xeon Max 9480 2PXeon Platinum 8490H 2PXeon 6780E 2PXeon Max 9468 2PEPYC 9754Xeon 6766E 2PXeon Platinum 8592+Xeon 6780EXeon 6766EXeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 8380 2PXeon Platinum 838090180270360450SE +/- 1.19, N = 3SE +/- 0.18, N = 3SE +/- 0.12, N = 3SE +/- 1.51, N = 3SE +/- 0.50, N = 3SE +/- 0.59, N = 3SE +/- 0.52, N = 3SE +/- 0.48, N = 3SE +/- 0.60, N = 3SE +/- 0.84, N = 3SE +/- 0.72, N = 3SE +/- 1.20, N = 3SE +/- 0.52, N = 3SE +/- 0.51, N = 3SE +/- 0.15, N = 3SE +/- 0.74, N = 3SE +/- 0.71, N = 3SE +/- 0.53, N = 3SE +/- 0.17, N = 3SE +/- 0.19, N = 3SE +/- 0.68, N = 3SE +/- 0.22, N = 3114.91118.90145.41147.74147.84164.02171.17172.99173.09175.63186.10187.65214.43228.57246.85252.65254.00270.38277.53288.12303.42423.63
OpenBenchmarking.orgWatts, Fewer Is BetterTimed Node.js Compilation 21.7.2CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8380Xeon 6766E 2PXeon 6780E 2PEPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9754 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P140280420560700Min: 16.32 / Avg: 118.09 / Max: 147.17Min: 18.11 / Avg: 134.67 / Max: 172.23Min: 43.59 / Avg: 148.97 / Max: 246.66Min: 43.35 / Avg: 170.44 / Max: 300.92Min: 21.84 / Avg: 210.13 / Max: 338.39Min: 29.13 / Avg: 242.47 / Max: 351.76Min: 50.7 / Avg: 248.06 / Max: 290.96Min: 104.39 / Avg: 256.25 / Max: 503.96Min: 106.88 / Avg: 287.54 / Max: 584Min: 30.95 / Avg: 289.15 / Max: 411.31Min: 33.43 / Avg: 295.74 / Max: 377.74Min: 56.59 / Avg: 305.63 / Max: 376.82Min: 84.71 / Avg: 317.34 / Max: 376.11Min: 74.34 / Avg: 318.88 / Max: 376.31Min: 41.45 / Avg: 361.3 / Max: 676Min: 55.68 / Avg: 430.05 / Max: 696.5Min: 96.84 / Avg: 455.83 / Max: 582.18Min: 61.4 / Avg: 490.25 / Max: 822.63Min: 82.39 / Avg: 529.15 / Max: 756.15Min: 157.7 / Avg: 555.35 / Max: 756.3Min: 190.08 / Avg: 584.7 / Max: 754.37Min: 200.82 / Avg: 601.52 / Max: 753.51. EPYC 8534PN: Approximate power consumption of 35073 Joules per run.2. EPYC 8534P: Approximate power consumption of 38561 Joules per run.3. Xeon 6766E: Approximate power consumption of 38286 Joules per run.4. Xeon 6780E: Approximate power consumption of 40621 Joules per run.5. EPYC 9754: Approximate power consumption of 40976 Joules per run.6. EPYC 9654: Approximate power consumption of 41705 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 107078 Joules per run.8. Xeon 6766E 2P: Approximate power consumption of 50653 Joules per run.9. Xeon 6780E 2P: Approximate power consumption of 52427 Joules per run.10. EPYC 9684X: Approximate power consumption of 45107 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 65654 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 80177 Joules per run.13. Xeon Max 9480: Approximate power consumption of 82613 Joules per run.14. Xeon Max 9468: Approximate power consumption of 88649 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 56483 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 54760 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 141915 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 59974 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 81312 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 100889 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 107780 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 110278 Joules per run.

OpenSSL

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: SHA256EPYC 9754 2PXeon 6780E 2PEPYC 9684X 2PXeon 6766E 2PEPYC 9654 2PEPYC 9754Xeon 6780EEPYC 9684XXeon Platinum 8592+ 2PXeon 6766EEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PEPYC 8534PNXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380 2PXeon Max 9480Xeon Max 9468Xeon Platinum 838070000M140000M210000M280000M350000MSE +/- 80639802.67, N = 3SE +/- 228931567.43, N = 3SE +/- 160246527.97, N = 3SE +/- 97765007.32, N = 3SE +/- 210407867.05, N = 3SE +/- 34182873.86, N = 3SE +/- 242095363.59, N = 3SE +/- 146384349.91, N = 3SE +/- 29142783.86, N = 3SE +/- 34216643.88, N = 3SE +/- 38601729.93, N = 3SE +/- 66583540.43, N = 3SE +/- 70647143.49, N = 3SE +/- 126029257.64, N = 3SE +/- 10642001.84, N = 3SE +/- 64797308.82, N = 3SE +/- 23323764.84, N = 3SE +/- 159515825.53, N = 3SE +/- 919807437.76, N = 12SE +/- 33334799.97, N = 3SE +/- 27466135.54, N = 3SE +/- 8534071.27, N = 33202586862372870350411402762677664032563303497772516456298871612691622801441630272801384095889831319760501201299759947331264751376901191068021071033828601138863575341374584721007678067303876657395792061806994523545307005765184043676344439185187278585044901. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenBenchmarking.orgbyte/s Per Watt, More Is BetterOpenSSL 3.3Algorithm: SHA256Xeon 6766EXeon 6766E 2PXeon 6780EEPYC 8534PNXeon 6780E 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 9654EPYC 9654 2PEPYC 9684XEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9480 2PXeon Max 9468Xeon Max 9468 2PXeon Platinum 8380Xeon Platinum 8380 2P130M260M390M520M650M611047359.48578313018.50516781889.88511227929.81507731880.45481947170.76471857277.56469088919.27386445411.79378210579.19345260515.93344443539.20195213927.96193109819.08189585676.93179424218.79167457577.18160789835.78157500377.52149911179.45105324899.05103421352.66
OpenBenchmarking.orgWatts, Fewer Is BetterOpenSSL 3.3CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon 6780EXeon Max 9468Xeon Max 9480Xeon Platinum 8490HEPYC 9654EPYC 9754Xeon Platinum 8592+EPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684X 2P140280420560700Min: 17.53 / Avg: 132.64 / Max: 140.44Min: 18.27 / Avg: 159 / Max: 170.75Min: 43.63 / Avg: 212.71 / Max: 270.71Min: 52.69 / Avg: 264.5 / Max: 291.33Min: 43.49 / Avg: 278.96 / Max: 357.32Min: 75.75 / Avg: 282.15 / Max: 323.37Min: 82.11 / Avg: 309.57 / Max: 363.52Min: 57.24 / Avg: 326.01 / Max: 380.05Min: 29.19 / Avg: 327.28 / Max: 361.5Min: 22.61 / Avg: 334.62 / Max: 353.13Min: 32.34 / Avg: 341.03 / Max: 377.49Min: 34.63 / Avg: 400.88 / Max: 411.05Min: 105.85 / Avg: 443.24 / Max: 540.57Min: 100.31 / Avg: 527.27 / Max: 585.66Min: 108.39 / Avg: 565.33 / Max: 713.33Min: 182.49 / Avg: 591.26 / Max: 697.86Min: 186.31 / Avg: 642.97 / Max: 734.25Min: 163.14 / Avg: 663.83 / Max: 754.31Min: 59.61 / Avg: 665.36 / Max: 734.49Min: 42.79 / Avg: 678.72 / Max: 712.84Min: 71.86 / Avg: 683.42 / Max: 754.43Min: 69.9 / Avg: 802.07 / Max: 822.121. EPYC 8534PN: Approximate power consumption of 24361 Joules per run.2. EPYC 8534P: Approximate power consumption of 29203 Joules per run.3. Xeon 6766E: Approximate power consumption of 39068 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 48668 Joules per run.5. Xeon 6780E: Approximate power consumption of 51422 Joules per run.6. Xeon Max 9468: Approximate power consumption of 51916 Joules per run.7. Xeon Max 9480: Approximate power consumption of 56962 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 60095 Joules per run.9. EPYC 9654: Approximate power consumption of 60001 Joules per run.10. EPYC 9754: Approximate power consumption of 61347 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 62750 Joules per run.12. EPYC 9684X: Approximate power consumption of 73362 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 81408 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 96797 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 103832 Joules per run.16. Xeon Max 9468 2P: Approximate power consumption of 108791 Joules per run.17. Xeon Max 9480 2P: Approximate power consumption of 118306 Joules per run.18. Xeon Platinum 8490H 2P: Approximate power consumption of 122144 Joules per run.19. EPYC 9654 2P: Approximate power consumption of 121095 Joules per run.20. EPYC 9754 2P: Approximate power consumption of 123527 Joules per run.21. Xeon Platinum 8592+ 2P: Approximate power consumption of 125750 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 145977 Joules per run.

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: GoogLeNetEPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9654 2PXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 9754EPYC 9684XXeon Platinum 8380 2PXeon Max 9480Xeon Max 9468Xeon 6780E 2PXeon 6766E 2PEPYC 8534PXeon 6780EEPYC 8534PNXeon Platinum 8380Xeon 6766E130260390520650SE +/- 5.63, N = 6SE +/- 1.52, N = 3SE +/- 2.62, N = 3SE +/- 5.11, N = 3SE +/- 2.46, N = 3SE +/- 4.02, N = 10SE +/- 1.14, N = 3SE +/- 1.60, N = 3SE +/- 3.68, N = 3SE +/- 0.34, N = 3SE +/- 12.03, N = 12SE +/- 3.05, N = 12SE +/- 0.25, N = 3SE +/- 0.37, N = 3SE +/- 0.41, N = 3SE +/- 1.26, N = 3SE +/- 1.19, N = 3SE +/- 0.06, N = 3SE +/- 0.19, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.26, N = 3588.43577.76576.08525.84477.33470.95467.91464.78462.78461.23450.61425.25411.05398.40383.57378.79354.81313.50298.16295.29290.16278.05
OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: GoogLeNetEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon 6766EEPYC 9684XEPYC 9754 2PXeon Max 9480Xeon 6780EXeon Max 9468Xeon Platinum 8380Xeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon 6766E 2PEPYC 9684X 2PXeon 6780E 2PXeon Max 9480 2PXeon Max 9468 2P0.50851.0171.52552.0342.54252.2602.0981.8241.6461.5111.3781.2981.2931.2451.1801.1401.1371.1100.9740.9600.8710.8130.7810.7470.7340.7100.696
OpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.16.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon Platinum 8380Xeon 6780EEPYC 9654Xeon Platinum 8592+EPYC 9684XXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon 6766E 2PEPYC 9754 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P130260390520650Min: 16.37 / Avg: 130.65 / Max: 139.18Min: 18.68 / Avg: 149.41 / Max: 158.78Min: 43.64 / Avg: 214.28 / Max: 238.23Min: 19.9 / Avg: 247.07 / Max: 298.24Min: 52.49 / Avg: 261.52 / Max: 277.08Min: 43.63 / Avg: 261.65 / Max: 298.46Min: 16.07 / Avg: 286.15 / Max: 318.45Min: 35.37 / Avg: 306.26 / Max: 336.64Min: 33.11 / Avg: 328.89 / Max: 367.06Min: 62.15 / Avg: 334.67 / Max: 366.71Min: 73.74 / Avg: 337.25 / Max: 358.42Min: 83.34 / Avg: 337.62 / Max: 362.35Min: 106.15 / Avg: 454.45 / Max: 503.93Min: 41.61 / Avg: 472.75 / Max: 541.37Min: 104.77 / Avg: 505.8 / Max: 538.69Min: 109.13 / Avg: 515.79 / Max: 577.43Min: 60.16 / Avg: 547.94 / Max: 597.52Min: 81.09 / Avg: 593.47 / Max: 647.85Min: 65.4 / Avg: 622.34 / Max: 677.73Min: 163.66 / Avg: 661.11 / Max: 719.14Min: 205.47 / Avg: 671.88 / Max: 722Min: 204.77 / Avg: 672.55 / Max: 725.441. EPYC 8534PN: Approximate power consumption of 26131 Joules per run.2. EPYC 8534P: Approximate power consumption of 28138 Joules per run.3. Xeon 6766E: Approximate power consumption of 45571 Joules per run.4. EPYC 9754: Approximate power consumption of 32675 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 52827 Joules per run.6. Xeon 6780E: Approximate power consumption of 52068 Joules per run.7. EPYC 9654: Approximate power consumption of 36198 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 39814 Joules per run.9. EPYC 9684X: Approximate power consumption of 45661 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 43618 Joules per run.11. Xeon Max 9468: Approximate power consumption of 52499 Joules per run.12. Xeon Max 9480: Approximate power consumption of 50530 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 78620 Joules per run.14. EPYC 9754 2P: Approximate power consumption of 50820 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 73846 Joules per run.16. Xeon 6780E 2P: Approximate power consumption of 83558 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 63379 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 63700 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 80904 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 71179 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 87568 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 86087 Joules per run.

FFmpeg

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: PlatformEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468EPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P1224364860SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.15, N = 3SE +/- 0.01, N = 3SE +/- 0.16, N = 3SE +/- 0.12, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.27, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 355.6155.3855.1153.9253.2252.7949.7948.7648.3547.3247.3147.1346.8746.8646.5945.9544.0143.5529.9428.3927.1726.901. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
OpenBenchmarking.orgFPS Per Watt, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: PlatformEPYC 8534PNEPYC 8534PXeon 6780EXeon 6766EEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8592+Xeon Platinum 8380Xeon Platinum 8490HXeon 6766E 2PEPYC 9754 2PXeon 6780E 2PXeon Max 9480Xeon Max 9468EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P0.15750.3150.47250.630.78750.7000.6750.5160.4980.4980.4520.3990.3290.3030.2670.2300.2240.2220.2120.2100.2030.1920.1840.1680.1330.1060.104
OpenBenchmarking.orgWatts, Fewer Is BetterFFmpeg 7.0CPU Power Consumption MonitorXeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9754Xeon 6766E 2PEPYC 9654Xeon 6780E 2PEPYC 9684XXeon Platinum 8380Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9754 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P90180270360450Min: 43.59 / Avg: 54.55 / Max: 78.03Min: 43.43 / Avg: 58 / Max: 86.79Min: 15.45 / Avg: 66.97 / Max: 86.23Min: 15.65 / Avg: 69.43 / Max: 88.73Min: 20.65 / Avg: 94.97 / Max: 114.96Min: 56.04 / Avg: 117.19 / Max: 147.2Min: 27.62 / Avg: 123.14 / Max: 151.27Min: 61.79 / Avg: 127.88 / Max: 169.4Min: 28.08 / Avg: 138.95 / Max: 171.83Min: 49.55 / Avg: 145.35 / Max: 194.36Min: 27.23 / Avg: 163.84 / Max: 212.24Min: 62.31 / Avg: 186.7 / Max: 222.86Min: 39.9 / Avg: 210.51 / Max: 233.46Min: 76.85 / Avg: 225.5 / Max: 260.64Min: 81.77 / Avg: 228.19 / Max: 273.56Min: 100.74 / Avg: 237.01 / Max: 295.05Min: 57.48 / Avg: 260.25 / Max: 290.76Min: 61.23 / Avg: 286.98 / Max: 323.54Min: 68.77 / Avg: 316.56 / Max: 368.13Min: 161.47 / Avg: 365.67 / Max: 399.89Min: 212.12 / Avg: 439.49 / Max: 489.04Min: 205.4 / Avg: 441.78 / Max: 509.361. Xeon 6766E: Approximate power consumption of 16874 Joules per run.2. Xeon 6780E: Approximate power consumption of 16338 Joules per run.3. EPYC 8534PN: Approximate power consumption of 12569 Joules per run.4. EPYC 8534P: Approximate power consumption of 13029 Joules per run.5. EPYC 9754: Approximate power consumption of 17728 Joules per run.6. Xeon 6766E 2P: Approximate power consumption of 36680 Joules per run.7. EPYC 9654: Approximate power consumption of 19621 Joules per run.8. Xeon 6780E 2P: Approximate power consumption of 37894 Joules per run.9. EPYC 9684X: Approximate power consumption of 22140 Joules per run.10. Xeon Platinum 8380: Approximate power consumption of 28828 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 26706 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 32984 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 39435 Joules per run.14. Xeon Max 9468: Approximate power consumption of 41567 Joules per run.15. Xeon Max 9480: Approximate power consumption of 41303 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 47560 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 43202 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 46012 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 52232 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 66186 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 82478 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 84086 Joules per run.

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: Video On DemandEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468EPYC 9754EPYC 9754 2PEPYC 8534PNEPYC 8534PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P1224364860SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.13, N = 3SE +/- 0.43, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 355.5955.5655.0153.9953.2952.8149.8448.7748.1447.3447.3347.1446.9346.8846.7945.2944.1343.8029.9528.3927.1726.891. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
OpenBenchmarking.orgFPS Per Watt, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: Video On DemandEPYC 8534PNEPYC 8534PXeon 6780EEPYC 9754Xeon 6766EEPYC 9654EPYC 9684XXeon Platinum 8592+Xeon Platinum 8380Xeon Platinum 8490HXeon 6766E 2PEPYC 9754 2PXeon 6780E 2PXeon Max 9480Xeon Max 9468EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P0.15770.31540.47310.63080.78850.7010.6750.5160.4990.4980.4520.4000.3290.3030.2670.2290.2240.2220.2110.2100.2030.1910.1840.1680.1330.1070.102
OpenBenchmarking.orgWatts, Fewer Is BetterFFmpeg 7.0CPU Power Consumption MonitorXeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9754Xeon 6766E 2PEPYC 9654Xeon 6780E 2PEPYC 9684XXeon Platinum 8380Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9754 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P90180270360450Min: 43.59 / Avg: 54.51 / Max: 76.42Min: 29 / Avg: 58.08 / Max: 84.77Min: 16.1 / Avg: 66.97 / Max: 83.84Min: 15.96 / Avg: 69.48 / Max: 89.87Min: 19.72 / Avg: 94.92 / Max: 115.72Min: 103.99 / Avg: 117.45 / Max: 147.92Min: 28.98 / Avg: 123.07 / Max: 151.95Min: 60.98 / Avg: 127.77 / Max: 168.5Min: 33.72 / Avg: 139.07 / Max: 174.07Min: 51.94 / Avg: 145.51 / Max: 200.88Min: 27.6 / Avg: 164.12 / Max: 212.91Min: 60.59 / Avg: 186.45 / Max: 226Min: 40.07 / Avg: 210.54 / Max: 233.66Min: 78.38 / Avg: 225.58 / Max: 260.03Min: 85.24 / Avg: 228.49 / Max: 271.74Min: 100.82 / Avg: 237.65 / Max: 291.56Min: 56.36 / Avg: 260.19 / Max: 290.84Min: 64.38 / Avg: 287.45 / Max: 321.56Min: 70.84 / Avg: 317.18 / Max: 370.52Min: 163.78 / Avg: 366.29 / Max: 401.74Min: 214.26 / Avg: 439.08 / Max: 477.53Min: 207.79 / Avg: 444.37 / Max: 498.921. Xeon 6766E: Approximate power consumption of 16880 Joules per run.2. Xeon 6780E: Approximate power consumption of 16358 Joules per run.3. EPYC 8534PN: Approximate power consumption of 12569 Joules per run.4. EPYC 8534P: Approximate power consumption of 13038 Joules per run.5. EPYC 9754: Approximate power consumption of 17718 Joules per run.6. Xeon 6766E 2P: Approximate power consumption of 36839 Joules per run.7. EPYC 9654: Approximate power consumption of 19609 Joules per run.8. Xeon 6780E 2P: Approximate power consumption of 37863 Joules per run.9. EPYC 9684X: Approximate power consumption of 22158 Joules per run.10. Xeon Platinum 8380: Approximate power consumption of 28714 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 26697 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 32940 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 39372 Joules per run.14. Xeon Max 9468: Approximate power consumption of 41657 Joules per run.15. Xeon Max 9480: Approximate power consumption of 41508 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 47293 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 43191 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 46088 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 52228 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 66055 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 81962 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 85318 Joules per run.

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8380EPYC 9754Xeon 6780EEPYC 9684XEPYC 9654EPYC 9684X 2PXeon 6780E 2PXeon 6766EXeon 6766E 2PEPYC 9754 2PEPYC 8534PEPYC 9654 2PEPYC 8534PN50100150200250SE +/- 0.69, N = 15SE +/- 0.44, N = 3SE +/- 0.71, N = 3SE +/- 1.55, N = 15SE +/- 0.09, N = 3SE +/- 5.82, N = 12SE +/- 2.59, N = 15SE +/- 3.36, N = 15SE +/- 6.41, N = 15SE +/- 2.32, N = 15SE +/- 2.29, N = 15SE +/- 0.21, N = 3SE +/- 4.76, N = 12SE +/- 4.84, N = 15SE +/- 2.18, N = 15SE +/- 0.13, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 2.91, N = 3SE +/- 6.87, N = 12SE +/- 0.35, N = 3SE +/- 7.19, N = 1592.35100.74109.67110.97116.32121.67121.78139.10155.79160.53166.79174.14178.03182.02182.27182.36188.30194.11203.57216.70220.35226.631. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EXeon Platinum 8380EPYC 9654EPYC 9684XXeon 6766E 2PEPYC 9754 2PXeon 6780E 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2P120240360480600Min: 17.45 / Avg: 121.04 / Max: 134.63Min: 19.31 / Avg: 140.51 / Max: 154.48Min: 43.7 / Avg: 200.72 / Max: 216.16Min: 21.08 / Avg: 240.98 / Max: 267.52Min: 43.58 / Avg: 243.68 / Max: 263.63Min: 53.6 / Avg: 252.85 / Max: 280.59Min: 27.94 / Avg: 273.66 / Max: 300.92Min: 33.76 / Avg: 321.88 / Max: 360.42Min: 105.71 / Avg: 414.92 / Max: 451.7Min: 41.83 / Avg: 453.96 / Max: 496.3Min: 108.32 / Avg: 473.62 / Max: 514.95Min: 100.08 / Avg: 498.61 / Max: 537.57Min: 60.03 / Avg: 522.44 / Max: 571.64Min: 64.5 / Avg: 611.91 / Max: 674.711. EPYC 8534PN: Approximate power consumption of 7875 Joules per run.2. EPYC 8534P: Approximate power consumption of 9157 Joules per run.3. Xeon 6766E: Approximate power consumption of 13114 Joules per run.4. EPYC 9754: Approximate power consumption of 15632 Joules per run.5. Xeon 6780E: Approximate power consumption of 15758 Joules per run.6. Xeon Platinum 8380: Approximate power consumption of 16418 Joules per run.7. EPYC 9654: Approximate power consumption of 17715 Joules per run.8. EPYC 9684X: Approximate power consumption of 20815 Joules per run.9. Xeon 6766E 2P: Approximate power consumption of 27108 Joules per run.10. EPYC 9754 2P: Approximate power consumption of 29507 Joules per run.11. Xeon 6780E 2P: Approximate power consumption of 31101 Joules per run.12. Xeon Platinum 8380 2P: Approximate power consumption of 32310 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 33784 Joules per run.14. EPYC 9684X 2P: Approximate power consumption of 39448 Joules per run.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8380EPYC 9754Xeon 6780EEPYC 9684XEPYC 9654EPYC 9684X 2PXeon 6780E 2PXeon 6766EXeon 6766E 2PEPYC 9754 2PEPYC 8534PEPYC 9654 2PEPYC 8534PN3691215SE +/- 0.07619, N = 15SE +/- 0.04271, N = 3SE +/- 0.05824, N = 3SE +/- 0.11577, N = 15SE +/- 0.00664, N = 3SE +/- 0.34632, N = 12SE +/- 0.16487, N = 15SE +/- 0.15651, N = 15SE +/- 0.22869, N = 15SE +/- 0.08940, N = 15SE +/- 0.08489, N = 15SE +/- 0.00692, N = 3SE +/- 0.16422, N = 12SE +/- 0.15150, N = 15SE +/- 0.06453, N = 15SE +/- 0.00381, N = 3SE +/- 0.00241, N = 3SE +/- 0.00154, N = 3SE +/- 0.07023, N = 3SE +/- 0.14467, N = 12SE +/- 0.00718, N = 3SE +/- 0.11914, N = 1510.836239.926849.118859.033678.597198.399628.260167.241876.549656.247406.011645.742345.665085.550185.497115.483435.310505.151664.914204.664914.538174.465331. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8380EPYC 9754Xeon 6780EEPYC 9684XEPYC 9654EPYC 9684X 2PXeon 6780E 2PXeon 6766EXeon 6766E 2PEPYC 9754 2PEPYC 8534PEPYC 9654 2PEPYC 8534PN50100150200250SE +/- 0.69, N = 15SE +/- 0.44, N = 3SE +/- 0.71, N = 3SE +/- 1.55, N = 15SE +/- 0.09, N = 3SE +/- 5.82, N = 12SE +/- 2.59, N = 15SE +/- 3.36, N = 15SE +/- 6.41, N = 15SE +/- 2.32, N = 15SE +/- 2.29, N = 15SE +/- 0.21, N = 3SE +/- 4.76, N = 12SE +/- 4.84, N = 15SE +/- 2.18, N = 15SE +/- 0.13, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 2.91, N = 3SE +/- 6.87, N = 12SE +/- 0.35, N = 3SE +/- 7.19, N = 1592.35100.74109.67110.97116.32121.67121.78139.10155.79160.53166.79174.14178.03182.02182.27182.36188.30194.11203.57216.70220.35226.631. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

FFmpeg

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: UploadEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480EPYC 9754Xeon Max 9468Xeon Max 9480 2PEPYC 9754 2PEPYC 8534PNEPYC 8534PXeon Max 9468 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P714212835SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 327.6627.6127.4326.9326.8026.4124.9724.5623.7723.3623.3323.3023.2823.2723.2522.3421.9621.7315.4714.8714.0113.901. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
OpenBenchmarking.orgFPS Per Watt, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: UploadEPYC 8534PNEPYC 8534PXeon 6780EXeon 6766EEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8592+Xeon Platinum 8380Xeon Platinum 8490HXeon 6780E 2PXeon 6766E 2PEPYC 9754 2PXeon Max 9480Xeon Max 9468EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P0.08260.16520.24780.33040.4130.3670.3540.2830.2700.2580.2370.2100.1790.1670.1420.1210.1210.1130.1100.1080.1040.0980.0970.0950.0690.0540.052
OpenBenchmarking.orgWatts, Fewer Is BetterFFmpeg 7.0CPU Power Consumption MonitorXeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9754Xeon 6766E 2PEPYC 9654Xeon 6780E 2PXeon Platinum 8380EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HEPYC 9754 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P90180270360450Min: 21.91 / Avg: 51.98 / Max: 83.48Min: 26.8 / Avg: 54.72 / Max: 93.15Min: 16.42 / Avg: 63.46 / Max: 99.36Min: 17.2 / Avg: 65.65 / Max: 103.63Min: 21.11 / Avg: 90.52 / Max: 130.74Min: 103.98 / Avg: 114.66 / Max: 149.44Min: 28.66 / Avg: 116.46 / Max: 162.4Min: 105.83 / Avg: 122.91 / Max: 188.11Min: 54.29 / Avg: 131.33 / Max: 221.85Min: 32.37 / Avg: 131.52 / Max: 197.98Min: 33.49 / Avg: 150.78 / Max: 267.25Min: 59.92 / Avg: 175.77 / Max: 260.15Min: 40.21 / Avg: 205.67 / Max: 248.29Min: 77.87 / Avg: 215.12 / Max: 282.66Min: 73.34 / Avg: 216.54 / Max: 288.18Min: 101.47 / Avg: 224.76 / Max: 314.49Min: 57.5 / Avg: 253.71 / Max: 316.9Min: 60.82 / Avg: 280.31 / Max: 349.69Min: 74.8 / Avg: 282.67 / Max: 421.23Min: 169.76 / Avg: 355.39 / Max: 439.92Min: 200.89 / Avg: 428.04 / Max: 517.82Min: 200.59 / Avg: 429.86 / Max: 523.11. Xeon 6766E: Approximate power consumption of 14848 Joules per run.2. Xeon 6780E: Approximate power consumption of 14154 Joules per run.3. EPYC 8534PN: Approximate power consumption of 12248 Joules per run.4. EPYC 8534P: Approximate power consumption of 12671 Joules per run.5. EPYC 9754: Approximate power consumption of 17440 Joules per run.6. Xeon 6766E 2P: Approximate power consumption of 33022 Joules per run.7. EPYC 9654: Approximate power consumption of 18984 Joules per run.8. Xeon 6780E 2P: Approximate power consumption of 32736 Joules per run.9. Xeon Platinum 8380: Approximate power consumption of 26485 Joules per run.10. EPYC 9684X: Approximate power consumption of 21437 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 25381 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 32458 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 39625 Joules per run.14. Xeon Max 9468: Approximate power consumption of 41303 Joules per run.15. Xeon Max 9480: Approximate power consumption of 41071 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 45701 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 42285 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 45690 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 47960 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 66576 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 82326 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 84540 Joules per run.

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average LatencyXeon 6780EEPYC 9654EPYC 9684XXeon 6766EXeon Platinum 8592+Xeon Platinum 8380 2PEPYC 9754Xeon Max 9480Xeon Platinum 8490HXeon Max 9468Xeon Platinum 8490H 2PEPYC 8534PXeon Platinum 8380Xeon Max 9480 2PEPYC 9754 2PXeon Max 9468 2PEPYC 8534PNEPYC 9654 2PEPYC 9684X 2PXeon 6780E 2PXeon 6766E 2PXeon Platinum 8592+ 2P714212835SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.12, N = 12SE +/- 0.12, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 3SE +/- 0.25, N = 12SE +/- 0.32, N = 12SE +/- 0.15, N = 3SE +/- 0.14, N = 3SE +/- 0.10, N = 311.5412.5012.5812.6313.2613.6913.8413.8514.0414.2914.8616.3216.3416.6616.8816.9618.0518.0618.1626.2928.8130.201. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgWatts, Fewer Is BetterPostgreSQL 16CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754Xeon Platinum 8380Xeon 6766E 2PEPYC 9654Xeon 6780E 2PXeon Platinum 8592+EPYC 9684XXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P110220330440550Min: 15.4 / Avg: 110.68 / Max: 134.33Min: 16.91 / Avg: 135.16 / Max: 158.27Min: 43.52 / Avg: 150.61 / Max: 191.14Min: 43.39 / Avg: 172.92 / Max: 212.03Min: 21.27 / Avg: 207.74 / Max: 251.71Min: 54.49 / Avg: 239.87 / Max: 290.09Min: 104.31 / Avg: 242.14 / Max: 314.19Min: 19.41 / Avg: 254.31 / Max: 305.58Min: 107.64 / Avg: 262.99 / Max: 345.55Min: 31.89 / Avg: 275.46 / Max: 347.94Min: 32.63 / Avg: 299.03 / Max: 361.05Min: 54.62 / Avg: 299.36 / Max: 354.29Min: 69.55 / Avg: 311.42 / Max: 350.84Min: 86.13 / Avg: 315.59 / Max: 351.55Min: 71.52 / Avg: 361.27 / Max: 515.84Min: 37.64 / Avg: 361.97 / Max: 439.12Min: 48.63 / Avg: 431.32 / Max: 519.43Min: 103.15 / Avg: 454.63 / Max: 533.63Min: 42.76 / Avg: 483.2 / Max: 581.92Min: 162.26 / Avg: 519.08 / Max: 620.62Min: 201.21 / Avg: 553.8 / Max: 622.91Min: 197.27 / Avg: 561.38 / Max: 632.441. EPYC 8534PN: Approximate power consumption of 15901 Joules per run.2. EPYC 8534P: Approximate power consumption of 19419 Joules per run.3. Xeon 6766E: Approximate power consumption of 21738 Joules per run.4. Xeon 6780E: Approximate power consumption of 24785 Joules per run.5. EPYC 9754: Approximate power consumption of 29845 Joules per run.6. Xeon Platinum 8380: Approximate power consumption of 34102 Joules per run.7. Xeon 6766E 2P: Approximate power consumption of 35271 Joules per run.8. EPYC 9654: Approximate power consumption of 36282 Joules per run.9. Xeon 6780E 2P: Approximate power consumption of 38484 Joules per run.10. Xeon Platinum 8592+: Approximate power consumption of 38748 Joules per run.11. EPYC 9684X: Approximate power consumption of 42562 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 42409 Joules per run.13. Xeon Max 9468: Approximate power consumption of 44014 Joules per run.14. Xeon Max 9480: Approximate power consumption of 44604 Joules per run.15. Xeon Platinum 8592+ 2P: Approximate power consumption of 51180 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 52002 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 61140 Joules per run.18. Xeon Platinum 8380 2P: Approximate power consumption of 64709 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 68614 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 74402 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 78640 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 79904 Joules per run.

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read WriteXeon 6780EEPYC 9654EPYC 9684XXeon 6766EXeon Platinum 8592+Xeon Platinum 8380 2PEPYC 9754Xeon Max 9480Xeon Platinum 8490HXeon Max 9468Xeon Platinum 8490H 2PEPYC 8534PXeon Platinum 8380Xeon Max 9480 2PEPYC 9754 2PXeon Max 9468 2PEPYC 9654 2PEPYC 8534PNEPYC 9684X 2PXeon 6780E 2PXeon 6766E 2PXeon Platinum 8592+ 2P20K40K60K80K100KSE +/- 232.81, N = 3SE +/- 232.97, N = 3SE +/- 87.23, N = 3SE +/- 186.80, N = 3SE +/- 198.41, N = 3SE +/- 656.63, N = 3SE +/- 242.45, N = 3SE +/- 143.25, N = 3SE +/- 78.02, N = 3SE +/- 95.84, N = 3SE +/- 137.82, N = 3SE +/- 175.33, N = 3SE +/- 434.11, N = 12SE +/- 440.63, N = 3SE +/- 58.85, N = 3SE +/- 195.77, N = 3SE +/- 865.71, N = 12SE +/- 299.71, N = 3SE +/- 1059.49, N = 12SE +/- 221.82, N = 3SE +/- 163.06, N = 3SE +/- 106.16, N = 3866777998779492791917539673042722447222571227699696731561272612336004659228589525550555395552723804334716331101. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Barbershop - Compute: CPU-OnlyEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon 6780E 2PXeon 6766E 2PEPYC 9754EPYC 9684XXeon Platinum 8592+ 2PEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon 6780EXeon 6766EXeon Platinum 8380 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon Platinum 8380100200300400500SE +/- 0.07, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 3SE +/- 0.17, N = 3SE +/- 0.41, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.21, N = 3SE +/- 0.25, N = 3SE +/- 0.42, N = 3SE +/- 0.06, N = 3SE +/- 0.23, N = 3SE +/- 0.08, N = 3SE +/- 0.33, N = 3SE +/- 0.25, N = 3SE +/- 0.69, N = 3SE +/- 0.06, N = 3SE +/- 0.18, N = 3SE +/- 0.07, N = 3SE +/- 1.09, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 365.5867.5279.0597.18106.48114.76123.90125.87139.25141.54156.70169.44174.49191.20235.31236.73240.13261.97263.76290.56320.11456.81
OpenBenchmarking.orgWatts, Fewer Is BetterBlender 4.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon 6780EEPYC 9654EPYC 9754Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9684XXeon 6766E 2PXeon 6780E 2PXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2P140280420560700Min: 17.54 / Avg: 139.56 / Max: 146.03Min: 17.05 / Avg: 166.92 / Max: 172.9Min: 43.74 / Avg: 219.92 / Max: 232.7Min: 52.6 / Avg: 265.95 / Max: 290.85Min: 43.73 / Avg: 282.74 / Max: 303.29Min: 27.59 / Avg: 319.36 / Max: 343.48Min: 23.25 / Avg: 321.43 / Max: 348.37Min: 33.95 / Avg: 339.43 / Max: 377.51Min: 60.47 / Avg: 340.87 / Max: 376.73Min: 85.64 / Avg: 342.89 / Max: 377.27Min: 73.43 / Avg: 343.06 / Max: 375.17Min: 35.25 / Avg: 388.09 / Max: 411.05Min: 106.4 / Avg: 442.07 / Max: 501.67Min: 108.93 / Avg: 517.76 / Max: 626.1Min: 104.16 / Avg: 521 / Max: 582.69Min: 41.32 / Avg: 614.31 / Max: 703.89Min: 58.63 / Avg: 632.52 / Max: 694.54Min: 79.57 / Avg: 660.14 / Max: 755.17Min: 167.6 / Avg: 666.99 / Max: 755.27Min: 209.81 / Avg: 673.68 / Max: 752.4Min: 206.17 / Avg: 675.87 / Max: 751.49Min: 68.76 / Avg: 738.74 / Max: 823.721. EPYC 8534PN: Approximate power consumption of 37636 Joules per run.2. EPYC 8534P: Approximate power consumption of 41008 Joules per run.3. Xeon 6766E: Approximate power consumption of 43617 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 122956 Joules per run.5. Xeon 6780E: Approximate power consumption of 51270 Joules per run.6. EPYC 9654: Approximate power consumption of 47266 Joules per run.7. EPYC 9754: Approximate power consumption of 38786 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 82369 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 91354 Joules per run.10. Xeon Max 9480: Approximate power consumption of 101723 Joules per run.11. Xeon Max 9468: Approximate power consumption of 111722 Joules per run.12. EPYC 9684X: Approximate power consumption of 50064 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 50690 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 57644 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 126603 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 44025 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 53764 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 87578 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 99381 Joules per run.20. Xeon Max 9480 2P: Approximate power consumption of 110259 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 119403 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 53682 Joules per run.

Numpy Benchmark

This is a test to obtain the general Numpy performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkEPYC 9684XEPYC 9684X 2PEPYC 9654EPYC 9654 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon Platinum 8380Xeon Platinum 8380 2PXeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P120240360480600SE +/- 1.85, N = 3SE +/- 0.60, N = 3SE +/- 2.28, N = 3SE +/- 0.38, N = 3SE +/- 1.84, N = 3SE +/- 1.42, N = 3SE +/- 0.79, N = 3SE +/- 0.60, N = 3SE +/- 0.26, N = 3SE +/- 0.33, N = 3SE +/- 1.30, N = 3SE +/- 1.13, N = 3SE +/- 0.96, N = 3SE +/- 0.25, N = 3SE +/- 0.72, N = 3SE +/- 1.34, N = 3SE +/- 2.23, N = 3SE +/- 1.52, N = 3SE +/- 2.24, N = 3SE +/- 0.47, N = 3SE +/- 0.37, N = 3SE +/- 0.30, N = 3542.15540.96529.80529.03520.22519.89464.72461.61456.18455.57439.84435.21425.46422.76421.99418.89400.64394.71284.33283.52261.19258.49
OpenBenchmarking.orgScore Per Watt, More Is BetterNumpy BenchmarkEPYC 8534PNEPYC 8534PXeon 6780EXeon 6766EEPYC 9754EPYC 9654Xeon Platinum 8592+EPYC 9684XXeon Platinum 8490HXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon 6780E 2PXeon 6766E 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P2468107.9627.9186.2445.8175.4055.3595.2554.8544.1834.0433.2903.1642.6032.3822.3602.2492.1702.0792.0711.7161.3751.343
OpenBenchmarking.orgWatts, Fewer Is BetterNumpy BenchmarkCPU Power Consumption MonitorXeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8380Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8490HEPYC 9684XXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P80160240320400Min: 21.86 / Avg: 44.9 / Max: 66.76Min: 43.42 / Avg: 45.54 / Max: 66.48Min: 14.57 / Avg: 52.61 / Max: 56.75Min: 16.02 / Avg: 53.3 / Max: 57.51Min: 20.13 / Avg: 78.72 / Max: 83.54Min: 26.33 / Avg: 98.86 / Max: 103.35Min: 33.91 / Avg: 98.99 / Max: 138.69Min: 48.6 / Avg: 99.09 / Max: 103.63Min: 104.03 / Avg: 108.54 / Max: 129.89Min: 53.93 / Avg: 108.91 / Max: 127.19Min: 59.12 / Avg: 108.92 / Max: 159.89Min: 32.28 / Avg: 111.7 / Max: 116.99Min: 73.46 / Avg: 140.29 / Max: 199.25Min: 82.95 / Avg: 146.89 / Max: 202.52Min: 99.11 / Avg: 190.58 / Max: 201.58Min: 38.63 / Avg: 194.78 / Max: 202.23Min: 78.29 / Avg: 220.31 / Max: 293.25Min: 57.9 / Avg: 235.19 / Max: 242.43Min: 64.52 / Avg: 260.26 / Max: 267.94Min: 168.75 / Avg: 265.77 / Max: 348.44Min: 203.89 / Avg: 319.82 / Max: 421.94Min: 137.87 / Avg: 324.03 / Max: 425.171. Xeon 6766E: Approximate power consumption of 14129 Joules per run.2. Xeon 6780E: Approximate power consumption of 13039 Joules per run.3. EPYC 8534PN: Approximate power consumption of 9820 Joules per run.4. EPYC 8534P: Approximate power consumption of 9949 Joules per run.5. EPYC 9754: Approximate power consumption of 14878 Joules per run.6. EPYC 9654: Approximate power consumption of 15357 Joules per run.7. Xeon Platinum 8592+: Approximate power consumption of 13430 Joules per run.8. Xeon Platinum 8380: Approximate power consumption of 19918 Joules per run.9. Xeon 6766E 2P: Approximate power consumption of 34442 Joules per run.10. Xeon 6780E 2P: Approximate power consumption of 31258 Joules per run.11. Xeon Platinum 8490H: Approximate power consumption of 16483 Joules per run.12. EPYC 9684X: Approximate power consumption of 17127 Joules per run.13. Xeon Max 9468: Approximate power consumption of 21324 Joules per run.14. Xeon Max 9480: Approximate power consumption of 22181 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 38877 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 36749 Joules per run.17. Xeon Platinum 8592+ 2P: Approximate power consumption of 31358 Joules per run.18. EPYC 9654 2P: Approximate power consumption of 36532 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 40513 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 40662 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 51810 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 51197 Joules per run.

LuxCoreRender

LuxCoreRender is an open-source 3D physically based renderer formerly known as LuxRender. LuxCoreRender supports CPU-based rendering as well as GPU acceleration via OpenCL, NVIDIA CUDA, and NVIDIA OptiX interfaces. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: DLSC - Acceleration: CPUEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon 6780EXeon 6766EEPYC 8534PXeon Platinum 8592+Xeon Platinum 8380 2PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon 6780E 2PXeon 6766E 2PXeon Max 9468Xeon Platinum 8380510152025SE +/- 0.91, N = 15SE +/- 1.02, N = 15SE +/- 0.12, N = 3SE +/- 0.28, N = 15SE +/- 0.18, N = 15SE +/- 0.13, N = 3SE +/- 0.24, N = 15SE +/- 0.23, N = 15SE +/- 0.20, N = 15SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 15SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 15SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.22, N = 15SE +/- 0.22, N = 12SE +/- 0.08, N = 3SE +/- 0.05, N = 322.5822.0017.8916.7916.2114.2912.7411.1210.4410.1710.099.409.399.388.988.728.488.007.997.717.465.63
OpenBenchmarking.orgM samples/sec Per Watt, More Is BetterLuxCoreRender 2.6Scene: DLSC - Acceleration: CPUEPYC 8534PNEPYC 8534PEPYC 9754Xeon 6766EEPYC 9654Xeon 6780EEPYC 9684XEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+Xeon 6766E 2PXeon Platinum 8490HXeon Max 9480Xeon 6780E 2PXeon Max 9468Xeon Platinum 8380Xeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P0.01490.02980.04470.05960.07450.0660.0600.0540.0520.0480.0450.0420.0390.0310.0310.0290.0260.0260.0240.0230.0230.0220.0190.0180.0170.0160.015
OpenBenchmarking.orgWatts, Fewer Is BetterLuxCoreRender 2.6CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Platinum 8380Xeon 6766E 2PEPYC 9654EPYC 9754Xeon Platinum 8592+Xeon Max 9480Xeon Platinum 8490HXeon Max 9468Xeon 6780E 2PEPYC 9684XXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P150300450600750Min: 18.19 / Avg: 128.95 / Max: 140.58Min: 18.62 / Avg: 156.14 / Max: 171.55Min: 43.65 / Avg: 180.3 / Max: 223.44Min: 43.51 / Avg: 225.44 / Max: 288.32Min: 51.32 / Avg: 255.3 / Max: 289.97Min: 104.02 / Avg: 295.99 / Max: 409.35Min: 29.9 / Avg: 299.39 / Max: 326.71Min: 20.73 / Avg: 311.89 / Max: 340.37Min: 24.28 / Avg: 326.43 / Max: 375.69Min: 72.86 / Avg: 330.29 / Max: 377.65Min: 59.67 / Avg: 330.53 / Max: 373.83Min: 74.56 / Avg: 331.26 / Max: 374.04Min: 79.88 / Avg: 341.83 / Max: 482.57Min: 34.75 / Avg: 384.12 / Max: 412.45Min: 101.11 / Avg: 511.71 / Max: 580Min: 42.95 / Avg: 561.1 / Max: 675.69Min: 59.66 / Avg: 573.93 / Max: 661.76Min: 76.68 / Avg: 654.92 / Max: 755.35Min: 173.98 / Avg: 664.56 / Max: 753.01Min: 195.7 / Avg: 665.76 / Max: 753.2Min: 203.55 / Avg: 668.4 / Max: 754.98Min: 65.89 / Avg: 739.45 / Max: 837.691. EPYC 8534PN: Approximate power consumption of 8468 Joules per run.2. EPYC 8534P: Approximate power consumption of 10128 Joules per run.3. Xeon 6766E: Approximate power consumption of 11780 Joules per run.4. Xeon 6780E: Approximate power consumption of 14654 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 16595 Joules per run.6. Xeon 6766E 2P: Approximate power consumption of 19363 Joules per run.7. EPYC 9654: Approximate power consumption of 19560 Joules per run.8. EPYC 9754: Approximate power consumption of 20335 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 21327 Joules per run.10. Xeon Max 9480: Approximate power consumption of 21469 Joules per run.11. Xeon Platinum 8490H: Approximate power consumption of 21572 Joules per run.12. Xeon Max 9468: Approximate power consumption of 21532 Joules per run.13. Xeon 6780E 2P: Approximate power consumption of 22356 Joules per run.14. EPYC 9684X: Approximate power consumption of 24993 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 33261 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 36696 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 37497 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 42919 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 43595 Joules per run.20. Xeon Max 9468 2P: Approximate power consumption of 43052 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 43491 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 47818 Joules per run.

OpenSSL

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: AES-128-GCMEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon 6780E 2PEPYC 9754Xeon 6766E 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PNXeon Platinum 8380500000M1000000M1500000M2000000M2500000MSE +/- 1841260363.24, N = 3SE +/- 1428966819.54, N = 3SE +/- 337702856.52, N = 3SE +/- 1622921637.03, N = 3SE +/- 159598753.20, N = 3SE +/- 697208281.49, N = 3SE +/- 268465891.11, N = 3SE +/- 333650111.34, N = 3SE +/- 49279694.68, N = 3SE +/- 429428665.34, N = 3SE +/- 570058274.06, N = 3SE +/- 164763342.54, N = 3SE +/- 1253503549.61, N = 3SE +/- 266669781.18, N = 3SE +/- 28627701.54, N = 3SE +/- 56355870.99, N = 3SE +/- 43545680.66, N = 3SE +/- 129279575.06, N = 3SE +/- 195953395.92, N = 3SE +/- 530918594.60, N = 3SE +/- 409615403.40, N = 3SE +/- 706172241.68, N = 323166119452831990352059967178500687906717693131460131533026300727148466962705012775833827571266882866653116722114187010960821997139960071092678972884361238895675065408072292653007688046936977477107026606412008481706384532037635657207677835397849313734889653908573995268154271. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenBenchmarking.orgbyte/s Per Watt, More Is BetterOpenSSL 3.3Algorithm: AES-128-GCMEPYC 8534PNEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 9654EPYC 9654 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9684X 2PXeon Platinum 8490HXeon 6766EXeon Platinum 8490H 2PXeon 6766E 2PXeon Max 9480Xeon Max 9480 2PXeon Max 9468Xeon 6780EXeon Max 9468 2PXeon 6780E 2PXeon Platinum 8380 2PXeon Platinum 8380700M1400M2100M2800M3500M3483917754.103351926704.373291374680.153225126995.222686039538.132638396952.002600338214.732589909503.872482510440.032480518885.862333237948.272305290901.872275619248.612230951841.302214398499.062168460340.432035473064.321970077384.371967868118.181953802430.201525932773.141510207805.12
OpenBenchmarking.orgWatts, Fewer Is BetterOpenSSL 3.3CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon Max 9468Xeon 6780EXeon Platinum 8490HEPYC 9654Xeon Max 9480Xeon Platinum 8592+EPYC 9754EPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Max 9480 2PEPYC 9754 2PEPYC 9684X 2P140280420560700Min: 17.62 / Avg: 140.35 / Max: 146.9Min: 17.13 / Avg: 167.37 / Max: 173.46Min: 43.71 / Avg: 245.4 / Max: 270.99Min: 54.11 / Avg: 264.55 / Max: 290.68Min: 72.06 / Avg: 315.01 / Max: 350.37Min: 43.57 / Avg: 324.08 / Max: 356.29Min: 57.48 / Avg: 329.5 / Max: 379.19Min: 28.74 / Avg: 334.06 / Max: 354.77Min: 73.91 / Avg: 337.66 / Max: 377.26Min: 21.98 / Avg: 342.1 / Max: 376.9Min: 22.8 / Avg: 348.22 / Max: 361.46Min: 34.83 / Avg: 401.21 / Max: 411.04Min: 109.26 / Avg: 491.31 / Max: 541.12Min: 101.06 / Avg: 529.01 / Max: 581.52Min: 110.15 / Avg: 648.42 / Max: 712.91Min: 201.68 / Avg: 649.22 / Max: 717.93Min: 164.19 / Avg: 673.67 / Max: 754.31Min: 56.69 / Avg: 676.55 / Max: 719.01Min: 68.61 / Avg: 683.16 / Max: 735.37Min: 187.64 / Avg: 684.67 / Max: 756.52Min: 40.47 / Avg: 703.84 / Max: 726.54Min: 68.36 / Avg: 802.39 / Max: 822.11. EPYC 8534PN: Approximate power consumption of 25777 Joules per run.2. EPYC 8534P: Approximate power consumption of 30684 Joules per run.3. Xeon 6766E: Approximate power consumption of 45154 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 48677 Joules per run.5. Xeon Max 9468: Approximate power consumption of 58067 Joules per run.6. Xeon 6780E: Approximate power consumption of 59522 Joules per run.7. Xeon Platinum 8490H: Approximate power consumption of 60628 Joules per run.8. EPYC 9654: Approximate power consumption of 61132 Joules per run.9. Xeon Max 9480: Approximate power consumption of 62017 Joules per run.10. Xeon Platinum 8592+: Approximate power consumption of 62946 Joules per run.11. EPYC 9754: Approximate power consumption of 63841 Joules per run.12. EPYC 9684X: Approximate power consumption of 73421 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 90400 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 97161 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 118877 Joules per run.16. Xeon Max 9468 2P: Approximate power consumption of 119024 Joules per run.17. Xeon Platinum 8490H 2P: Approximate power consumption of 124630 Joules per run.18. EPYC 9654 2P: Approximate power consumption of 123358 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 125701 Joules per run.20. Xeon Max 9480 2P: Approximate power consumption of 125750 Joules per run.21. EPYC 9754 2P: Approximate power consumption of 128099 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 145768 Joules per run.

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: AES-256-GCMEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon 6780E 2PXeon Max 9468 2PEPYC 9754Xeon 6766E 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480Xeon 6780EXeon Max 9468Xeon 6766EEPYC 8534PEPYC 8534PNXeon Platinum 8380400000M800000M1200000M1600000M2000000MSE +/- 1791964708.17, N = 3SE +/- 1859275059.09, N = 3SE +/- 2225250504.62, N = 3SE +/- 1320809584.03, N = 3SE +/- 1397764228.85, N = 3SE +/- 112278705.55, N = 3SE +/- 301551944.80, N = 3SE +/- 108288170.03, N = 3SE +/- 290015345.25, N = 3SE +/- 252081360.30, N = 3SE +/- 671752057.50, N = 3SE +/- 818689705.82, N = 3SE +/- 3966858436.56, N = 3SE +/- 116420153.53, N = 3SE +/- 2848140790.67, N = 3SE +/- 63026881.96, N = 3SE +/- 317370827.95, N = 3SE +/- 119857064.56, N = 3SE +/- 34244051.67, N = 3SE +/- 148092414.72, N = 3SE +/- 3442274884.66, N = 3SE +/- 81945775.93, N = 3198310302670017140617610871526505465813149752993937713695343284701181148957353112537304117310118989933239975390078739794193887978597205999637676965536677443876836707124854114477002393527175920141154535689375783135074567280875063013746234623097505304158939632073560620408831. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenBenchmarking.orgbyte/s Per Watt, More Is BetterOpenSSL 3.3Algorithm: AES-256-GCMEPYC 8534PNEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 9654EPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9684XEPYC 9684X 2PXeon 6766EXeon Platinum 8490HXeon Platinum 8490H 2PXeon 6766E 2PXeon Max 9480Xeon 6780EXeon Max 9480 2PXeon 6780E 2PXeon Max 9468Xeon Max 9468 2PXeon Platinum 8380 2PXeon Platinum 8380600M1200M1800M2400M3000M2991193842.102889219779.922844279712.452800094011.982331206946.712286984508.792193171119.612177657519.612144285710.422139406659.572061752146.932048623453.071998240264.781993158291.381789501537.541758065363.321745319585.661735227671.901651813451.151587520126.441345006115.811344485766.05
OpenBenchmarking.orgWatts, Fewer Is BetterOpenSSL 3.3CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon Max 9468Xeon 6780EEPYC 9654Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+EPYC 9754EPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PXeon Max 9468 2PXeon 6780E 2PEPYC 9654 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9684X 2P140280420560700Min: 16.68 / Avg: 139.04 / Max: 145.32Min: 17.84 / Avg: 165.11 / Max: 170.43Min: 43.78 / Avg: 245.57 / Max: 271.22Min: 52.04 / Avg: 264.83 / Max: 290.23Min: 69.15 / Avg: 307.21 / Max: 344.49Min: 43.56 / Avg: 323.62 / Max: 356.6Min: 29.29 / Avg: 329.31 / Max: 350.94Min: 76.66 / Avg: 330.83 / Max: 377.06Min: 57.11 / Avg: 341.81 / Max: 377.46Min: 23.55 / Avg: 341.83 / Max: 377.46Min: 22.57 / Avg: 345.26 / Max: 357.86Min: 34.11 / Avg: 400.94 / Max: 411.04Min: 108.93 / Avg: 491.39 / Max: 542.48Min: 103.41 / Avg: 529.73 / Max: 581.31Min: 186.02 / Avg: 637.41 / Max: 707.3Min: 109.57 / Avg: 648.54 / Max: 712.9Min: 59.32 / Avg: 667.48 / Max: 710.25Min: 191.65 / Avg: 676.75 / Max: 755.44Min: 67.1 / Avg: 682.81 / Max: 732.1Min: 152.63 / Avg: 685.37 / Max: 754.67Min: 42.68 / Avg: 697.23 / Max: 724.85Min: 64.77 / Avg: 801.19 / Max: 822.221. EPYC 8534PN: Approximate power consumption of 25537 Joules per run.2. EPYC 8534P: Approximate power consumption of 30324 Joules per run.3. Xeon 6766E: Approximate power consumption of 45185 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 48729 Joules per run.5. Xeon Max 9468: Approximate power consumption of 56425 Joules per run.6. Xeon 6780E: Approximate power consumption of 59653 Joules per run.7. EPYC 9654: Approximate power consumption of 60264 Joules per run.8. Xeon Max 9480: Approximate power consumption of 60872 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 63007 Joules per run.10. Xeon Platinum 8592+: Approximate power consumption of 62897 Joules per run.11. EPYC 9754: Approximate power consumption of 63298 Joules per run.12. EPYC 9684X: Approximate power consumption of 73238 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 90416 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 97470 Joules per run.15. Xeon Max 9468 2P: Approximate power consumption of 117496 Joules per run.16. Xeon 6780E 2P: Approximate power consumption of 118900 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 121703 Joules per run.18. Xeon Max 9480 2P: Approximate power consumption of 124297 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 125638 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 126108 Joules per run.21. EPYC 9754 2P: Approximate power consumption of 126895 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 145549 Joules per run.

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: ChaCha20EPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8380 2PXeon 6780E 2PXeon 6766E 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon Platinum 8380Xeon 6780EXeon 6766E300000M600000M900000M1200000M1500000MSE +/- 63368290.15, N = 3SE +/- 874940734.18, N = 3SE +/- 80233613.02, N = 3SE +/- 303075210.03, N = 3SE +/- 170968063.89, N = 3SE +/- 271318554.29, N = 3SE +/- 94935214.36, N = 3SE +/- 863978337.15, N = 3SE +/- 151272595.84, N = 3SE +/- 329510485.23, N = 3SE +/- 352722951.98, N = 3SE +/- 63366974.35, N = 3SE +/- 11835135.62, N = 3SE +/- 3335467.26, N = 3SE +/- 232288636.76, N = 3SE +/- 9570566.28, N = 3SE +/- 71110585.03, N = 3SE +/- 312824840.64, N = 3SE +/- 415487944.57, N = 3SE +/- 151152302.42, N = 3SE +/- 39095934.62, N = 3SE +/- 11028602.79, N = 31306928507573108661819195010015026348606842843827606563963293876244029729475449040847735229124033475033110211234499084949274254511900633919112254803528268216533441509169373161264211733070689383772820533270772637406900672265973541532122948838301969206832701772490621831. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenBenchmarking.orgbyte/s Per Watt, More Is BetterOpenSSL 3.3Algorithm: ChaCha20EPYC 8534PNEPYC 8534PEPYC 9754EPYC 9754 2PEPYC 9654EPYC 9654 2PEPYC 9684XEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon 6766EXeon Max 9480Xeon Max 9480 2PXeon Max 9468Xeon Platinum 8380 2PXeon 6766E 2PXeon Platinum 8380Xeon Max 9468 2PXeon 6780EXeon 6780E 2P400M800M1200M1600M2000M2009755510.331824186596.161795036060.881778324265.621510491450.861480134319.021361592598.331353849347.711008751851.931003586866.34977212174.27936302176.04862670148.37852735838.29846331621.99811931853.54804835329.47804207062.62802490465.58774438543.71730208953.76712317847.22
OpenBenchmarking.orgWatts, Fewer Is BetterOpenSSL 3.3CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon 6780EXeon Max 9468Xeon Max 9480Xeon Platinum 8490HEPYC 9654Xeon Platinum 8592+EPYC 9754EPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9684X 2P150300450600750Min: 15.27 / Avg: 140.34 / Max: 147.74Min: 17.59 / Avg: 168.33 / Max: 176.1Min: 43.7 / Avg: 205.47 / Max: 234.45Min: 54.01 / Avg: 264.55 / Max: 291.24Min: 43.55 / Avg: 269.68 / Max: 311.17Min: 71.67 / Avg: 279.08 / Max: 326.73Min: 73.21 / Avg: 309.29 / Max: 373.85Min: 54.19 / Avg: 323.5 / Max: 377.22Min: 30.31 / Avg: 333.21 / Max: 358.89Min: 22.69 / Avg: 341.17 / Max: 376.63Min: 22.28 / Avg: 365.67 / Max: 391.73Min: 34.55 / Avg: 400.2 / Max: 411.05Min: 108.7 / Avg: 438.73 / Max: 492.61Min: 101.74 / Avg: 528.62 / Max: 581.46Min: 109.96 / Avg: 550.19 / Max: 629.46Min: 197.94 / Avg: 580.95 / Max: 674.82Min: 183.97 / Avg: 617.86 / Max: 744.83Min: 168.89 / Avg: 666.88 / Max: 755.69Min: 59.94 / Avg: 676.63 / Max: 728.84Min: 70.13 / Avg: 681.84 / Max: 728.96Min: 42.15 / Avg: 734.92 / Max: 800.62Min: 70.23 / Avg: 802.61 / Max: 826.121. EPYC 8534PN: Approximate power consumption of 25729 Joules per run.2. EPYC 8534P: Approximate power consumption of 30917 Joules per run.3. Xeon 6766E: Approximate power consumption of 37737 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 48676 Joules per run.5. Xeon 6780E: Approximate power consumption of 49531 Joules per run.6. Xeon Max 9468: Approximate power consumption of 51351 Joules per run.7. Xeon Max 9480: Approximate power consumption of 56909 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 59524 Joules per run.9. EPYC 9654: Approximate power consumption of 61089 Joules per run.10. Xeon Platinum 8592+: Approximate power consumption of 62774 Joules per run.11. EPYC 9754: Approximate power consumption of 66918 Joules per run.12. EPYC 9684X: Approximate power consumption of 73369 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 80726 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 97090 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 101419 Joules per run.16. Xeon Max 9468 2P: Approximate power consumption of 106507 Joules per run.17. Xeon Max 9480 2P: Approximate power consumption of 117187 Joules per run.18. Xeon Platinum 8490H 2P: Approximate power consumption of 122929 Joules per run.19. EPYC 9654 2P: Approximate power consumption of 123372 Joules per run.20. Xeon Platinum 8592+ 2P: Approximate power consumption of 125913 Joules per run.21. EPYC 9754 2P: Approximate power consumption of 134001 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 145808 Joules per run.

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: SHA512EPYC 9754 2PEPYC 9684X 2PXeon 6780E 2PEPYC 9654 2PXeon 6766E 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XXeon 6780EXeon Platinum 8490H 2PXeon 6766EEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PNXeon Platinum 8380 2PXeon Max 9480Xeon Max 9468Xeon Platinum 838020000M40000M60000M80000M100000MSE +/- 17716195.81, N = 3SE +/- 44023374.36, N = 3SE +/- 64065176.93, N = 3SE +/- 37307640.51, N = 3SE +/- 66704467.17, N = 3SE +/- 5822493.86, N = 3SE +/- 14734422.48, N = 3SE +/- 55712209.05, N = 3SE +/- 24045021.87, N = 3SE +/- 481040738.21, N = 3SE +/- 14430784.68, N = 3SE +/- 6285194.15, N = 3SE +/- 14339684.98, N = 3SE +/- 3500318.33, N = 3SE +/- 15082903.45, N = 3SE +/- 37654528.63, N = 3SE +/- 203213936.42, N = 3SE +/- 9990938.84, N = 3SE +/- 20492408.59, N = 3SE +/- 1250834.62, N = 3SE +/- 500176.69, N = 3SE +/- 6313493.56, N = 31047766330479145597120089194416857788222573837859939523052746634113465207607074586513191345088755640428462544774060513792339627575497375645220533230422299324378460820238860547702221992772322194470973220795399001889398078316199261277109809400931. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenBenchmarking.orgbyte/s Per Watt, More Is BetterOpenSSL 3.3Algorithm: SHA512Xeon 6766EEPYC 8534PNXeon 6766E 2PEPYC 9754EPYC 9754 2PEPYC 8534PXeon 6780EXeon 6780E 2PEPYC 9654EPYC 9654 2PEPYC 9684XEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9480 2PXeon Max 9468Xeon Max 9468 2PXeon Platinum 8380 2PXeon Platinum 838040M80M120M160M200M165922834.04165874523.26159806130.44157697655.07154893248.59154425638.15139323873.72137868745.00128564080.98125714359.16114623223.18114225793.1069884736.5767966151.0965144677.3062457308.5057121711.2355449110.3754000562.6751580447.5242041804.1841470367.43
OpenBenchmarking.orgWatts, Fewer Is BetterOpenSSL 3.3CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon Max 9468EPYC 9654Xeon 6780EXeon Max 9480EPYC 9754Xeon Platinum 8490HXeon Platinum 8592+EPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PXeon Max 9468 2PEPYC 9654 2PXeon 6780E 2PEPYC 9754 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684X 2P140280420560700Min: 15.55 / Avg: 133.8 / Max: 143.63Min: 18.44 / Avg: 157.87 / Max: 169.7Min: 43.65 / Avg: 244.72 / Max: 270.07Min: 53.35 / Avg: 264.79 / Max: 291.44Min: 71.29 / Avg: 299.98 / Max: 317.48Min: 28.99 / Avg: 308.23 / Max: 338.17Min: 43.5 / Avg: 323.63 / Max: 356.46Min: 74.41 / Avg: 330.77 / Max: 354.3Min: 21.49 / Avg: 334.48 / Max: 349.67Min: 56.54 / Avg: 341.09 / Max: 377.07Min: 23.35 / Avg: 341.79 / Max: 377.28Min: 34.64 / Avg: 400.14 / Max: 413.51Min: 106.79 / Avg: 491.84 / Max: 540.07Min: 105.66 / Avg: 525.18 / Max: 583.12Min: 190.86 / Avg: 626.29 / Max: 729.82Min: 59.93 / Avg: 626.99 / Max: 687.56Min: 108.54 / Avg: 646.95 / Max: 712.56Min: 42.68 / Avg: 676.44 / Max: 705.8Min: 194.96 / Avg: 677.46 / Max: 722.73Min: 66.13 / Avg: 684.47 / Max: 754.35Min: 158.63 / Avg: 686.01 / Max: 753.85Min: 66.79 / Avg: 800.66 / Max: 822.161. EPYC 8534PN: Approximate power consumption of 24620 Joules per run.2. EPYC 8534P: Approximate power consumption of 28995 Joules per run.3. Xeon 6766E: Approximate power consumption of 45029 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 48721 Joules per run.5. Xeon Max 9468: Approximate power consumption of 55097 Joules per run.6. EPYC 9654: Approximate power consumption of 56509 Joules per run.7. Xeon 6780E: Approximate power consumption of 59439 Joules per run.8. Xeon Max 9480: Approximate power consumption of 60861 Joules per run.9. EPYC 9754: Approximate power consumption of 61210 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 62760 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 62890 Joules per run.12. EPYC 9684X: Approximate power consumption of 73225 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 90335 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 96458 Joules per run.15. Xeon Max 9468 2P: Approximate power consumption of 115028 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 114322 Joules per run.17. Xeon 6780E 2P: Approximate power consumption of 119039 Joules per run.18. EPYC 9754 2P: Approximate power consumption of 123113 Joules per run.19. Xeon Max 9480 2P: Approximate power consumption of 124201 Joules per run.20. Xeon Platinum 8592+ 2P: Approximate power consumption of 126171 Joules per run.21. Xeon Platinum 8490H 2P: Approximate power consumption of 126226 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 145720 Joules per run.

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: ChaCha20-Poly1305EPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8380 2PXeon 6780E 2PXeon 6766E 2PXeon Platinum 8490HXeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon Platinum 8380Xeon 6780EXeon 6766E200000M400000M600000M800000M1000000MSE +/- 19082587.00, N = 3SE +/- 558033954.71, N = 3SE +/- 6119305.11, N = 3SE +/- 151303743.70, N = 3SE +/- 82161991.11, N = 3SE +/- 132227134.30, N = 3SE +/- 4478378.70, N = 3SE +/- 36941390.18, N = 3SE +/- 29295317.86, N = 3SE +/- 4148679.28, N = 3SE +/- 31274617.76, N = 3SE +/- 38565703.74, N = 3SE +/- 37182497.08, N = 3SE +/- 766713911.50, N = 3SE +/- 120899798.30, N = 3SE +/- 24234601.89, N = 3SE +/- 65233629.47, N = 3SE +/- 37795783.50, N = 3SE +/- 6370607.14, N = 3SE +/- 255765711.98, N = 3SE +/- 18243420.30, N = 3SE +/- 2360978.39, N = 39060286089907676527195476989258222234570397488704440991442704422025329773839256520773727352152973509609983573203967204472935021224132665838578872400051351532250388507302236257380132111856617271933050936431877961744401613210582131461562129501340330390901205917872571. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenBenchmarking.orgbyte/s Per Watt, More Is BetterOpenSSL 3.3Algorithm: ChaCha20-Poly1305EPYC 8534PNEPYC 8534PEPYC 9754EPYC 9754 2PEPYC 9654EPYC 9654 2PEPYC 9684X 2PEPYC 9684XXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9480 2PXeon 6766EXeon Max 9468Xeon Platinum 8380 2PXeon Platinum 8380Xeon Max 9468 2PXeon 6766E 2PXeon 6780EXeon 6780E 2P300M600M900M1200M1500M1388893901.101287300050.021269363721.241244610923.331061980440.861039886433.31957228032.13957073830.82666607882.23658820863.84648595124.99644676877.17603664493.39574875604.57569925760.92568545794.25554436256.62552257367.63542055990.77536427227.19483646931.54471667041.65
OpenBenchmarking.orgWatts, Fewer Is BetterOpenSSL 3.3CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon 6780EXeon Max 9468Xeon Max 9480EPYC 9654Xeon Platinum 8490HXeon Platinum 8592+EPYC 9754EPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9684X 2P140280420560700Min: 14.85 / Avg: 139.18 / Max: 148.57Min: 16.74 / Avg: 164.05 / Max: 171.53Min: 43.7 / Avg: 211.59 / Max: 250.8Min: 54.07 / Avg: 264.65 / Max: 291.12Min: 43.58 / Avg: 277.13 / Max: 331.03Min: 74.91 / Avg: 283.74 / Max: 304.03Min: 71.53 / Avg: 311.09 / Max: 362.15Min: 27.82 / Avg: 330.48 / Max: 353.86Min: 58.01 / Avg: 337.59 / Max: 352.56Min: 21.83 / Avg: 339.43 / Max: 376.89Min: 21.97 / Avg: 360.05 / Max: 375.06Min: 35.8 / Avg: 401.15 / Max: 411.05Min: 107.32 / Avg: 447.17 / Max: 525.92Min: 104.8 / Avg: 529.37 / Max: 582.49Min: 109.07 / Avg: 565.2 / Max: 671.32Min: 186.72 / Avg: 591.08 / Max: 630.87Min: 193.92 / Avg: 648.38 / Max: 695.92Min: 54.76 / Avg: 672.12 / Max: 721.51Min: 79.72 / Avg: 684.71 / Max: 754.83Min: 163.33 / Avg: 685.93 / Max: 736.16Min: 41.79 / Avg: 727.96 / Max: 758.79Min: 68.91 / Avg: 801.95 / Max: 822.131. EPYC 8534PN: Approximate power consumption of 25563 Joules per run.2. EPYC 8534P: Approximate power consumption of 30131 Joules per run.3. Xeon 6766E: Approximate power consumption of 39003 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 48696 Joules per run.5. Xeon 6780E: Approximate power consumption of 50992 Joules per run.6. Xeon Max 9468: Approximate power consumption of 52209 Joules per run.7. Xeon Max 9480: Approximate power consumption of 57241 Joules per run.8. EPYC 9654: Approximate power consumption of 60588 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 62116 Joules per run.10. Xeon Platinum 8592+: Approximate power consumption of 62456 Joules per run.11. EPYC 9754: Approximate power consumption of 65890 Joules per run.12. EPYC 9684X: Approximate power consumption of 73410 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 82279 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 97228 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 103807 Joules per run.16. Xeon Max 9468 2P: Approximate power consumption of 108364 Joules per run.17. Xeon Max 9480 2P: Approximate power consumption of 119085 Joules per run.18. EPYC 9654 2P: Approximate power consumption of 122325 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 125758 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 126211 Joules per run.21. EPYC 9754 2P: Approximate power consumption of 132489 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 145956 Joules per run.

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 512 - Model: ResNet-50Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8380Xeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8380 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNXeon 6780EEPYC 9754Xeon 6766EEPYC 9684X 2PEPYC 9654 2PXeon 6780E 2PXeon 6766E 2PEPYC 9754 2P1428425670SE +/- 0.19, N = 3SE +/- 0.12, N = 3SE +/- 0.43, N = 15SE +/- 0.72, N = 3SE +/- 0.17, N = 3SE +/- 0.26, N = 3SE +/- 0.30, N = 15SE +/- 0.34, N = 15SE +/- 0.21, N = 3SE +/- 0.38, N = 15SE +/- 0.19, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.24, N = 3SE +/- 0.29, N = 12SE +/- 0.23, N = 3SE +/- 0.13, N = 9SE +/- 0.03, N = 3SE +/- 0.22, N = 1263.3056.4451.8651.0548.9941.6540.8337.8437.5537.4534.6934.6533.7633.1830.8727.5326.9116.8216.2415.9714.8113.76
OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 512 - Model: ResNet-50EPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon Platinum 8380Xeon Platinum 8490HXeon 6780EXeon 6766EXeon Max 9468Xeon Max 9480EPYC 9654EPYC 9754EPYC 9684XXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9754 2PXeon 6780E 2PXeon 6766E 2PEPYC 9654 2PEPYC 9684X 2P0.07470.14940.22410.29880.37350.3320.3050.2580.2360.2250.1940.1940.1920.1880.1780.1750.1490.1140.0800.0770.0730.0660.0460.0450.0450.0440.040
OpenBenchmarking.orgWatts, Fewer Is BetterPyTorch 2.2.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EEPYC 9654Xeon Platinum 8380EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9754 2PXeon Platinum 8380 2PXeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2P110220330440550Min: 17.13 / Avg: 99.8 / Max: 111.33Min: 18.44 / Avg: 110.66 / Max: 125.07Min: 43.57 / Avg: 138.61 / Max: 153.19Min: 21.06 / Avg: 157.61 / Max: 175.55Min: 43.48 / Avg: 159.18 / Max: 178.15Min: 30.14 / Avg: 194.55 / Max: 219.58Min: 56.55 / Avg: 207.89 / Max: 238.03Min: 35.86 / Avg: 232.68 / Max: 261.18Min: 34.92 / Avg: 245.26 / Max: 293.93Min: 59.74 / Avg: 250.75 / Max: 298.2Min: 74.44 / Avg: 265.6 / Max: 309.82Min: 70.81 / Avg: 276.02 / Max: 323.04Min: 39.07 / Avg: 298.03 / Max: 341.96Min: 98.32 / Avg: 327.4 / Max: 419.31Min: 105.19 / Avg: 327.79 / Max: 351.26Min: 108.16 / Avg: 354.05 / Max: 391.41Min: 58.93 / Avg: 369.53 / Max: 409.87Min: 63.73 / Avg: 418.64 / Max: 475.03Min: 161.18 / Avg: 490.32 / Max: 568.06Min: 79.08 / Avg: 511.14 / Max: 575.41Min: 202.76 / Avg: 570.95 / Max: 625.38Min: 176.16 / Avg: 577.13 / Max: 637.061. EPYC 8534PN: Approximate power consumption of 6753 Joules per run.2. EPYC 8534P: Approximate power consumption of 7451 Joules per run.3. Xeon 6766E: Approximate power consumption of 11644 Joules per run.4. EPYC 9754: Approximate power consumption of 13082 Joules per run.5. Xeon 6780E: Approximate power consumption of 11832 Joules per run.6. EPYC 9654: Approximate power consumption of 12970 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 10048 Joules per run.8. EPYC 9684X: Approximate power consumption of 15357 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 9647 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 12203 Joules per run.11. Xeon Max 9468: Approximate power consumption of 14785 Joules per run.12. Xeon Max 9480: Approximate power consumption of 15936 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 48429 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 20582 Joules per run.15. Xeon 6766E 2P: Approximate power consumption of 49933 Joules per run.16. Xeon 6780E 2P: Approximate power consumption of 59362 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 49640 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 54737 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 33832 Joules per run.20. Xeon Platinum 8592+ 2P: Approximate power consumption of 30396 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 33115 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 41553 Joules per run.

LuxCoreRender

LuxCoreRender is an open-source 3D physically based renderer formerly known as LuxRender. LuxCoreRender supports CPU-based rendering as well as GPU acceleration via OpenCL, NVIDIA CUDA, and NVIDIA OptiX interfaces. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: LuxCore Benchmark - Acceleration: CPUEPYC 9684XEPYC 9754EPYC 9654EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon 6780EXeon Platinum 8592+Xeon 6766EXeon Max 9480 2PEPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468 2PXeon 6780E 2PXeon Platinum 8380 2PXeon 6766E 2PXeon Max 9468Xeon Platinum 83803691215SE +/- 0.04, N = 3SE +/- 0.16, N = 3SE +/- 0.10, N = 7SE +/- 0.12, N = 15SE +/- 0.11, N = 15SE +/- 0.08, N = 15SE +/- 0.17, N = 12SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.06, N = 3SE +/- 0.16, N = 15SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.22, N = 12SE +/- 0.08, N = 15SE +/- 0.07, N = 15SE +/- 0.10, N = 15SE +/- 0.03, N = 3SE +/- 0.06, N = 1512.4312.4111.3410.6110.569.658.888.828.478.067.907.417.387.106.936.826.816.746.436.416.304.29
OpenBenchmarking.orgM samples/sec Per Watt, More Is BetterLuxCoreRender 2.6Scene: LuxCore Benchmark - Acceleration: CPUEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754EPYC 9654Xeon 6780EEPYC 9684XXeon Platinum 8592+Xeon 6766E 2PXeon Platinum 8490HEPYC 9754 2PXeon Max 9480Xeon 6780E 2PEPYC 9654 2PXeon Max 9468EPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9468 2P0.01190.02380.03570.04760.05950.0530.0490.0460.0430.0400.0390.0340.0250.0220.0220.0210.0210.0200.0200.0190.0170.0170.0140.0140.0130.0110.010
OpenBenchmarking.orgWatts, Fewer Is BetterLuxCoreRender 2.6CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Platinum 8380EPYC 9654EPYC 9754Xeon 6766E 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon 6780E 2PEPYC 9684XEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P130260390520650Min: 17.5 / Avg: 131.25 / Max: 148.58Min: 18.49 / Avg: 149.9 / Max: 169.31Min: 43.63 / Avg: 172.93 / Max: 201.7Min: 43.54 / Avg: 215.89 / Max: 253.56Min: 52.8 / Avg: 250 / Max: 286.38Min: 28.93 / Avg: 284.2 / Max: 318.53Min: 23.22 / Avg: 288.11 / Max: 334.63Min: 104.76 / Avg: 297.7 / Max: 400.24Min: 34.18 / Avg: 318.84 / Max: 374.24Min: 62.21 / Avg: 319.52 / Max: 375.32Min: 74.54 / Avg: 324.24 / Max: 366.89Min: 85.32 / Avg: 325.06 / Max: 364.85Min: 107.86 / Avg: 344.5 / Max: 460.96Min: 34.2 / Avg: 365.21 / Max: 410.93Min: 40.41 / Avg: 450.3 / Max: 521.1Min: 101 / Avg: 492.26 / Max: 580.68Min: 58.25 / Avg: 537.06 / Max: 610.46Min: 38.08 / Avg: 620.51 / Max: 723.33Min: 83.65 / Avg: 634.64 / Max: 754.69Min: 178.58 / Avg: 636.83 / Max: 753.39Min: 129.79 / Avg: 649.71 / Max: 752.19Min: 205.6 / Avg: 650.43 / Max: 750.561. EPYC 8534PN: Approximate power consumption of 8707 Joules per run.2. EPYC 8534P: Approximate power consumption of 9943 Joules per run.3. Xeon 6766E: Approximate power consumption of 11529 Joules per run.4. Xeon 6780E: Approximate power consumption of 14537 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 16517 Joules per run.6. EPYC 9654: Approximate power consumption of 18879 Joules per run.7. EPYC 9754: Approximate power consumption of 18823 Joules per run.8. Xeon 6766E 2P: Approximate power consumption of 20085 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 21256 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 21301 Joules per run.11. Xeon Max 9468: Approximate power consumption of 21508 Joules per run.12. Xeon Max 9480: Approximate power consumption of 21562 Joules per run.13. Xeon 6780E 2P: Approximate power consumption of 23196 Joules per run.14. EPYC 9684X: Approximate power consumption of 23739 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 30020 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 32653 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 35804 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 41285 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 42151 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 42668 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 43227 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 43200 Joules per run.

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 1 - Model: ResNet-152Xeon Platinum 8592+Xeon Platinum 8380Xeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Max 9468 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654EPYC 8534PEPYC 8534PNXeon Max 9480 2PXeon 6780EXeon 6766EEPYC 9754EPYC 9684X 2PEPYC 9654 2PXeon 6780E 2PEPYC 9754 2PXeon 6766E 2P612182430SE +/- 0.08, N = 3SE +/- 0.12, N = 3SE +/- 0.26, N = 3SE +/- 0.09, N = 3SE +/- 0.16, N = 3SE +/- 0.18, N = 3SE +/- 0.19, N = 5SE +/- 0.10, N = 3SE +/- 0.01, N = 3SE +/- 0.16, N = 4SE +/- 0.09, N = 3SE +/- 0.17, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 8SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.20, N = 12SE +/- 0.27, N = 9SE +/- 0.07, N = 3SE +/- 0.15, N = 12SE +/- 0.17, N = 927.2122.2719.9919.4118.0717.9117.5716.6815.8615.7715.5715.2515.1114.8614.5313.3913.058.358.277.106.646.47
OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 1 - Model: ResNet-152EPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon Platinum 8380Xeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8490HXeon Max 9468EPYC 9684XXeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9754 2PEPYC 9654 2PXeon 6780E 2PXeon 6766E 2PEPYC 9684X 2P0.03510.07020.10530.14040.17550.1560.1460.1130.1110.0960.0920.0840.0810.0800.0760.0690.0670.0560.0340.0330.0310.0260.0220.0220.0200.0200.020
OpenBenchmarking.orgWatts, Fewer Is BetterPyTorch 2.2.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EEPYC 9654Xeon Platinum 8380EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PEPYC 9754 2PXeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2P110220330440550Min: 16.2 / Avg: 97.09 / Max: 104.85Min: 16.21 / Avg: 104.37 / Max: 113.9Min: 43.54 / Avg: 139.02 / Max: 150.49Min: 19.56 / Avg: 155.97 / Max: 167.94Min: 43.41 / Avg: 158.21 / Max: 172.64Min: 27.2 / Avg: 192.05 / Max: 207.21Min: 55.11 / Avg: 200.49 / Max: 223.6Min: 30.38 / Avg: 228.52 / Max: 247.96Min: 33.7 / Avg: 239.78 / Max: 273.27Min: 58.34 / Avg: 242.81 / Max: 264.97Min: 73.95 / Avg: 262.34 / Max: 291.94Min: 73.16 / Avg: 270.76 / Max: 301.09Min: 102.12 / Avg: 295.35 / Max: 320.3Min: 20.22 / Avg: 296.81 / Max: 327.42Min: 54.23 / Avg: 317.38 / Max: 347.71Min: 107.67 / Avg: 362.4 / Max: 382.35Min: 55.84 / Avg: 369.03 / Max: 409.77Min: 61.36 / Avg: 418.43 / Max: 475.94Min: 162.11 / Avg: 476.49 / Max: 563.05Min: 79.16 / Avg: 511.35 / Max: 559.55Min: 196.88 / Avg: 571.95 / Max: 613.16Min: 196.56 / Avg: 578.74 / Max: 617.411. EPYC 8534PN: Approximate power consumption of 7929 Joules per run.2. EPYC 8534P: Approximate power consumption of 8454 Joules per run.3. Xeon 6766E: Approximate power consumption of 12789 Joules per run.4. EPYC 9754: Approximate power consumption of 14454 Joules per run.5. Xeon 6780E: Approximate power consumption of 13448 Joules per run.6. EPYC 9654: Approximate power consumption of 15044 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 11628 Joules per run.8. EPYC 9684X: Approximate power consumption of 17596 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 11669 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 15864 Joules per run.11. Xeon Max 9468: Approximate power consumption of 17227 Joules per run.12. Xeon Max 9480: Approximate power consumption of 21571 Joules per run.13. Xeon Platinum 8380 2P: Approximate power consumption of 22053 Joules per run.14. EPYC 9754 2P: Approximate power consumption of 52041 Joules per run.15. Xeon 6766E 2P: Approximate power consumption of 58927 Joules per run.16. Xeon 6780E 2P: Approximate power consumption of 61125 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 52443 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 58789 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 37524 Joules per run.20. Xeon Platinum 8592+ 2P: Approximate power consumption of 37226 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 40608 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 49193 Joules per run.

Xmrig

Xmrig is an open-source cross-platform CPU/GPU miner for RandomX, KawPow, CryptoNight and AstroBWT. This test profile is setup to measure the Xmrig CPU mining performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: GhostRider - Hash Count: 1MEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Max 9480 2PXeon Platinum 8490H 2PXeon 6780E 2PXeon Max 9468 2PXeon 6766E 2PEPYC 9754Xeon Platinum 8592+Xeon Max 9480Xeon Platinum 8490HXeon 6780EXeon Max 9468Xeon 6766EXeon Platinum 8380 2PEPYC 8534PEPYC 8534PNXeon Platinum 83807K14K21K28K35KSE +/- 95.10, N = 3SE +/- 290.50, N = 3SE +/- 46.94, N = 3SE +/- 64.69, N = 3SE +/- 10.36, N = 3SE +/- 117.32, N = 3SE +/- 7.44, N = 3SE +/- 4.03, N = 3SE +/- 43.14, N = 3SE +/- 14.02, N = 3SE +/- 53.95, N = 3SE +/- 61.27, N = 3SE +/- 44.68, N = 3SE +/- 14.78, N = 3SE +/- 23.16, N = 3SE +/- 43.00, N = 3SE +/- 12.93, N = 3SE +/- 19.74, N = 3SE +/- 49.14, N = 12SE +/- 30.53, N = 3SE +/- 41.94, N = 3SE +/- 32.20, N = 231157.826702.717873.116324.715786.614207.712115.011263.211147.210975.810431.69320.58378.36122.35808.85753.95446.85315.75230.94660.04564.32593.21. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
OpenBenchmarking.orgH/s Per Watt, More Is BetterXmrig 6.21Variant: GhostRider - Hash Count: 1MEPYC 9654EPYC 9654 2PEPYC 9684X 2PEPYC 9684XEPYC 9754EPYC 8534PNEPYC 9754 2PEPYC 8534PXeon 6766EXeon 6780EXeon 6766E 2PXeon 6780E 2PXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Max 9480 2PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Platinum 8380 2PXeon Platinum 8380112233445546.68845.05144.08242.00440.16636.23636.16833.46630.62129.19028.50427.67625.29125.01518.00217.92917.11416.82816.63616.29310.1839.798
OpenBenchmarking.orgWatts, Fewer Is BetterXmrig 6.21CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754Xeon Platinum 8380EPYC 9654Xeon Max 9468Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon 6766E 2PEPYC 9684XXeon 6780E 2PEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2P140280420560700Min: 15.67 / Avg: 125.96 / Max: 131.33Min: 17.62 / Avg: 139.24 / Max: 143.75Min: 43.68 / Avg: 173.6 / Max: 178.87Min: 43.43 / Avg: 197.12 / Max: 203.16Min: 21.91 / Avg: 232.05 / Max: 250.74Min: 53.3 / Avg: 264.66 / Max: 271.14Min: 30.21 / Avg: 304.31 / Max: 328.13Min: 73.18 / Avg: 327.41 / Max: 335.76Min: 24.38 / Avg: 334.94 / Max: 357.54Min: 55.89 / Avg: 339.42 / Max: 349.66Min: 75.82 / Avg: 341.47 / Max: 356.09Min: 103.58 / Avg: 365.97 / Max: 390.52Min: 36 / Avg: 375.84 / Max: 410.13Min: 104.75 / Avg: 402.77 / Max: 425.84Min: 38.53 / Avg: 494.18 / Max: 551.71Min: 95.12 / Avg: 513.7 / Max: 535.43Min: 54.62 / Avg: 592.72 / Max: 673.62Min: 73.19 / Avg: 645.48 / Max: 743.36Min: 159.48 / Avg: 669.3 / Max: 730.91Min: 188.92 / Avg: 672.99 / Max: 738.06Min: 201.16 / Avg: 673.63 / Max: 702.68Min: 60.4 / Avg: 706.81 / Max: 819.971. EPYC 8534PN: Approximate power consumption of 28131 Joules per run.2. EPYC 8534P: Approximate power consumption of 30495 Joules per run.3. Xeon 6766E: Approximate power consumption of 33620 Joules per run.4. Xeon 6780E: Approximate power consumption of 35218 Joules per run.5. EPYC 9754: Approximate power consumption of 25990 Joules per run.6. Xeon Platinum 8380: Approximate power consumption of 252352 Joules per run.7. EPYC 9654: Approximate power consumption of 22925 Joules per run.8. Xeon Max 9468: Approximate power consumption of 61772 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 55934 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 60191 Joules per run.11. Xeon Max 9480: Approximate power consumption of 57366 Joules per run.12. Xeon 6766E 2P: Approximate power consumption of 37085 Joules per run.13. EPYC 9684X: Approximate power consumption of 25933 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 38398 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 30145 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 100685 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 25289 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 43893 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 62691 Joules per run.20. Xeon Max 9480 2P: Approximate power consumption of 58774 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 64220 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 26388 Joules per run.

LuxCoreRender

LuxCoreRender is an open-source 3D physically based renderer formerly known as LuxRender. LuxCoreRender supports CPU-based rendering as well as GPU acceleration via OpenCL, NVIDIA CUDA, and NVIDIA OptiX interfaces. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: Orange Juice - Acceleration: CPUEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon 6780E 2PXeon Max 9468 2PXeon 6766E 2PXeon Max 9480 2PXeon 6766EXeon 6780EXeon Platinum 8592+Xeon Platinum 8380 2PEPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon Platinum 8380816243240SE +/- 1.06, N = 15SE +/- 1.12, N = 15SE +/- 0.84, N = 15SE +/- 0.28, N = 5SE +/- 0.07, N = 3SE +/- 0.18, N = 15SE +/- 0.30, N = 15SE +/- 0.12, N = 3SE +/- 0.46, N = 15SE +/- 0.16, N = 15SE +/- 0.46, N = 12SE +/- 0.28, N = 15SE +/- 0.19, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.03, N = 333.0832.2629.6124.6923.7621.3219.9118.7017.4516.9116.8816.6415.9015.8314.7414.3113.8113.4613.0012.5011.868.82
OpenBenchmarking.orgM samples/sec Per Watt, More Is BetterLuxCoreRender 2.6Scene: Orange Juice - Acceleration: CPUEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754EPYC 9654Xeon 6780EEPYC 9684XEPYC 9754 2PXeon 6766E 2PEPYC 9654 2PXeon 6780E 2PEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8380Xeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P0.02270.04540.06810.09080.11350.1010.0920.0830.0800.0720.0710.0660.0590.0530.0510.0480.0460.0460.0420.0380.0360.0350.0310.0290.0290.0260.025
OpenBenchmarking.orgWatts, Fewer Is BetterLuxCoreRender 2.6CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Platinum 8380EPYC 9654EPYC 9754Xeon Platinum 8592+Xeon 6766E 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon 6780E 2PEPYC 9684XXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P150300450600750Min: 17.62 / Avg: 128.09 / Max: 142.09Min: 19.16 / Avg: 150.1 / Max: 167.85Min: 43.68 / Avg: 191.46 / Max: 222.84Min: 43.49 / Avg: 223.98 / Max: 283.31Min: 53 / Avg: 249.69 / Max: 290.48Min: 27.54 / Avg: 296.6 / Max: 330.72Min: 22.04 / Avg: 298.61 / Max: 336.88Min: 34.75 / Avg: 320.73 / Max: 377.48Min: 104.86 / Avg: 321.3 / Max: 495.12Min: 61.77 / Avg: 323.08 / Max: 377.72Min: 75.77 / Avg: 326.79 / Max: 375.2Min: 83.75 / Avg: 327.46 / Max: 377.5Min: 107.87 / Avg: 364.17 / Max: 576.89Min: 33.09 / Avg: 373.72 / Max: 411.13Min: 100.16 / Avg: 499.14 / Max: 582.6Min: 41.55 / Avg: 551.09 / Max: 677.8Min: 57.15 / Avg: 586.21 / Max: 670.16Min: 82.44 / Avg: 639.12 / Max: 751.58Min: 172.79 / Avg: 646.27 / Max: 748.56Min: 204.79 / Avg: 656.04 / Max: 751.44Min: 201.92 / Avg: 656.25 / Max: 748.81Min: 66.69 / Avg: 722.97 / Max: 825.831. EPYC 8534PN: Approximate power consumption of 8753 Joules per run.2. EPYC 8534P: Approximate power consumption of 10207 Joules per run.3. Xeon 6766E: Approximate power consumption of 13211 Joules per run.4. Xeon 6780E: Approximate power consumption of 15380 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 16979 Joules per run.6. EPYC 9654: Approximate power consumption of 20030 Joules per run.7. EPYC 9754: Approximate power consumption of 20306 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 21810 Joules per run.9. Xeon 6766E 2P: Approximate power consumption of 22518 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 21970 Joules per run.11. Xeon Max 9468: Approximate power consumption of 22113 Joules per run.12. Xeon Max 9480: Approximate power consumption of 22158 Joules per run.13. Xeon 6780E 2P: Approximate power consumption of 25346 Joules per run.14. EPYC 9684X: Approximate power consumption of 25189 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 34108 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 37364 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 39745 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 43332 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 44593 Joules per run.20. Xeon Max 9468 2P: Approximate power consumption of 44786 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 44800 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 48921 Joules per run.

OSPRay

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/scivis/real_timeEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon 6780E 2PEPYC 9754Xeon Max 9480 2PXeon 6766E 2PEPYC 9684XXeon Platinum 8592+Xeon Max 9468 2PEPYC 9654Xeon Platinum 8490HXeon 6780EXeon 6766EXeon Max 9480EPYC 8534PXeon Platinum 8380 2PEPYC 8534PNXeon Max 9468Xeon Platinum 83801326395265SE +/- 0.01106, N = 3SE +/- 0.01792, N = 3SE +/- 0.04682, N = 3SE +/- 0.04960, N = 3SE +/- 0.02499, N = 3SE +/- 0.02131, N = 3SE +/- 0.02252, N = 3SE +/- 0.04134, N = 3SE +/- 0.04097, N = 3SE +/- 0.01858, N = 3SE +/- 0.04057, N = 3SE +/- 0.05872, N = 3SE +/- 0.01265, N = 3SE +/- 0.00525, N = 3SE +/- 0.01460, N = 3SE +/- 0.00610, N = 3SE +/- 0.03593, N = 3SE +/- 0.01395, N = 3SE +/- 0.03711, N = 3SE +/- 0.00583, N = 3SE +/- 0.00932, N = 3SE +/- 0.00909, N = 356.4485055.2576053.9348047.5267038.2269036.2464035.1464033.1275032.7979032.5232030.6799029.3496028.0689021.8932021.5147019.4251018.4851017.9448017.6222016.4505016.086909.70022
OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 3.1Benchmark: particle_volume/scivis/real_timeEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EEPYC 9754 2PEPYC 9654Xeon 6766E 2PXeon Platinum 8592+EPYC 9684XXeon 6780E 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380Xeon Platinum 8380 2P0.03260.06520.09780.13040.1630.1450.1390.1360.1330.1210.1070.1070.1060.1060.0980.0940.0910.0860.0810.0740.0630.0610.0610.0530.0470.0410.039
OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 3.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Platinum 8380Xeon Max 9468EPYC 9654EPYC 9754Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon 6766E 2PEPYC 9684XXeon 6780E 2PXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P140280420560700Min: 16.2 / Avg: 113.27 / Max: 134.96Min: 18.42 / Avg: 129.01 / Max: 155.58Min: 43.64 / Avg: 142.92 / Max: 193.36Min: 43.6 / Avg: 178.41 / Max: 247.31Min: 52.66 / Avg: 239.04 / Max: 286.42Min: 74.87 / Avg: 255.3 / Max: 321.66Min: 28.04 / Avg: 261.28 / Max: 302.78Min: 22.25 / Avg: 264.01 / Max: 319.18Min: 25.32 / Avg: 288.49 / Max: 368.86Min: 59.59 / Avg: 296.81 / Max: 366.58Min: 76.7 / Avg: 301.86 / Max: 366.25Min: 105.71 / Avg: 310.52 / Max: 393.05Min: 35.05 / Avg: 332.91 / Max: 399.84Min: 108.67 / Avg: 386.65 / Max: 484.75Min: 95.5 / Avg: 453.46 / Max: 555.04Min: 42.57 / Avg: 526.9 / Max: 623.56Min: 60.52 / Avg: 553.25 / Max: 625.16Min: 67.98 / Avg: 591.05 / Max: 725.39Min: 168.54 / Avg: 625.45 / Max: 728.13Min: 191.04 / Avg: 627.62 / Max: 711.24Min: 200.54 / Avg: 630.06 / Max: 725.99Min: 67.89 / Avg: 682.63 / Max: 796.51. EPYC 8534PN: Approximate power consumption of 16915 Joules per run.2. EPYC 8534P: Approximate power consumption of 19093 Joules per run.3. Xeon 6766E: Approximate power consumption of 21534 Joules per run.4. Xeon 6780E: Approximate power consumption of 26642 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 38087 Joules per run.6. Xeon Max 9468: Approximate power consumption of 38295 Joules per run.7. EPYC 9654: Approximate power consumption of 45026 Joules per run.8. EPYC 9754: Approximate power consumption of 51481 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 48947 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 43532 Joules per run.11. Xeon Max 9480: Approximate power consumption of 44876 Joules per run.12. Xeon 6766E 2P: Approximate power consumption of 54134 Joules per run.13. EPYC 9684X: Approximate power consumption of 55707 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 76300 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 68321 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 90802 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 98478 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 102843 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 119670 Joules per run.20. Xeon Max 9468 2P: Approximate power consumption of 108998 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 106690 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 116729 Joules per run.

RocksDB

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Read While WritingXeon 6780E 2PXeon 6766E 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon 6780EXeon 6766EXeon Max 9480 2PXeon Platinum 8380 2PXeon Max 9468 2PEPYC 8534PEPYC 8534PNXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 83806M12M18M24M30MSE +/- 726178.20, N = 12SE +/- 426084.70, N = 15SE +/- 273109.47, N = 3SE +/- 506458.47, N = 15SE +/- 236709.61, N = 3SE +/- 109424.14, N = 3SE +/- 36524.26, N = 3SE +/- 93669.97, N = 15SE +/- 215352.04, N = 15SE +/- 343737.14, N = 15SE +/- 136761.19, N = 4SE +/- 45015.86, N = 3SE +/- 254193.37, N = 15SE +/- 113154.86, N = 4SE +/- 218479.19, N = 15SE +/- 28098.62, N = 3SE +/- 81998.56, N = 3SE +/- 28201.44, N = 3SE +/- 61518.27, N = 10SE +/- 83772.27, N = 13SE +/- 26369.56, N = 3SE +/- 23120.76, N = 3270597862446614322900152201082891985166415776186146085441415841912425519123213001186481511340389112233299836689962441793336458934176892689378417387439663736650055398701. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s Per Watt, More Is BetterRocksDB 9.0Test: Read While WritingXeon 6766E 2PXeon 6780E 2PEPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EEPYC 9754EPYC 9654EPYC 9754 2PEPYC 9684XEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Platinum 8592+ 2PXeon Max 9480Xeon Platinum 8380Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P15K30K45K60K75K69851.7567516.2966672.7063183.0360067.2156900.6252342.4648605.6945330.1836906.8334889.6529572.8927560.2823723.7622369.2622256.9522200.6221648.9919253.5218781.2716920.4614775.49
OpenBenchmarking.orgWatts, Fewer Is BetterRocksDB 9.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Platinum 8380EPYC 9654EPYC 9754Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon 6766E 2PEPYC 9684XXeon 6780E 2PEPYC 9754 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9684X 2P140280420560700Min: 17.36 / Avg: 134 / Max: 149.2Min: 17.34 / Avg: 155.39 / Max: 168.8Min: 43.66 / Avg: 179.48 / Max: 270.38Min: 43.57 / Avg: 208.52 / Max: 356.32Min: 55.14 / Avg: 255.9 / Max: 290.56Min: 24.6 / Avg: 300.55 / Max: 337.2Min: 22 / Avg: 301.4 / Max: 339.84Min: 33.11 / Avg: 323.9 / Max: 378.14Min: 52.65 / Avg: 330.54 / Max: 376.66Min: 74.89 / Avg: 331.82 / Max: 375.82Min: 72.31 / Avg: 332.58 / Max: 376.04Min: 107.56 / Avg: 350.26 / Max: 540.44Min: 34.3 / Avg: 383.63 / Max: 411.02Min: 108.91 / Avg: 400.79 / Max: 709.44Min: 43.23 / Avg: 505.19 / Max: 682.09Min: 98.57 / Avg: 510.9 / Max: 583.45Min: 67.94 / Avg: 558.28 / Max: 752.93Min: 56.63 / Avg: 576.34 / Max: 690.47Min: 200.41 / Avg: 651.38 / Max: 755.47Min: 157.04 / Avg: 656.04 / Max: 755.91Min: 185.7 / Avg: 663.3 / Max: 752.58Min: 67.1 / Avg: 671.28 / Max: 820.111. EPYC 8534PN: Approximate power consumption of 8621 Joules per run.2. EPYC 8534P: Approximate power consumption of 9997 Joules per run.3. Xeon 6766E: Approximate power consumption of 11487 Joules per run.4. Xeon 6780E: Approximate power consumption of 13397 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 16463 Joules per run.6. EPYC 9654: Approximate power consumption of 19235 Joules per run.7. EPYC 9754: Approximate power consumption of 19390 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 20838 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 21188 Joules per run.10. Xeon Max 9480: Approximate power consumption of 21347 Joules per run.11. Xeon Max 9468: Approximate power consumption of 21285 Joules per run.12. Xeon 6766E 2P: Approximate power consumption of 22463 Joules per run.13. EPYC 9684X: Approximate power consumption of 24450 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 25717 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 32163 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 32826 Joules per run.17. Xeon Platinum 8592+ 2P: Approximate power consumption of 35767 Joules per run.18. EPYC 9654 2P: Approximate power consumption of 36694 Joules per run.19. Xeon Max 9468 2P: Approximate power consumption of 41688 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 42030 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 42407 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 42738 Joules per run.

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardEPYC 9684XEPYC 9684X 2PEPYC 9654EPYC 9654 2PEPYC 9754EPYC 8534PNEPYC 9754 2PEPYC 8534PXeon Platinum 8380Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Max 9468Xeon Max 9480Xeon Max 9480 2PXeon Max 9468 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P1122334455SE +/- 0.61, N = 15SE +/- 0.40, N = 15SE +/- 0.50, N = 15SE +/- 0.61, N = 15SE +/- 0.45, N = 15SE +/- 0.61, N = 15SE +/- 0.23, N = 15SE +/- 0.63, N = 15SE +/- 0.01, N = 3SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.35, N = 3SE +/- 0.11, N = 3SE +/- 0.31, N = 3SE +/- 0.33, N = 3SE +/- 0.40, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.35, N = 3SE +/- 0.36, N = 1121.5822.7923.9225.3226.4526.8327.9027.9328.0228.8529.0229.4129.7529.7633.3333.9936.0036.2336.7841.0843.8147.201. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8380Xeon 6766E 2PXeon 6780E 2PEPYC 9684XEPYC 9754 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2P90180270360450Min: 16.01 / Avg: 98.3 / Max: 106.86Min: 18.14 / Avg: 109.41 / Max: 118.96Min: 43.64 / Avg: 132.23 / Max: 144.22Min: 43.52 / Avg: 154.49 / Max: 168.64Min: 19.69 / Avg: 171.56 / Max: 188.27Min: 26.28 / Avg: 211.37 / Max: 231.46Min: 53.43 / Avg: 226.19 / Max: 247.32Min: 104.4 / Avg: 226.53 / Max: 245.57Min: 106.43 / Avg: 248.46 / Max: 271.28Min: 31.9 / Avg: 250.92 / Max: 275.39Min: 40.25 / Avg: 308.06 / Max: 331.38Min: 54.43 / Avg: 417.34 / Max: 450.65Min: 103.45 / Avg: 419.57 / Max: 461.32Min: 60.67 / Avg: 475.62 / Max: 514.581. EPYC 8534PN: Approximate power consumption of 6514 Joules per run.2. EPYC 8534P: Approximate power consumption of 7243 Joules per run.3. Xeon 6766E: Approximate power consumption of 8903 Joules per run.4. Xeon 6780E: Approximate power consumption of 10351 Joules per run.5. EPYC 9754: Approximate power consumption of 11346 Joules per run.6. EPYC 9654: Approximate power consumption of 13894 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 15080 Joules per run.8. Xeon 6766E 2P: Approximate power consumption of 15301 Joules per run.9. Xeon 6780E 2P: Approximate power consumption of 16978 Joules per run.10. EPYC 9684X: Approximate power consumption of 16477 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 20373 Joules per run.12. EPYC 9654 2P: Approximate power consumption of 27349 Joules per run.13. Xeon Platinum 8380 2P: Approximate power consumption of 27831 Joules per run.14. EPYC 9684X 2P: Approximate power consumption of 31169 Joules per run.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardEPYC 9684XEPYC 9684X 2PEPYC 9654EPYC 9654 2PEPYC 9754EPYC 8534PNEPYC 8534PEPYC 9754 2PXeon Platinum 8380Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Max 9468Xeon Max 9480Xeon Max 9480 2PXeon Max 9468 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P1122334455SE +/- 1.36, N = 15SE +/- 0.76, N = 15SE +/- 0.91, N = 15SE +/- 0.92, N = 15SE +/- 0.63, N = 15SE +/- 0.82, N = 15SE +/- 0.87, N = 15SE +/- 0.27, N = 15SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.13, N = 3SE +/- 0.40, N = 3SE +/- 0.09, N = 3SE +/- 0.27, N = 3SE +/- 0.26, N = 3SE +/- 0.31, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.18, N = 3SE +/- 0.16, N = 1146.8844.0642.0739.8037.9637.5336.0835.8735.6934.6634.4634.0033.6133.6030.0029.4327.7827.6127.1824.3422.8321.201. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardEPYC 9684XEPYC 9684X 2PEPYC 9654EPYC 9654 2PEPYC 9754EPYC 8534PNEPYC 9754 2PEPYC 8534PXeon Platinum 8380Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Max 9468Xeon Max 9480Xeon Max 9480 2PXeon Max 9468 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P1122334455SE +/- 0.61, N = 15SE +/- 0.40, N = 15SE +/- 0.50, N = 15SE +/- 0.61, N = 15SE +/- 0.45, N = 15SE +/- 0.61, N = 15SE +/- 0.23, N = 15SE +/- 0.63, N = 15SE +/- 0.01, N = 3SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.35, N = 3SE +/- 0.11, N = 3SE +/- 0.31, N = 3SE +/- 0.33, N = 3SE +/- 0.40, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.35, N = 3SE +/- 0.36, N = 1121.5822.7923.9225.3226.4526.8327.9027.9328.0228.8529.0229.4129.7529.7633.3333.9936.0036.2336.7841.0843.8147.201. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenFOAM

OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9684XXeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 9654Xeon Platinum 8380 2PXeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 9754EPYC 8534PNEPYC 8534PXeon Platinum 8380200400600800100093.57124.30137.04137.11178.25186.33196.50201.11302.06325.42362.59410.29420.65440.83449.47690.74691.64798.351. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
OpenBenchmarking.orgWatts, Fewer Is BetterOpenFOAM 10CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon Platinum 8380EPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9684XXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P140280420560700Min: 18.07 / Avg: 136.84 / Max: 141.45Min: 19.18 / Avg: 151.27 / Max: 160.12Min: 52.75 / Avg: 267.82 / Max: 290.28Min: 20.74 / Avg: 299.74 / Max: 340.28Min: 29.39 / Avg: 315.41 / Max: 351.03Min: 25 / Avg: 342.05 / Max: 374.57Min: 69.16 / Avg: 345.17 / Max: 371.43Min: 87.17 / Avg: 345.66 / Max: 374.97Min: 77.28 / Avg: 345.8 / Max: 369.64Min: 34.52 / Avg: 383.05 / Max: 409.74Min: 108.34 / Avg: 530.36 / Max: 581.07Min: 42.44 / Avg: 608.58 / Max: 684.35Min: 62.13 / Avg: 646.4 / Max: 715.42Min: 81.67 / Avg: 662.55 / Max: 747.87Min: 165.73 / Avg: 677.95 / Max: 749.23Min: 209.08 / Avg: 682.47 / Max: 751.14Min: 216.76 / Avg: 683.58 / Max: 747.25Min: 67.81 / Avg: 754.07 / Max: 819.01

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh TimeEPYC 9684XXeon Max 9468 2PEPYC 9684X 2PEPYC 9654Xeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8592+Xeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8380 2PEPYC 8534PEPYC 9754Xeon Platinum 8380EPYC 8534PNEPYC 9754 2P4080120160200118.54134.78135.52136.40139.62140.48148.40150.67153.12159.31160.73162.03162.32163.70167.41182.24188.37192.421. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

Timed LLVM Compilation

This test times how long it takes to compile/build the LLVM compiler stack. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: NinjaEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XXeon 6780E 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9654Xeon 6766E 2PEPYC 9754Xeon Platinum 8592+Xeon 6780EXeon 6766EXeon Platinum 8490HXeon Platinum 8380 2PXeon Max 9480EPYC 8534PXeon Max 9468EPYC 8534PNXeon Platinum 838060120180240300SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.45, N = 3SE +/- 0.27, N = 3SE +/- 0.15, N = 3SE +/- 0.27, N = 3SE +/- 0.05, N = 3SE +/- 0.79, N = 3SE +/- 0.17, N = 3SE +/- 0.31, N = 3SE +/- 1.52, N = 3SE +/- 0.74, N = 3SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.20, N = 3SE +/- 0.07, N = 3SE +/- 0.37, N = 3SE +/- 0.36, N = 3SE +/- 0.20, N = 3SE +/- 0.19, N = 3SE +/- 0.10, N = 3SE +/- 1.03, N = 389.2894.81101.56106.82122.31124.46125.27128.07134.42135.67138.57146.76165.05169.45184.20187.02194.38197.84205.01212.48215.93298.41
OpenBenchmarking.orgWatts, Fewer Is BetterTimed LLVM Compilation 16.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8380Xeon 6766E 2PXeon 6780E 2PEPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9754 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P140280420560700Min: 15.37 / Avg: 117.14 / Max: 147.36Min: 16.99 / Avg: 134 / Max: 170.95Min: 43.51 / Avg: 148.04 / Max: 239.55Min: 43.38 / Avg: 172.6 / Max: 293.27Min: 21.92 / Avg: 221.05 / Max: 334.41Min: 28.01 / Avg: 241.32 / Max: 332.83Min: 51.36 / Avg: 243.86 / Max: 291.49Min: 104.24 / Avg: 248.44 / Max: 496.75Min: 107.08 / Avg: 281.29 / Max: 590.24Min: 33.31 / Avg: 289.22 / Max: 411.83Min: 33.37 / Avg: 291.41 / Max: 377.45Min: 58.01 / Avg: 298.24 / Max: 377.21Min: 83.29 / Avg: 311.03 / Max: 377.86Min: 74.97 / Avg: 314.74 / Max: 377.51Min: 41.44 / Avg: 382.15 / Max: 678.1Min: 52.7 / Avg: 427.31 / Max: 682.72Min: 106.11 / Avg: 438.51 / Max: 581.89Min: 69.22 / Avg: 491.18 / Max: 825.37Min: 81.57 / Avg: 519.72 / Max: 754.2Min: 162.49 / Avg: 544.93 / Max: 754.95Min: 206.76 / Avg: 582.56 / Max: 754.19Min: 201.26 / Avg: 591.84 / Max: 754.621. EPYC 8534PN: Approximate power consumption of 27645 Joules per run.2. EPYC 8534P: Approximate power consumption of 30194 Joules per run.3. Xeon 6766E: Approximate power consumption of 30298 Joules per run.4. Xeon 6780E: Approximate power consumption of 32679 Joules per run.5. EPYC 9754: Approximate power consumption of 36841 Joules per run.6. EPYC 9654: Approximate power consumption of 37003 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 76573 Joules per run.8. Xeon 6766E 2P: Approximate power consumption of 39998 Joules per run.9. Xeon 6780E 2P: Approximate power consumption of 41162 Joules per run.10. EPYC 9684X: Approximate power consumption of 41069 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 52357 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 60443 Joules per run.13. Xeon Max 9480: Approximate power consumption of 66146 Joules per run.14. Xeon Max 9468: Approximate power consumption of 71550 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 46750 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 48286 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 92234 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 52557 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 63578 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 75745 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 83501 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 88579 Joules per run.

Memcached

Memcached is a high performance, distributed memory object caching system. This Memcached test profiles makes use of memtier_benchmark for excuting this CPU/memory-focused server benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:100EPYC 9684X 2PEPYC 9684XEPYC 9654 2PEPYC 9654EPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon Platinum 8380Xeon Platinum 8380 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P2M4M6M8M10MSE +/- 27143.58, N = 3SE +/- 58081.25, N = 3SE +/- 83562.82, N = 3SE +/- 29027.89, N = 3SE +/- 38372.96, N = 3SE +/- 14591.70, N = 3SE +/- 36366.89, N = 3SE +/- 41123.40, N = 3SE +/- 38410.91, N = 15SE +/- 101903.23, N = 15SE +/- 35182.67, N = 3SE +/- 25335.31, N = 3SE +/- 21428.06, N = 3SE +/- 52575.97, N = 3SE +/- 35300.21, N = 3SE +/- 24083.78, N = 3SE +/- 26891.33, N = 3SE +/- 50660.01, N = 15SE +/- 19998.04, N = 15SE +/- 19070.02, N = 15SE +/- 16926.98, N = 15SE +/- 16910.46, N = 158683410.798634258.398498306.788220895.457736018.747645325.706198256.725820618.184826284.804814941.534752673.794481667.954384040.524315467.173780240.563392842.383373323.923245908.402339570.282299150.511821144.001783869.961. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec Per Watt, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:100EPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654EPYC 9684XXeon 6766EXeon Platinum 8380EPYC 9754 2PXeon 6780EXeon Platinum 8592+EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PXeon 6766E 2PXeon Platinum 8592+ 2PXeon 6780E 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2P11K22K33K44K55K51146.0644935.7432910.9331074.2625824.7321456.1420130.4919415.8818800.3618089.3017990.1415985.0115564.5315062.1314272.3910688.238031.407668.817280.706127.335975.555947.33
OpenBenchmarking.orgWatts, Fewer Is BetterMemcached 1.6.19CPU Power Consumption MonitorXeon 6766EEPYC 8534PNXeon 6780EEPYC 8534PXeon 6766E 2PEPYC 9754Xeon Platinum 8380Xeon 6780E 2PXeon Platinum 8592+EPYC 9654Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9684XEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P110220330440550Min: 43.49 / Avg: 107.16 / Max: 120.67Min: 16.61 / Avg: 113.8 / Max: 137.75Min: 43.41 / Avg: 124.44 / Max: 142.61Min: 19.03 / Avg: 137.94 / Max: 159.73Min: 104.69 / Avg: 222.11 / Max: 257.75Min: 21.61 / Avg: 235.06 / Max: 274.9Min: 53.19 / Avg: 239.75 / Max: 291.89Min: 107.52 / Avg: 250.13 / Max: 283.85Min: 24.01 / Avg: 262.73 / Max: 308.93Min: 26.63 / Avg: 264.56 / Max: 307.16Min: 53.66 / Avg: 287.94 / Max: 334.72Min: 70.74 / Avg: 291.06 / Max: 331.31Min: 56.01 / Avg: 302.36 / Max: 343.09Min: 33.48 / Avg: 334.34 / Max: 390.93Min: 40.14 / Avg: 393.77 / Max: 460.35Min: 98.17 / Avg: 450.49 / Max: 528.19Min: 55.17 / Avg: 472.39 / Max: 548.36Min: 62.89 / Avg: 492.94 / Max: 577.85Min: 64.05 / Avg: 543.22 / Max: 637.08Min: 165.51 / Avg: 545.78 / Max: 623.84Min: 197.32 / Avg: 550.54 / Max: 613.93Min: 189.98 / Avg: 567.79 / Max: 640.731. Xeon 6766E: Approximate power consumption of 7587 Joules per run.2. EPYC 8534PN: Approximate power consumption of 8004 Joules per run.3. Xeon 6780E: Approximate power consumption of 8794 Joules per run.4. EPYC 8534P: Approximate power consumption of 9656 Joules per run.5. Xeon 6766E 2P: Approximate power consumption of 15696 Joules per run.6. EPYC 9754: Approximate power consumption of 16454 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 16814 Joules per run.8. Xeon 6780E 2P: Approximate power consumption of 17659 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 18742 Joules per run.10. EPYC 9654: Approximate power consumption of 18431 Joules per run.11. Xeon Platinum 8490H: Approximate power consumption of 20060 Joules per run.12. Xeon Max 9468: Approximate power consumption of 20471 Joules per run.13. Xeon Max 9480: Approximate power consumption of 21266 Joules per run.14. EPYC 9684X: Approximate power consumption of 23292 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 27957 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 31534 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 33539 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 35163 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 38207 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 38641 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 38905 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 40502 Joules per run.

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardXeon Platinum 8380Xeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480EPYC 9684XEPYC 9654Xeon Platinum 8380 2PEPYC 8534PEPYC 8534PNXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PEPYC 9754Xeon 6780EEPYC 9684X 2PEPYC 9654 2PXeon 6766EEPYC 9754 2PXeon 6780E 2PXeon 6766E 2P3691215SE +/- 0.01476, N = 3SE +/- 0.02187, N = 3SE +/- 0.01810, N = 3SE +/- 0.02572, N = 3SE +/- 0.03815, N = 5SE +/- 0.01598, N = 3SE +/- 0.08822, N = 15SE +/- 0.01280, N = 3SE +/- 0.04633, N = 15SE +/- 0.05392, N = 15SE +/- 0.03225, N = 3SE +/- 0.09530, N = 15SE +/- 0.01358, N = 3SE +/- 0.06816, N = 3SE +/- 0.07891, N = 15SE +/- 0.03249, N = 3SE +/- 0.14799, N = 15SE +/- 0.20624, N = 12SE +/- 0.08614, N = 3SE +/- 0.10131, N = 15SE +/- 0.00701, N = 3SE +/- 0.06840, N = 32.983063.028973.170023.183923.370344.109144.461354.493174.570294.742215.625175.744915.839546.177966.227916.975097.096827.555587.689778.5180811.4820012.434501. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754Xeon Platinum 8380EPYC 9654EPYC 9684XXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2P100200300400500Min: 15.97 / Avg: 109.73 / Max: 119.37Min: 17.38 / Avg: 123.79 / Max: 132.65Min: 43.68 / Avg: 148.15 / Max: 156.57Min: 43.64 / Avg: 174.72 / Max: 185.33Min: 15.87 / Avg: 195.33 / Max: 210.52Min: 54.43 / Avg: 235.28 / Max: 251.36Min: 29.39 / Avg: 241.91 / Max: 260.94Min: 31.68 / Avg: 288.98 / Max: 309.48Min: 104.79 / Avg: 305.05 / Max: 321.54Min: 108.03 / Avg: 350.61 / Max: 370.78Min: 39.76 / Avg: 407.81 / Max: 436.29Min: 101.4 / Avg: 445.3 / Max: 473.57Min: 55.26 / Avg: 482.11 / Max: 517.72Min: 60.4 / Avg: 551.5 / Max: 590.71. EPYC 8534PN: Approximate power consumption of 7023 Joules per run.2. EPYC 8534P: Approximate power consumption of 7931 Joules per run.3. Xeon 6766E: Approximate power consumption of 9531 Joules per run.4. Xeon 6780E: Approximate power consumption of 11240 Joules per run.5. EPYC 9754: Approximate power consumption of 12501 Joules per run.6. Xeon Platinum 8380: Approximate power consumption of 15136 Joules per run.7. EPYC 9654: Approximate power consumption of 15482 Joules per run.8. EPYC 9684X: Approximate power consumption of 18591 Joules per run.9. Xeon 6766E 2P: Approximate power consumption of 19523 Joules per run.10. Xeon 6780E 2P: Approximate power consumption of 22556 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 26045 Joules per run.12. Xeon Platinum 8380 2P: Approximate power consumption of 28351 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 30694 Joules per run.14. EPYC 9684X 2P: Approximate power consumption of 35112 Joules per run.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardXeon Platinum 8380Xeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480EPYC 9684XEPYC 9654Xeon Platinum 8380 2PEPYC 8534PEPYC 8534PNXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PEPYC 9754Xeon 6780EEPYC 9684X 2PEPYC 9654 2PXeon 6766EEPYC 9754 2PXeon 6780E 2PXeon 6766E 2P70140210280350SE +/- 1.65, N = 3SE +/- 2.40, N = 3SE +/- 1.80, N = 3SE +/- 2.52, N = 3SE +/- 3.31, N = 5SE +/- 0.95, N = 3SE +/- 4.35, N = 15SE +/- 0.64, N = 3SE +/- 2.24, N = 15SE +/- 2.40, N = 15SE +/- 1.01, N = 3SE +/- 2.72, N = 15SE +/- 0.40, N = 3SE +/- 1.78, N = 3SE +/- 2.12, N = 15SE +/- 0.67, N = 3SE +/- 3.21, N = 15SE +/- 3.84, N = 12SE +/- 1.47, N = 3SE +/- 1.44, N = 15SE +/- 0.05, N = 3SE +/- 0.44, N = 3335.15330.10315.41314.06296.80243.34225.31222.52219.06211.19177.76174.68171.23161.89160.90143.36141.83133.49130.06117.6287.0980.421. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardXeon Platinum 8380Xeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480EPYC 9684XEPYC 9654Xeon Platinum 8380 2PEPYC 8534PEPYC 8534PNXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PEPYC 9754Xeon 6780EEPYC 9684X 2PEPYC 9654 2PXeon 6766EEPYC 9754 2PXeon 6780E 2PXeon 6766E 2P3691215SE +/- 0.01476, N = 3SE +/- 0.02187, N = 3SE +/- 0.01810, N = 3SE +/- 0.02572, N = 3SE +/- 0.03815, N = 5SE +/- 0.01598, N = 3SE +/- 0.08822, N = 15SE +/- 0.01280, N = 3SE +/- 0.04633, N = 15SE +/- 0.05392, N = 15SE +/- 0.03225, N = 3SE +/- 0.09530, N = 15SE +/- 0.01358, N = 3SE +/- 0.06816, N = 3SE +/- 0.07891, N = 15SE +/- 0.03249, N = 3SE +/- 0.14799, N = 15SE +/- 0.20624, N = 12SE +/- 0.08614, N = 3SE +/- 0.10131, N = 15SE +/- 0.00701, N = 3SE +/- 0.06840, N = 32.983063.028973.170023.183923.370344.109144.461354.493174.570294.742215.625175.744915.839546.177966.227916.975097.096827.555587.689778.5180811.4820012.434501. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

NAMD

NAMD is a parallel molecular dynamics code designed for high-performance simulation of large biomolecular systems. NAMD was developed by the Theoretical and Computational Biophysics Group in the Beckman Institute for Advanced Science and Technology at the University of Illinois at Urbana-Champaign. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: ATPase with 327,506 AtomsEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684XEPYC 9654EPYC 9754Xeon Max 9468 2PXeon Platinum 8380 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PEPYC 8534PEPYC 8534PNXeon Platinum 8592+Xeon 6766EXeon 6780EXeon Platinum 8380Xeon Platinum 8490HXeon Max 9480 2PXeon 6766E 2PXeon 6780E 2PXeon Platinum 8490H 2P510152025SE +/- 0.08771, N = 3SE +/- 0.02125, N = 3SE +/- 0.04751, N = 3SE +/- 0.02148, N = 6SE +/- 0.01368, N = 5SE +/- 0.04917, N = 5SE +/- 0.26203, N = 15SE +/- 0.07204, N = 4SE +/- 0.16058, N = 15SE +/- 0.14537, N = 15SE +/- 0.34017, N = 12SE +/- 0.04338, N = 5SE +/- 0.00431, N = 4SE +/- 0.54361, N = 15SE +/- 0.02593, N = 3SE +/- 0.17734, N = 15SE +/- 0.02582, N = 3SE +/- 0.21567, N = 12SE +/- 0.44989, N = 15SE +/- 0.19805, N = 15SE +/- 0.20408, N = 12SE +/- 0.17435, N = 1520.7525918.9745417.811059.335348.182757.997567.300656.726635.971305.925015.852675.706725.449714.648143.768113.763483.604792.970212.563192.554002.397702.21948
OpenBenchmarking.orgns/day Per Watt, More Is BetterNAMD 3.0b6Input: ATPase with 327,506 AtomsEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PEPYC 8534PNEPYC 8534PEPYC 9684XEPYC 9754EPYC 9654Xeon 6766EXeon 6780EXeon Max 9468Xeon Max 9480Xeon Platinum 8592+Xeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9468 2PXeon Platinum 8592+ 2PXeon 6766E 2PXeon Platinum 8490HXeon 6780E 2PXeon Max 9480 2PXeon Platinum 8490H 2P0.01890.03780.05670.07560.09450.0840.0680.0640.0560.0520.0520.0480.0440.0340.0290.0240.0220.0200.0170.0170.0140.0120.0110.0110.0090.0050.004
OpenBenchmarking.orgWatts, Fewer Is BetterNAMD 3.0b6CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8380EPYC 9754 2PXeon Platinum 8592+Xeon 6766E 2PXeon Max 9468Xeon Platinum 8490HEPYC 9654 2PXeon 6780E 2PXeon Max 9480EPYC 9684X 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2P140280420560700Min: 16.45 / Avg: 96.77 / Max: 141.98Min: 17 / Avg: 109.51 / Max: 166.07Min: 43.66 / Avg: 112.28 / Max: 262.76Min: 43.48 / Avg: 132.04 / Max: 342.42Min: 20.68 / Avg: 165.67 / Max: 289.24Min: 29.28 / Avg: 180.85 / Max: 379.02Min: 27.01 / Avg: 187.68 / Max: 312.41Min: 54.68 / Avg: 216.04 / Max: 281.76Min: 40.88 / Avg: 225.05 / Max: 615.88Min: 33.34 / Avg: 236.13 / Max: 373.62Min: 72.63 / Avg: 236.64 / Max: 427.46Min: 73.54 / Avg: 248.99 / Max: 374.54Min: 55.01 / Avg: 258.53 / Max: 352.06Min: 58.84 / Avg: 262.91 / Max: 648.62Min: 106.87 / Avg: 266.5 / Max: 492.66Min: 73.99 / Avg: 269.88 / Max: 376.76Min: 62.44 / Avg: 326.5 / Max: 779.77Min: 101.59 / Avg: 389.17 / Max: 564.97Min: 75.47 / Avg: 484.77 / Max: 671.95Min: 194.24 / Avg: 522.05 / Max: 693.75Min: 165.98 / Avg: 533.68 / Max: 633.47Min: 190.7 / Avg: 550.3 / Max: 686.191. EPYC 8534PN: Approximate power consumption of 1524 Joules per run.2. EPYC 8534P: Approximate power consumption of 1686 Joules per run.3. Xeon 6766E: Approximate power consumption of 11976 Joules per run.4. Xeon 6780E: Approximate power consumption of 13442 Joules per run.5. EPYC 9754: Approximate power consumption of 2286 Joules per run.6. EPYC 9684X: Approximate power consumption of 2803 Joules per run.7. EPYC 9654: Approximate power consumption of 2440 Joules per run.8. Xeon Platinum 8380: Approximate power consumption of 5905 Joules per run.9. EPYC 9754 2P: Approximate power consumption of 13353 Joules per run.10. Xeon Platinum 8592+: Approximate power consumption of 7666 Joules per run.11. Xeon 6766E 2P: Approximate power consumption of 27135 Joules per run.12. Xeon Max 9468: Approximate power consumption of 6424 Joules per run.13. Xeon Platinum 8490H: Approximate power consumption of 10621 Joules per run.14. EPYC 9654 2P: Approximate power consumption of 16651 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 30381 Joules per run.16. Xeon Max 9480: Approximate power consumption of 7521 Joules per run.17. EPYC 9684X 2P: Approximate power consumption of 24270 Joules per run.18. Xeon Platinum 8380 2P: Approximate power consumption of 18972 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 21572 Joules per run.20. Xeon Max 9468 2P: Approximate power consumption of 13434 Joules per run.21. Xeon Platinum 8490H 2P: Approximate power consumption of 25937 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 24177 Joules per run.

Speedb

Speedb is a next-generation key value storage engine that is RocksDB compatible and aiming for stability, efficiency, and performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Read While WritingEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon 6780E 2PXeon 6766E 2PEPYC 9754EPYC 9684XEPYC 9654Xeon 6780EXeon Platinum 8592+ 2PXeon 6766EXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 83808M16M24M32M40MSE +/- 803844.71, N = 15SE +/- 651901.79, N = 15SE +/- 746932.76, N = 15SE +/- 223786.94, N = 15SE +/- 138092.00, N = 3SE +/- 172052.60, N = 3SE +/- 118870.12, N = 3SE +/- 170909.18, N = 3SE +/- 75416.94, N = 3SE +/- 195912.00, N = 15SE +/- 45758.35, N = 3SE +/- 239363.92, N = 3SE +/- 197596.27, N = 3SE +/- 171807.74, N = 3SE +/- 143570.67, N = 4SE +/- 88013.69, N = 15SE +/- 86788.79, N = 3SE +/- 48351.08, N = 3SE +/- 62510.72, N = 3SE +/- 93731.24, N = 7SE +/- 88257.34, N = 3SE +/- 48302.92, N = 15365932043330757430324596276577762763078122829426195957771802499317945745175857371754893417297027153544001385925412168413120539011188210311795318106953609988176879540871471201. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s Per Watt, More Is BetterSpeedb 2.7Test: Read While WritingXeon 6766EEPYC 8534PNEPYC 9754Xeon 6780EEPYC 9754 2PEPYC 8534PXeon 6766E 2PXeon 6780E 2PEPYC 9654EPYC 9654 2PEPYC 9684X 2PEPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Max 9480Xeon Platinum 8380Xeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9468 2P20K40K60K80K100K103697.4297163.6593506.8490565.2185339.0379851.0577049.1369360.7963472.8761034.9757884.5657032.7737383.4132356.0430648.4229984.5827890.6926509.9126260.0523084.6123023.2321183.20
OpenBenchmarking.orgWatts, Fewer Is BetterSpeedb 2.7CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754Xeon Platinum 8380EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9684XXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2P140280420560700Min: 17.9 / Avg: 122.29 / Max: 139.21Min: 17.32 / Avg: 150.95 / Max: 163.43Min: 43.64 / Avg: 169.23 / Max: 238.92Min: 43.55 / Avg: 198.15 / Max: 300.83Min: 22.4 / Avg: 244.15 / Max: 314.31Min: 52.53 / Avg: 256.25 / Max: 291.99Min: 26.3 / Avg: 283.98 / Max: 305.25Min: 34.03 / Avg: 325.5 / Max: 377.13Min: 52.35 / Avg: 330.55 / Max: 376.19Min: 78.68 / Avg: 331.78 / Max: 377.28Min: 74.62 / Avg: 333.11 / Max: 375.39Min: 32.81 / Avg: 343.59 / Max: 411.18Min: 107.63 / Avg: 358.61 / Max: 475.78Min: 108.97 / Avg: 398.75 / Max: 547.56Min: 41.53 / Avg: 428.8 / Max: 640.33Min: 56.42 / Avg: 496.84 / Max: 614.4Min: 105.62 / Avg: 510.96 / Max: 581.73Min: 78.24 / Avg: 573.79 / Max: 750.97Min: 64.91 / Avg: 575.41 / Max: 820.95Min: 210.71 / Avg: 654.26 / Max: 754.28Min: 164.82 / Avg: 658.68 / Max: 750.75Min: 210.91 / Avg: 666.91 / Max: 751.131. EPYC 8534PN: Approximate power consumption of 7867 Joules per run.2. EPYC 8534P: Approximate power consumption of 9701 Joules per run.3. Xeon 6766E: Approximate power consumption of 10887 Joules per run.4. Xeon 6780E: Approximate power consumption of 12748 Joules per run.5. EPYC 9754: Approximate power consumption of 15625 Joules per run.6. Xeon Platinum 8380: Approximate power consumption of 16452 Joules per run.7. EPYC 9654: Approximate power consumption of 18269 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 20995 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 21266 Joules per run.10. Xeon Max 9468: Approximate power consumption of 21344 Joules per run.11. Xeon Max 9480: Approximate power consumption of 21367 Joules per run.12. EPYC 9684X: Approximate power consumption of 21990 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 23310 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 25733 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 27529 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 31731 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 32531 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 36876 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 36788 Joules per run.20. Xeon Max 9468 2P: Approximate power consumption of 41872 Joules per run.21. Xeon Platinum 8490H 2P: Approximate power consumption of 42595 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 42904 Joules per run.

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-50Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8380Xeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XEPYC 8534PEPYC 8534PNXeon 6780EEPYC 9754Xeon 6766EEPYC 9684X 2PEPYC 9654 2PXeon 6780E 2PXeon 6766E 2PEPYC 9754 2P1428425670SE +/- 0.12, N = 3SE +/- 0.24, N = 3SE +/- 0.71, N = 3SE +/- 0.62, N = 3SE +/- 0.14, N = 3SE +/- 0.51, N = 3SE +/- 0.12, N = 3SE +/- 0.46, N = 4SE +/- 0.40, N = 15SE +/- 0.50, N = 3SE +/- 0.26, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.18, N = 3SE +/- 0.33, N = 5SE +/- 0.10, N = 3SE +/- 0.14, N = 3SE +/- 0.37, N = 12SE +/- 0.35, N = 12SE +/- 0.11, N = 3SE +/- 0.06, N = 3SE +/- 0.23, N = 963.0656.0151.5551.3548.9942.3540.7738.3037.7537.0835.0134.7133.4933.2330.6927.6826.8917.2817.0716.1014.8413.68
OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-50EPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon Platinum 8380Xeon Platinum 8490HXeon 6766EXeon 6780EXeon Max 9468Xeon Max 9480EPYC 9654EPYC 9754EPYC 9684XXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9754 2PEPYC 9654 2PXeon 6766E 2PXeon 6780E 2PEPYC 9684X 2P0.07610.15220.22830.30440.38050.3380.3080.2580.2360.2230.1940.1930.1930.1860.1790.1750.1500.1160.0800.0760.0740.0660.0460.0460.0450.0440.042
OpenBenchmarking.orgWatts, Fewer Is BetterPyTorch 2.2.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EEPYC 9654Xeon Platinum 8380EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9754 2PXeon Platinum 8380 2PXeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2P110220330440550Min: 15.03 / Avg: 98.23 / Max: 110.34Min: 19.48 / Avg: 108.57 / Max: 123.57Min: 43.6 / Avg: 138.69 / Max: 152.97Min: 21.23 / Avg: 158.01 / Max: 176.03Min: 43.46 / Avg: 159.15 / Max: 179.26Min: 28.44 / Avg: 195.3 / Max: 220.5Min: 53.3 / Avg: 207.69 / Max: 238.28Min: 35.79 / Avg: 231.06 / Max: 261.25Min: 35.31 / Avg: 244 / Max: 293.19Min: 60.41 / Avg: 250.31 / Max: 298.35Min: 73.38 / Avg: 266.73 / Max: 308.34Min: 76.06 / Avg: 275.89 / Max: 319.9Min: 40.2 / Avg: 299.48 / Max: 333.06Min: 100.89 / Avg: 325.09 / Max: 418.72Min: 104.56 / Avg: 326.43 / Max: 349.99Min: 108.31 / Avg: 363.14 / Max: 388.67Min: 54.65 / Avg: 367.41 / Max: 412.66Min: 62.55 / Avg: 415.63 / Max: 466.73Min: 162.87 / Avg: 486.48 / Max: 565.96Min: 81.92 / Avg: 507.01 / Max: 574.06Min: 202.91 / Avg: 568.79 / Max: 623.75Min: 194.23 / Avg: 577.63 / Max: 637.31. EPYC 8534PN: Approximate power consumption of 6712 Joules per run.2. EPYC 8534P: Approximate power consumption of 7383 Joules per run.3. Xeon 6766E: Approximate power consumption of 11650 Joules per run.4. EPYC 9754: Approximate power consumption of 13009 Joules per run.5. Xeon 6780E: Approximate power consumption of 11873 Joules per run.6. EPYC 9654: Approximate power consumption of 12955 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 10038 Joules per run.8. EPYC 9684X: Approximate power consumption of 15327 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 9679 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 12265 Joules per run.11. Xeon Max 9468: Approximate power consumption of 14048 Joules per run.12. Xeon Max 9480: Approximate power consumption of 15266 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 48682 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 20307 Joules per run.15. Xeon 6766E 2P: Approximate power consumption of 49944 Joules per run.16. Xeon 6780E 2P: Approximate power consumption of 51081 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 46569 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 52785 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 33405 Joules per run.20. Xeon Platinum 8592+ 2P: Approximate power consumption of 30083 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 32610 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 40868 Joules per run.

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380Xeon Max 9468Xeon Platinum 8380 2PXeon Max 9480EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 8534PNEPYC 9754EPYC 8534PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P4080120160200SE +/- 0.19, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 3SE +/- 0.32, N = 15SE +/- 0.09, N = 3SE +/- 0.33, N = 3SE +/- 0.03, N = 3SE +/- 0.21, N = 3SE +/- 0.28, N = 4SE +/- 0.39, N = 13SE +/- 0.36, N = 3SE +/- 0.18, N = 3SE +/- 0.31, N = 15SE +/- 0.40, N = 15SE +/- 0.07, N = 3SE +/- 0.56, N = 15SE +/- 0.98, N = 15SE +/- 1.27, N = 15SE +/- 0.35, N = 3SE +/- 0.34, N = 3SE +/- 0.28, N = 3SE +/- 1.15, N = 315.0418.9319.6021.2221.9623.6624.1124.6525.4826.0927.5929.4432.2332.4732.9242.5142.8955.9296.69106.69167.97179.141. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754Xeon Platinum 8380EPYC 9654EPYC 9684XXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2P110220330440550Min: 16.31 / Avg: 120.57 / Max: 131.45Min: 17.21 / Avg: 132.4 / Max: 145.89Min: 43.72 / Avg: 151.02 / Max: 162.14Min: 43.54 / Avg: 183.75 / Max: 198.81Min: 20.36 / Avg: 200.16 / Max: 217.19Min: 53.12 / Avg: 250.25 / Max: 269.16Min: 25.68 / Avg: 250.64 / Max: 270.41Min: 34.41 / Avg: 294.42 / Max: 320.91Min: 103.92 / Avg: 301.78 / Max: 322.43Min: 107.32 / Avg: 350.27 / Max: 375.87Min: 37.61 / Avg: 403.98 / Max: 434.7Min: 99.93 / Avg: 462.76 / Max: 500.69Min: 56.82 / Avg: 486.07 / Max: 528.33Min: 58.32 / Avg: 553.19 / Max: 601.271. EPYC 8534PN: Approximate power consumption of 7813 Joules per run.2. EPYC 8534P: Approximate power consumption of 8562 Joules per run.3. Xeon 6766E: Approximate power consumption of 9867 Joules per run.4. Xeon 6780E: Approximate power consumption of 12066 Joules per run.5. EPYC 9754: Approximate power consumption of 12957 Joules per run.6. Xeon Platinum 8380: Approximate power consumption of 16266 Joules per run.7. EPYC 9654: Approximate power consumption of 16166 Joules per run.8. EPYC 9684X: Approximate power consumption of 19039 Joules per run.9. Xeon 6766E 2P: Approximate power consumption of 19918 Joules per run.10. Xeon 6780E 2P: Approximate power consumption of 23118 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 26097 Joules per run.12. Xeon Platinum 8380 2P: Approximate power consumption of 30233 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 31303 Joules per run.14. EPYC 9684X 2P: Approximate power consumption of 35589 Joules per run.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380Xeon Max 9468Xeon Platinum 8380 2PXeon Max 9480EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 8534PNEPYC 9754EPYC 8534PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P1530456075SE +/- 0.82440, N = 3SE +/- 0.16471, N = 3SE +/- 0.54692, N = 3SE +/- 0.69010, N = 15SE +/- 0.18826, N = 3SE +/- 0.58786, N = 3SE +/- 0.05911, N = 3SE +/- 0.34209, N = 3SE +/- 0.42374, N = 4SE +/- 0.50579, N = 13SE +/- 0.47575, N = 3SE +/- 0.20595, N = 3SE +/- 0.29092, N = 15SE +/- 0.38216, N = 15SE +/- 0.06539, N = 3SE +/- 0.31646, N = 15SE +/- 0.56636, N = 15SE +/- 0.40826, N = 15SE +/- 0.03724, N = 3SE +/- 0.02972, N = 3SE +/- 0.00992, N = 3SE +/- 0.03571, N = 366.5162052.8167051.0172047.2703045.5414042.2747041.4745040.5671039.2586038.4240036.2493033.9621031.0644030.8572030.3743023.5786023.4960018.0133010.342509.372945.952835.582411. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380Xeon Max 9468Xeon Platinum 8380 2PXeon Max 9480EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 8534PNEPYC 9754EPYC 8534PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P4080120160200SE +/- 0.19, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 3SE +/- 0.32, N = 15SE +/- 0.09, N = 3SE +/- 0.33, N = 3SE +/- 0.03, N = 3SE +/- 0.21, N = 3SE +/- 0.28, N = 4SE +/- 0.39, N = 13SE +/- 0.36, N = 3SE +/- 0.18, N = 3SE +/- 0.31, N = 15SE +/- 0.40, N = 15SE +/- 0.07, N = 3SE +/- 0.56, N = 15SE +/- 0.98, N = 15SE +/- 1.27, N = 15SE +/- 0.35, N = 3SE +/- 0.34, N = 3SE +/- 0.28, N = 3SE +/- 1.15, N = 315.0418.9319.6021.2221.9623.6624.1124.6525.4826.0927.5929.4432.2332.4732.9242.5142.8955.9296.69106.69167.97179.141. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Platinum 8380Xeon Platinum 8490HXeon Max 9480Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P306090120150SE +/- 0.04, N = 3SE +/- 0.44, N = 3SE +/- 0.44, N = 3SE +/- 1.84, N = 12SE +/- 0.17, N = 3SE +/- 0.23, N = 3SE +/- 0.29, N = 3SE +/- 1.12, N = 15SE +/- 0.68, N = 3SE +/- 0.62, N = 3SE +/- 0.18, N = 3SE +/- 0.17, N = 3SE +/- 0.51, N = 3SE +/- 1.26, N = 3SE +/- 0.70, N = 15SE +/- 2.80, N = 15SE +/- 2.33, N = 12SE +/- 0.90, N = 6SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 6.88, N = 15SE +/- 6.85, N = 1539.7544.6047.2448.4749.6449.9754.2855.9060.1160.3671.5672.1280.7286.6587.6690.0693.6493.83111.87124.06141.57155.901. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754Xeon 6766E 2PEPYC 9654Xeon 6780E 2PXeon Platinum 8380EPYC 9684XEPYC 9754 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2P90180270360450Min: 16.97 / Avg: 101.89 / Max: 112.56Min: 16.8 / Avg: 119.38 / Max: 129.78Min: 43.62 / Avg: 139.52 / Max: 148.88Min: 43.51 / Avg: 163.29 / Max: 175Min: 20.33 / Avg: 188.2 / Max: 202.92Min: 104.06 / Avg: 210.79 / Max: 227.9Min: 29.64 / Avg: 222.91 / Max: 240.57Min: 106.24 / Avg: 233.19 / Max: 250.31Min: 51.89 / Avg: 246.13 / Max: 266.29Min: 33.42 / Avg: 261.74 / Max: 283.2Min: 38.39 / Avg: 302.95 / Max: 323.86Min: 56.36 / Avg: 405.91 / Max: 434.32Min: 95.98 / Avg: 424.24 / Max: 455.9Min: 63.67 / Avg: 460.32 / Max: 497.921. EPYC 8534PN: Approximate power consumption of 6691 Joules per run.2. EPYC 8534P: Approximate power consumption of 7799 Joules per run.3. Xeon 6766E: Approximate power consumption of 9162 Joules per run.4. Xeon 6780E: Approximate power consumption of 10723 Joules per run.5. EPYC 9754: Approximate power consumption of 12233 Joules per run.6. Xeon 6766E 2P: Approximate power consumption of 13884 Joules per run.7. EPYC 9654: Approximate power consumption of 14564 Joules per run.8. Xeon 6780E 2P: Approximate power consumption of 15344 Joules per run.9. Xeon Platinum 8380: Approximate power consumption of 15999 Joules per run.10. EPYC 9684X: Approximate power consumption of 16926 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 19692 Joules per run.12. EPYC 9654 2P: Approximate power consumption of 26384 Joules per run.13. Xeon Platinum 8380 2P: Approximate power consumption of 27717 Joules per run.14. EPYC 9684X 2P: Approximate power consumption of 29798 Joules per run.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Platinum 8380Xeon Platinum 8490HXeon Max 9480Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P612182430SE +/- 0.02370, N = 3SE +/- 0.21982, N = 3SE +/- 0.19764, N = 3SE +/- 0.58074, N = 12SE +/- 0.07031, N = 3SE +/- 0.09194, N = 3SE +/- 0.09869, N = 3SE +/- 0.35497, N = 15SE +/- 0.18711, N = 3SE +/- 0.16743, N = 3SE +/- 0.03564, N = 3SE +/- 0.03352, N = 3SE +/- 0.07825, N = 3SE +/- 0.16639, N = 3SE +/- 0.09294, N = 15SE +/- 0.38561, N = 15SE +/- 0.26635, N = 12SE +/- 0.10002, N = 6SE +/- 0.00509, N = 3SE +/- 0.00331, N = 3SE +/- 0.36771, N = 15SE +/- 0.31004, N = 1525.1591022.4251021.1702020.8723020.1453020.0103018.4222017.9873016.6394016.5705013.9745013.8647012.3884011.5447011.4182011.2707010.7518810.661508.938338.060137.312856.604711. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Platinum 8380Xeon Platinum 8490HXeon Max 9480Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P306090120150SE +/- 0.04, N = 3SE +/- 0.44, N = 3SE +/- 0.44, N = 3SE +/- 1.84, N = 12SE +/- 0.17, N = 3SE +/- 0.23, N = 3SE +/- 0.29, N = 3SE +/- 1.12, N = 15SE +/- 0.68, N = 3SE +/- 0.62, N = 3SE +/- 0.18, N = 3SE +/- 0.17, N = 3SE +/- 0.51, N = 3SE +/- 1.26, N = 3SE +/- 0.70, N = 15SE +/- 2.80, N = 15SE +/- 2.33, N = 12SE +/- 0.90, N = 6SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 6.88, N = 15SE +/- 6.85, N = 1539.7544.6047.2448.4749.6449.9754.2855.9060.1160.3671.5672.1280.7286.6587.6690.0693.6493.83111.87124.06141.57155.901. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380Xeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PXeon 6780EEPYC 8534PNXeon 6766EEPYC 9684X 2PEPYC 9654 2PEPYC 8534PEPYC 9754EPYC 9754 2PXeon 6780E 2PXeon 6766E 2P0.81431.62862.44293.25724.0715SE +/- 0.00291, N = 3SE +/- 0.01594, N = 3SE +/- 0.00236, N = 3SE +/- 0.01541, N = 3SE +/- 0.02719, N = 15SE +/- 0.01456, N = 3SE +/- 0.02289, N = 15SE +/- 0.01405, N = 15SE +/- 0.01470, N = 3SE +/- 0.00498, N = 3SE +/- 0.02493, N = 15SE +/- 0.01853, N = 5SE +/- 0.00120, N = 3SE +/- 0.03117, N = 3SE +/- 0.00335, N = 3SE +/- 0.03659, N = 15SE +/- 0.02209, N = 15SE +/- 0.02450, N = 4SE +/- 0.01501, N = 3SE +/- 0.02347, N = 11SE +/- 0.03971, N = 3SE +/- 0.01119, N = 31.100421.172921.175611.324541.378311.416621.428491.435731.485961.652701.660461.718752.072882.238682.243232.246452.250202.257162.616533.164413.415373.619201. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8380EPYC 9684XXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2P100200300400500Min: 17.14 / Avg: 106.46 / Max: 113.35Min: 19.26 / Avg: 116.04 / Max: 124.74Min: 43.72 / Avg: 146.19 / Max: 154.64Min: 43.58 / Avg: 171.22 / Max: 182.02Min: 19.01 / Avg: 179.59 / Max: 191.94Min: 26 / Avg: 222.45 / Max: 240.99Min: 54.86 / Avg: 232.56 / Max: 248.24Min: 35.78 / Avg: 264.82 / Max: 285.07Min: 104.87 / Avg: 303.41 / Max: 320.11Min: 108.14 / Avg: 349.02 / Max: 367.93Min: 42.05 / Avg: 397.19 / Max: 423.71Min: 51.38 / Avg: 431.96 / Max: 458.85Min: 57.3 / Avg: 472.8 / Max: 505.93Min: 65.24 / Avg: 542.12 / Max: 580.411. EPYC 8534PN: Approximate power consumption of 6849 Joules per run.2. EPYC 8534P: Approximate power consumption of 7484 Joules per run.3. Xeon 6766E: Approximate power consumption of 9405 Joules per run.4. Xeon 6780E: Approximate power consumption of 11015 Joules per run.5. EPYC 9754: Approximate power consumption of 11554 Joules per run.6. EPYC 9654: Approximate power consumption of 14237 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 14961 Joules per run.8. EPYC 9684X: Approximate power consumption of 16949 Joules per run.9. Xeon 6766E 2P: Approximate power consumption of 19620 Joules per run.10. Xeon 6780E 2P: Approximate power consumption of 22453 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 25420 Joules per run.12. Xeon Platinum 8380 2P: Approximate power consumption of 27703 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 30133 Joules per run.14. EPYC 9684X 2P: Approximate power consumption of 34551 Joules per run.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380Xeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PXeon 6780EEPYC 9684X 2PEPYC 8534PNXeon 6766EEPYC 9654 2PEPYC 8534PEPYC 9754EPYC 9754 2PXeon 6780E 2PXeon 6766E 2P2004006008001000SE +/- 2.43, N = 3SE +/- 11.46, N = 3SE +/- 1.66, N = 3SE +/- 8.88, N = 3SE +/- 12.91, N = 15SE +/- 7.34, N = 3SE +/- 10.46, N = 15SE +/- 6.50, N = 15SE +/- 6.60, N = 3SE +/- 1.83, N = 3SE +/- 9.50, N = 15SE +/- 6.21, N = 5SE +/- 0.28, N = 3SE +/- 7.76, N = 15SE +/- 6.13, N = 3SE +/- 0.67, N = 3SE +/- 4.37, N = 15SE +/- 4.84, N = 4SE +/- 2.19, N = 3SE +/- 2.36, N = 11SE +/- 3.37, N = 3SE +/- 0.86, N = 3908.19852.33849.56754.81728.47705.61701.72696.98672.92604.76604.05581.77482.21446.81446.69445.62444.85443.06382.10316.11292.79276.241. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380Xeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PXeon 6780EEPYC 8534PNXeon 6766EEPYC 9684X 2PEPYC 9654 2PEPYC 8534PEPYC 9754EPYC 9754 2PXeon 6780E 2PXeon 6766E 2P0.81431.62862.44293.25724.0715SE +/- 0.00291, N = 3SE +/- 0.01594, N = 3SE +/- 0.00236, N = 3SE +/- 0.01541, N = 3SE +/- 0.02719, N = 15SE +/- 0.01456, N = 3SE +/- 0.02289, N = 15SE +/- 0.01405, N = 15SE +/- 0.01470, N = 3SE +/- 0.00498, N = 3SE +/- 0.02493, N = 15SE +/- 0.01853, N = 5SE +/- 0.00120, N = 3SE +/- 0.03117, N = 3SE +/- 0.00335, N = 3SE +/- 0.03659, N = 15SE +/- 0.02209, N = 15SE +/- 0.02450, N = 4SE +/- 0.01501, N = 3SE +/- 0.02347, N = 11SE +/- 0.03971, N = 3SE +/- 0.01119, N = 31.100421.172921.175611.324541.378311.416621.428491.435731.485961.652701.660461.718752.072882.238682.243232.246452.250202.257162.616533.164413.415373.619201. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Llamafile

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.7Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPUEPYC 9684XEPYC 9654EPYC 9754Xeon Platinum 8490HXeon 6780EXeon 6766EEPYC 9654 2PEPYC 9684X 2PEPYC 8534PEPYC 8534PNEPYC 9754 2PXeon Platinum 8380Xeon Platinum 8592+Xeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon 6780E 2PXeon 6766E 2PXeon Max 9468 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468246810SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.12, N = 6SE +/- 0.00, N = 3SE +/- 0.00, N = 38.488.357.475.855.585.395.245.245.165.114.634.414.083.823.103.052.672.561.771.541.541.47
OpenBenchmarking.orgTokens Per Second Per Watt, More Is BetterLlamafile 0.7Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPUEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon 6766EEPYC 9684XXeon 6780EXeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8592+EPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon 6780E 2PXeon 6766E 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2P0.00990.01980.02970.03960.04950.0440.0380.0370.0340.0310.0290.0280.0180.0180.0130.0110.0110.0090.0070.0070.0060.0060.0050.0050.0050.0030.002
OpenBenchmarking.orgWatts, Fewer Is BetterLlamafile 0.7CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8380EPYC 9684XXeon Max 9468Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon 6766E 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P130260390520650Min: 16.37 / Avg: 115.77 / Max: 139.52Min: 17.14 / Avg: 135.55 / Max: 164.93Min: 43.73 / Avg: 175.78 / Max: 254.24Min: 43.53 / Avg: 201.04 / Max: 326.57Min: 21.63 / Avg: 203.84 / Max: 298.7Min: 30.07 / Avg: 245.28 / Max: 317.66Min: 51.16 / Avg: 250.18 / Max: 288.75Min: 29.28 / Avg: 296.68 / Max: 399.75Min: 72.56 / Avg: 306.79 / Max: 356.97Min: 33.89 / Avg: 307.46 / Max: 338.87Min: 53.92 / Avg: 317.1 / Max: 376.78Min: 86.22 / Avg: 325.29 / Max: 362.03Min: 105.02 / Avg: 350.49 / Max: 483.96Min: 108.26 / Avg: 383.74 / Max: 590.61Min: 41.26 / Avg: 412.48 / Max: 564Min: 58.45 / Avg: 480.08 / Max: 600.8Min: 101.74 / Avg: 484.21 / Max: 566.46Min: 65.77 / Avg: 568.13 / Max: 708.34Min: 85.64 / Avg: 568.91 / Max: 665.68Min: 170.34 / Avg: 630.52 / Max: 723.74Min: 203.4 / Avg: 633.28 / Max: 704.68Min: 184.95 / Avg: 639.77 / Max: 696.321. EPYC 8534PN: Approximate power consumption of 10227 Joules per run.2. EPYC 8534P: Approximate power consumption of 11883 Joules per run.3. Xeon 6766E: Approximate power consumption of 15468 Joules per run.4. Xeon 6780E: Approximate power consumption of 17021 Joules per run.5. EPYC 9754: Approximate power consumption of 13182 Joules per run.6. EPYC 9654: Approximate power consumption of 14308 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 24518 Joules per run.8. EPYC 9684X: Approximate power consumption of 17009 Joules per run.9. Xeon Max 9468: Approximate power consumption of 81913 Joules per run.10. Xeon Platinum 8592+: Approximate power consumption of 31976 Joules per run.11. Xeon Platinum 8490H: Approximate power consumption of 24311 Joules per run.12. Xeon Max 9480: Approximate power consumption of 83491 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 60402 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 63573 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 39048 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 40326 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 64562 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 47912 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 77183 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 69987 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 142698 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 168578 Joules per run.

Timed Godot Game Engine Compilation

This test times how long it takes to compile the Godot Game Engine. Godot is a popular, open-source, cross-platform 2D/3D game engine and is built using the SCons build system and targeting the X11 platform. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 4.0Time To CompileEPYC 9684X 2PEPYC 9654 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Platinum 8592+Xeon Max 9468 2PEPYC 9754 2PEPYC 9754Xeon Platinum 8490HXeon Max 9480Xeon 6780E 2PXeon Max 9468Xeon Platinum 8380 2PXeon 6780EEPYC 8534PEPYC 8534PNXeon 6766E 2PXeon 6766EXeon Platinum 83804080120160200SE +/- 0.62, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.29, N = 3SE +/- 0.16, N = 3SE +/- 0.56, N = 3SE +/- 1.69, N = 3SE +/- 0.91, N = 3SE +/- 0.56, N = 3SE +/- 0.55, N = 3SE +/- 0.20, N = 3SE +/- 0.76, N = 3SE +/- 0.32, N = 3SE +/- 1.40, N = 3SE +/- 0.18, N = 3SE +/- 0.69, N = 3SE +/- 0.73, N = 3SE +/- 0.32, N = 3SE +/- 0.16, N = 3SE +/- 0.64, N = 3SE +/- 0.16, N = 3SE +/- 0.22, N = 396.16102.58103.35103.38111.69118.57122.70122.72123.88126.11128.28140.23143.81148.99149.38151.54152.23154.01159.62160.46165.41187.88
OpenBenchmarking.orgWatts, Fewer Is BetterTimed Godot Game Engine Compilation 4.0CPU Power Consumption MonitorEPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EEPYC 9754Xeon 6766E 2PEPYC 9654Xeon 6780E 2PXeon Platinum 8380EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HEPYC 9754 2PXeon Max 9480Xeon Max 9468EPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P140280420560700Min: 16.76 / Avg: 97.75 / Max: 142.01Min: 43.52 / Avg: 109.04 / Max: 243.23Min: 18.58 / Avg: 110.14 / Max: 169.2Min: 43.34 / Avg: 124.67 / Max: 295.77Min: 18.92 / Avg: 152.32 / Max: 333.75Min: 103.92 / Avg: 184.93 / Max: 507.62Min: 24.79 / Avg: 188.63 / Max: 336.96Min: 106.86 / Avg: 202.24 / Max: 626.79Min: 50.66 / Avg: 217.11 / Max: 290.99Min: 33.53 / Avg: 222.04 / Max: 410.61Min: 33.4 / Avg: 236.2 / Max: 374.96Min: 55.69 / Avg: 255.97 / Max: 375.31Min: 39.69 / Avg: 276.98 / Max: 673.64Min: 82.82 / Avg: 282.51 / Max: 375.66Min: 76.87 / Avg: 285.63 / Max: 375.65Min: 58.53 / Avg: 338.4 / Max: 689.21Min: 97.52 / Avg: 352.55 / Max: 559.9Min: 65.36 / Avg: 383.39 / Max: 820.55Min: 82.98 / Avg: 430.41 / Max: 750.75Min: 154.59 / Avg: 461.39 / Max: 752.04Min: 197.93 / Avg: 519.6 / Max: 744.47Min: 199.22 / Avg: 527.95 / Max: 724.511. EPYC 8534PN: Approximate power consumption of 16193 Joules per run.2. Xeon 6766E: Approximate power consumption of 18719 Joules per run.3. EPYC 8534P: Approximate power consumption of 17622 Joules per run.4. Xeon 6780E: Approximate power consumption of 19739 Joules per run.5. EPYC 9754: Approximate power consumption of 20411 Joules per run.6. Xeon 6766E 2P: Approximate power consumption of 30822 Joules per run.7. EPYC 9654: Approximate power consumption of 22133 Joules per run.8. Xeon 6780E 2P: Approximate power consumption of 31483 Joules per run.9. Xeon Platinum 8380: Approximate power consumption of 42119 Joules per run.10. EPYC 9684X: Approximate power consumption of 24203 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 31808 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 37371 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 36469 Joules per run.14. Xeon Max 9480: Approximate power consumption of 42188 Joules per run.15. Xeon Max 9468: Approximate power consumption of 44367 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 36434 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 55350 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 39105 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 47202 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 57674 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 66683 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 68458 Joules per run.

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 256 - Model: ResNet-50Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8380Xeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8380 2PEPYC 9654EPYC 9684XEPYC 8534PEPYC 8534PNXeon 6780EEPYC 9754Xeon 6766EEPYC 9654 2PEPYC 9684X 2PXeon 6780E 2PXeon 6766E 2PEPYC 9754 2P1428425670SE +/- 0.64, N = 3SE +/- 0.52, N = 3SE +/- 0.76, N = 3SE +/- 0.62, N = 3SE +/- 0.04, N = 3SE +/- 0.52, N = 3SE +/- 0.29, N = 3SE +/- 0.45, N = 3SE +/- 0.49, N = 3SE +/- 0.23, N = 3SE +/- 0.21, N = 3SE +/- 0.09, N = 3SE +/- 0.18, N = 3SE +/- 0.13, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.12, N = 3SE +/- 0.37, N = 12SE +/- 0.32, N = 12SE +/- 0.12, N = 3SE +/- 0.11, N = 3SE +/- 0.28, N = 1263.6054.8452.9751.5648.8941.6841.4537.9137.4436.9734.9034.9033.6833.3030.8627.7826.8217.4116.9716.2214.6713.11
OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 256 - Model: ResNet-50EPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon Platinum 8380Xeon Platinum 8490HXeon Max 9468Xeon 6780EXeon 6766EXeon Max 9480EPYC 9654EPYC 9754EPYC 9684XXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654 2PXeon 6780E 2PXeon 6766E 2PEPYC 9754 2PEPYC 9684X 2P0.07520.15040.22560.30080.3760.3340.3050.2930.2350.2180.1970.1940.1940.1890.1790.1760.1500.1130.0820.0770.0730.0660.0480.0450.0450.0440.040
OpenBenchmarking.orgWatts, Fewer Is BetterPyTorch 2.2.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EEPYC 9654Xeon Platinum 8380Xeon Platinum 8592+EPYC 9684XXeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9754 2PXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2P110220330440550Min: 17.28 / Avg: 99.64 / Max: 110.85Min: 19.91 / Avg: 110.56 / Max: 125.45Min: 43.68 / Avg: 138.47 / Max: 152.75Min: 21.47 / Avg: 157.48 / Max: 175.9Min: 43.38 / Avg: 159.18 / Max: 178.76Min: 30.18 / Avg: 194.95 / Max: 219.41Min: 55.01 / Avg: 207.81 / Max: 238.76Min: 18.63 / Avg: 215.65 / Max: 294.3Min: 32.73 / Avg: 232.73 / Max: 262.5Min: 61.04 / Avg: 251.84 / Max: 296.62Min: 75.38 / Avg: 268.45 / Max: 310.8Min: 89.32 / Avg: 273.3 / Max: 321.11Min: 40.16 / Avg: 300.12 / Max: 342.36Min: 105.49 / Avg: 325.94 / Max: 350.34Min: 101.92 / Avg: 326.58 / Max: 422.87Min: 108.2 / Avg: 363.82 / Max: 389.75Min: 55.56 / Avg: 365.56 / Max: 407.37Min: 61.35 / Avg: 419.25 / Max: 473.7Min: 165.22 / Avg: 486.52 / Max: 567.17Min: 72.64 / Avg: 507.69 / Max: 575.72Min: 201.49 / Avg: 569.91 / Max: 625.34Min: 193.43 / Avg: 577.93 / Max: 636.861. EPYC 8534PN: Approximate power consumption of 6742 Joules per run.2. EPYC 8534P: Approximate power consumption of 7407 Joules per run.3. Xeon 6766E: Approximate power consumption of 11539 Joules per run.4. EPYC 9754: Approximate power consumption of 13018 Joules per run.5. Xeon 6780E: Approximate power consumption of 11832 Joules per run.6. EPYC 9654: Approximate power consumption of 12932 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 10044 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 9848 Joules per run.9. EPYC 9684X: Approximate power consumption of 15360 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 12340 Joules per run.11. Xeon Max 9468: Approximate power consumption of 13691 Joules per run.12. Xeon Max 9480: Approximate power consumption of 19313 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 49920 Joules per run.14. Xeon 6766E 2P: Approximate power consumption of 50086 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 20683 Joules per run.16. Xeon 6780E 2P: Approximate power consumption of 50692 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 46030 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 53629 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 33084 Joules per run.20. Xeon Platinum 8592+ 2P: Approximate power consumption of 40108 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 33245 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 41033 Joules per run.

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: INIVOL and Fluid Structure Interaction Drop ContainerEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9654EPYC 9754Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 83804080120160200SE +/- 0.43, N = 3SE +/- 0.14, N = 3SE +/- 0.12, N = 3SE +/- 0.93, N = 3SE +/- 0.30, N = 3SE +/- 0.57, N = 3SE +/- 0.46, N = 3SE +/- 0.17, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.50, N = 3SE +/- 0.19, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.37, N = 3SE +/- 0.63, N = 3SE +/- 0.23, N = 379.4285.8990.8594.76100.00100.24106.54107.36110.56114.29128.74135.56140.43146.03160.56176.87187.03204.21
OpenBenchmarking.orgWatts, Fewer Is BetterOpenRadioss 2023.09.15CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon Platinum 8380EPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9684XXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2P140280420560700Min: 18.08 / Avg: 129.32 / Max: 137.09Min: 18.75 / Avg: 147.36 / Max: 159.1Min: 52.13 / Avg: 259.44 / Max: 290.81Min: 21.72 / Avg: 297.41 / Max: 340.37Min: 27.14 / Avg: 303.45 / Max: 345.2Min: 23.22 / Avg: 328.15 / Max: 377.07Min: 60.99 / Avg: 331.72 / Max: 375.56Min: 75.87 / Avg: 334.64 / Max: 374.39Min: 72.45 / Avg: 335.98 / Max: 368.12Min: 34.68 / Avg: 370.43 / Max: 409.62Min: 99.13 / Avg: 505.66 / Max: 581.63Min: 41.48 / Avg: 554.53 / Max: 680.58Min: 57.91 / Avg: 595.98 / Max: 703.76Min: 67.07 / Avg: 633.7 / Max: 776.53Min: 175.02 / Avg: 647.82 / Max: 749.74Min: 215.12 / Avg: 658.11 / Max: 751.86Min: 204.9 / Avg: 661.11 / Max: 752.72Min: 65.3 / Avg: 702.37 / Max: 819.281. EPYC 8534PN: Approximate power consumption of 25735 Joules per run.2. EPYC 8534P: Approximate power consumption of 27851 Joules per run.3. Xeon Platinum 8380: Approximate power consumption of 55866 Joules per run.4. EPYC 9754: Approximate power consumption of 35888 Joules per run.5. EPYC 9654: Approximate power consumption of 33885 Joules per run.6. Xeon Platinum 8592+: Approximate power consumption of 45613 Joules per run.7. Xeon Platinum 8490H: Approximate power consumption of 49979 Joules per run.8. Xeon Max 9480: Approximate power consumption of 52203 Joules per run.9. Xeon Max 9468: Approximate power consumption of 57340 Joules per run.10. EPYC 9684X: Approximate power consumption of 39389 Joules per run.11. Xeon Platinum 8380 2P: Approximate power consumption of 74837 Joules per run.12. EPYC 9754 2P: Approximate power consumption of 61183 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 59598 Joules per run.14. Xeon Platinum 8592+ 2P: Approximate power consumption of 71397 Joules per run.15. Xeon Platinum 8490H 2P: Approximate power consumption of 77954 Joules per run.16. Xeon Max 9480 2P: Approximate power consumption of 80728 Joules per run.17. Xeon Max 9468 2P: Approximate power consumption of 83521 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 65789 Joules per run.

QMCPACK

QMCPACK is a modern high-performance open-source Quantum Monte Carlo (QMC) simulation code making use of MPI for this benchmark of the H20 example code. QMCPACK is an open-source production level many-body ab initio Quantum Monte Carlo code for computing the electronic structure of atoms, molecules, and solids. QMCPACK is supported by the U.S. Department of Energy. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Execution Time - Seconds, Fewer Is BetterQMCPACK 3.17.1Input: Li2_STO_aeEPYC 9684X 2PEPYC 9684XXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9654 2PXeon Platinum 8592+Xeon Max 9480 2PEPYC 9654Xeon Platinum 8490HEPYC 9754EPYC 9754 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PEPYC 8534PEPYC 8534PNXeon Platinum 83804080120160200SE +/- 0.06, N = 3SE +/- 1.06, N = 3SE +/- 0.93, N = 3SE +/- 1.11, N = 3SE +/- 0.88, N = 3SE +/- 0.23, N = 3SE +/- 1.03, N = 3SE +/- 1.11, N = 5SE +/- 0.54, N = 3SE +/- 0.89, N = 3SE +/- 0.63, N = 3SE +/- 0.42, N = 3SE +/- 1.04, N = 3SE +/- 1.20, N = 3SE +/- 0.50, N = 3SE +/- 1.13, N = 3SE +/- 0.40, N = 3SE +/- 1.47, N = 791.9797.0097.91101.63102.12102.98105.98106.27108.02109.30110.80111.15117.81121.19131.37137.23151.27163.751. (CXX) g++ options: -fopenmp -foffload=disable -finline-limit=1000 -fstrict-aliasing -funroll-all-loops -ffast-math -march=native -O3 -lm -ldl
OpenBenchmarking.orgWatts, Fewer Is BetterQMCPACK 3.17.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon Platinum 8380EPYC 9654EPYC 9754Xeon Max 9468Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 9684XXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P140280420560700Min: 17.04 / Avg: 132.24 / Max: 137.56Min: 17.96 / Avg: 154.43 / Max: 159.92Min: 53.73 / Avg: 263.86 / Max: 290.45Min: 28.38 / Avg: 316.1 / Max: 334.43Min: 21.99 / Avg: 319.33 / Max: 338.99Min: 75.52 / Avg: 323.64 / Max: 364.79Min: 23.78 / Avg: 335.13 / Max: 377.2Min: 59.34 / Avg: 337.54 / Max: 376.68Min: 80.16 / Avg: 338.77 / Max: 371.37Min: 33.88 / Avg: 391.36 / Max: 409.49Min: 104.4 / Avg: 524.73 / Max: 581.03Min: 44.37 / Avg: 628.81 / Max: 690.2Min: 54.02 / Avg: 635.44 / Max: 688.42Min: 63.82 / Avg: 660.86 / Max: 753.6Min: 169.74 / Avg: 670.52 / Max: 753.5Min: 208.9 / Avg: 673.9 / Max: 748.46Min: 206.85 / Avg: 676.4 / Max: 753.87Min: 66.83 / Avg: 767.28 / Max: 818.971. EPYC 8534PN: Approximate power consumption of 20629 Joules per run.2. EPYC 8534P: Approximate power consumption of 21929 Joules per run.3. Xeon Platinum 8380: Approximate power consumption of 44403 Joules per run.4. EPYC 9654: Approximate power consumption of 35614 Joules per run.5. EPYC 9754: Approximate power consumption of 37149 Joules per run.6. Xeon Max 9468: Approximate power consumption of 40886 Joules per run.7. Xeon Platinum 8592+: Approximate power consumption of 37423 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 38705 Joules per run.9. Xeon Max 9480: Approximate power consumption of 41781 Joules per run.10. EPYC 9684X: Approximate power consumption of 39788 Joules per run.11. Xeon Platinum 8380 2P: Approximate power consumption of 71713 Joules per run.12. EPYC 9754 2P: Approximate power consumption of 77343 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 70533 Joules per run.14. Xeon Platinum 8592+ 2P: Approximate power consumption of 70712 Joules per run.15. Xeon Platinum 8490H 2P: Approximate power consumption of 73534 Joules per run.16. Xeon Max 9468 2P: Approximate power consumption of 73455 Joules per run.17. Xeon Max 9480 2P: Approximate power consumption of 76704 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 76728 Joules per run.

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelXeon Platinum 8592+EPYC 9754Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PEPYC 9754 2PEPYC 8534PNXeon Max 9468 2PXeon Max 9480 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2PEPYC 9654EPYC 9684XEPYC 9654 2PEPYC 9684X 2P30060090012001500SE +/- 0.74, N = 3SE +/- 1.91, N = 3SE +/- 4.07, N = 3SE +/- 0.94, N = 3SE +/- 2.36, N = 15SE +/- 0.96, N = 3SE +/- 2.55, N = 3SE +/- 1.73, N = 3SE +/- 2.21, N = 3SE +/- 3.54, N = 3SE +/- 5.48, N = 3SE +/- 3.59, N = 15SE +/- 5.57, N = 13SE +/- 6.06, N = 3SE +/- 0.63, N = 3SE +/- 0.61, N = 3SE +/- 3.30, N = 3SE +/- 6.08, N = 15SE +/- 9.04, N = 12SE +/- 13.72, N = 15SE +/- 19.12, N = 12SE +/- 1.59, N = 3302.27319.35327.88329.04345.94352.74363.35380.90382.11388.74397.43443.96460.67475.25515.08562.40587.00608.09800.23801.961094.261165.931. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8380EPYC 9684XXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2P100200300400500Min: 15.82 / Avg: 105.18 / Max: 117.88Min: 19.36 / Avg: 129.39 / Max: 140.24Min: 43.69 / Avg: 159.26 / Max: 172.23Min: 43.63 / Avg: 190.5 / Max: 207.06Min: 22.2 / Avg: 210.78 / Max: 229.48Min: 26.58 / Avg: 226.63 / Max: 248.05Min: 53.76 / Avg: 239.05 / Max: 256.78Min: 33.01 / Avg: 268.04 / Max: 290.06Min: 107.09 / Avg: 366.41 / Max: 399.46Min: 109.34 / Avg: 411.87 / Max: 447.93Min: 40.33 / Avg: 426.23 / Max: 461.75Min: 99.33 / Avg: 452.18 / Max: 484Min: 57.08 / Avg: 475.82 / Max: 514.33Min: 66.22 / Avg: 538.69 / Max: 582.151. EPYC 8534PN: Approximate power consumption of 6879 Joules per run.2. EPYC 8534P: Approximate power consumption of 8453 Joules per run.3. Xeon 6766E: Approximate power consumption of 10511 Joules per run.4. Xeon 6780E: Approximate power consumption of 12510 Joules per run.5. EPYC 9754: Approximate power consumption of 13701 Joules per run.6. EPYC 9654: Approximate power consumption of 14863 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 15618 Joules per run.8. EPYC 9684X: Approximate power consumption of 17637 Joules per run.9. Xeon 6766E 2P: Approximate power consumption of 24330 Joules per run.10. Xeon 6780E 2P: Approximate power consumption of 27183 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 27705 Joules per run.12. Xeon Platinum 8380 2P: Approximate power consumption of 29482 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 31365 Joules per run.14. EPYC 9684X 2P: Approximate power consumption of 35733 Joules per run.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelXeon Platinum 8592+EPYC 9754Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PEPYC 9754 2PEPYC 8534PNXeon Max 9468 2PXeon Max 9480 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9684X 2P0.74441.48882.23322.97763.722SE +/- 0.008053, N = 3SE +/- 0.018814, N = 3SE +/- 0.038257, N = 3SE +/- 0.008707, N = 3SE +/- 0.019617, N = 15SE +/- 0.007683, N = 3SE +/- 0.019473, N = 3SE +/- 0.011894, N = 3SE +/- 0.015170, N = 3SE +/- 0.023203, N = 3SE +/- 0.034519, N = 3SE +/- 0.018603, N = 15SE +/- 0.027020, N = 13SE +/- 0.026516, N = 3SE +/- 0.002384, N = 3SE +/- 0.001935, N = 3SE +/- 0.009611, N = 3SE +/- 0.016386, N = 15SE +/- 0.020352, N = 15SE +/- 0.013875, N = 12SE +/- 0.016597, N = 12SE +/- 0.001170, N = 33.3083603.1315603.0508503.0392202.8925302.8349802.7524202.6254402.6172102.5727802.5170902.2545302.1746302.1048001.9414401.7780901.7036501.6467401.2517901.2513500.9170430.8576851. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelXeon Platinum 8592+EPYC 9754Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PEPYC 9754 2PEPYC 8534PNXeon Max 9468 2PXeon Max 9480 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2PEPYC 9654EPYC 9684XEPYC 9654 2PEPYC 9684X 2P30060090012001500SE +/- 0.74, N = 3SE +/- 1.91, N = 3SE +/- 4.07, N = 3SE +/- 0.94, N = 3SE +/- 2.36, N = 15SE +/- 0.96, N = 3SE +/- 2.55, N = 3SE +/- 1.73, N = 3SE +/- 2.21, N = 3SE +/- 3.54, N = 3SE +/- 5.48, N = 3SE +/- 3.59, N = 15SE +/- 5.57, N = 13SE +/- 6.06, N = 3SE +/- 0.63, N = 3SE +/- 0.61, N = 3SE +/- 3.30, N = 3SE +/- 6.08, N = 15SE +/- 9.04, N = 12SE +/- 13.72, N = 15SE +/- 19.12, N = 12SE +/- 1.59, N = 3302.27319.35327.88329.04345.94352.74363.35380.90382.11388.74397.43443.96460.67475.25515.08562.40587.00608.09800.23801.961094.261165.931. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PEPYC 8534PNEPYC 8534PXeon Max 9468 2PXeon Max 9480 2PEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P3691215SE +/- 0.01491, N = 4SE +/- 0.00936, N = 3SE +/- 0.00184, N = 3SE +/- 0.00884, N = 3SE +/- 0.01053, N = 3SE +/- 0.00943, N = 3SE +/- 0.00701, N = 3SE +/- 0.01586, N = 15SE +/- 0.01428, N = 15SE +/- 0.01492, N = 3SE +/- 0.01684, N = 6SE +/- 0.00301, N = 3SE +/- 0.00720, N = 3SE +/- 0.00871, N = 3SE +/- 0.01454, N = 15SE +/- 0.02296, N = 15SE +/- 0.04200, N = 3SE +/- 0.03210, N = 15SE +/- 0.04327, N = 3SE +/- 0.04869, N = 15SE +/- 0.11179, N = 3SE +/- 0.07940, N = 31.202981.273681.301731.452801.472491.558211.649191.693071.705791.763531.805731.824432.026592.087802.210203.170643.217813.696025.240515.6642612.1268012.302101. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8380EPYC 9684XXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2P100200300400500Min: 17.47 / Avg: 111.54 / Max: 119.32Min: 16.81 / Avg: 122.1 / Max: 130.96Min: 43.72 / Avg: 141.66 / Max: 149.72Min: 43.54 / Avg: 166.24 / Max: 176.01Min: 19.98 / Avg: 184.69 / Max: 197.9Min: 25.06 / Avg: 230.17 / Max: 246.35Min: 53.65 / Avg: 232.18 / Max: 246.53Min: 35.49 / Avg: 275.71 / Max: 296Min: 104.72 / Avg: 302.14 / Max: 319.15Min: 108.06 / Avg: 346.02 / Max: 366.29Min: 39.85 / Avg: 399.31 / Max: 425.54Min: 98.39 / Avg: 431.89 / Max: 460.51Min: 57.19 / Avg: 475.21 / Max: 509.74Min: 66.9 / Avg: 542.3 / Max: 581.731. EPYC 8534PN: Approximate power consumption of 7157 Joules per run.2. EPYC 8534P: Approximate power consumption of 7815 Joules per run.3. Xeon 6766E: Approximate power consumption of 9113 Joules per run.4. Xeon 6780E: Approximate power consumption of 10695 Joules per run.5. EPYC 9754: Approximate power consumption of 11833 Joules per run.6. EPYC 9654: Approximate power consumption of 14747 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 14937 Joules per run.8. EPYC 9684X: Approximate power consumption of 17664 Joules per run.9. Xeon 6766E 2P: Approximate power consumption of 19539 Joules per run.10. Xeon 6780E 2P: Approximate power consumption of 22376 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 25556 Joules per run.12. Xeon Platinum 8380 2P: Approximate power consumption of 27785 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 30382 Joules per run.14. EPYC 9684X 2P: Approximate power consumption of 34707 Joules per run.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PEPYC 8534PNEPYC 8534PXeon Max 9468 2PXeon Max 9480 2PEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P2004006008001000SE +/- 10.06, N = 4SE +/- 5.72, N = 3SE +/- 1.09, N = 3SE +/- 4.16, N = 3SE +/- 4.87, N = 3SE +/- 3.90, N = 3SE +/- 2.57, N = 3SE +/- 5.53, N = 15SE +/- 4.99, N = 15SE +/- 4.81, N = 3SE +/- 5.34, N = 6SE +/- 0.91, N = 3SE +/- 1.77, N = 3SE +/- 1.98, N = 3SE +/- 3.02, N = 15SE +/- 2.35, N = 15SE +/- 4.10, N = 3SE +/- 2.41, N = 15SE +/- 1.57, N = 3SE +/- 1.50, N = 15SE +/- 0.77, N = 3SE +/- 0.53, N = 3830.73784.30767.48687.67678.48641.00605.59590.71586.18566.38553.47547.52492.89478.47452.32315.36310.59270.63190.78176.6482.4481.261. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PEPYC 8534PNEPYC 8534PXeon Max 9468 2PXeon Max 9480 2PEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P3691215SE +/- 0.01491, N = 4SE +/- 0.00936, N = 3SE +/- 0.00184, N = 3SE +/- 0.00884, N = 3SE +/- 0.01053, N = 3SE +/- 0.00943, N = 3SE +/- 0.00701, N = 3SE +/- 0.01586, N = 15SE +/- 0.01428, N = 15SE +/- 0.01492, N = 3SE +/- 0.01684, N = 6SE +/- 0.00301, N = 3SE +/- 0.00720, N = 3SE +/- 0.00871, N = 3SE +/- 0.01454, N = 15SE +/- 0.02296, N = 15SE +/- 0.04200, N = 3SE +/- 0.03210, N = 15SE +/- 0.04327, N = 3SE +/- 0.04869, N = 15SE +/- 0.11179, N = 3SE +/- 0.07940, N = 31.202981.273681.301731.452801.472491.558211.649191.693071.705791.763531.805731.824432.026592.087802.210203.170643.217813.696025.240515.6642612.1268012.302101. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9684X 2PXeon Max 9468Xeon 6780EXeon Max 9480Xeon 6780E 2PXeon 6766EXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9654 2PXeon 6766E 2PEPYC 9754EPYC 9754 2PEPYC 8534PNEPYC 8534P246810SE +/- 0.00472, N = 3SE +/- 0.00659, N = 3SE +/- 0.02371, N = 3SE +/- 0.03065, N = 15SE +/- 0.06148, N = 15SE +/- 0.00316, N = 3SE +/- 0.01718, N = 3SE +/- 0.06302, N = 15SE +/- 0.08827, N = 15SE +/- 0.00392, N = 3SE +/- 0.01103, N = 3SE +/- 0.02282, N = 3SE +/- 0.00782, N = 3SE +/- 0.03283, N = 3SE +/- 0.03084, N = 3SE +/- 0.02608, N = 3SE +/- 0.06624, N = 3SE +/- 0.56391, N = 15SE +/- 0.06745, N = 3SE +/- 0.07124, N = 3SE +/- 0.03354, N = 3SE +/- 0.06404, N = 132.169662.796942.802633.349663.431253.465713.575433.807924.575814.597034.647574.748594.807255.022675.346565.391235.984366.143277.633377.840657.860157.873251. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654EPYC 9684XXeon 6780E 2PXeon 6766E 2PXeon Platinum 8380EPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380 2P60120180240300Min: 15.64 / Avg: 68.55 / Max: 73.08Min: 16.9 / Avg: 70.5 / Max: 76.74Min: 43.7 / Avg: 85.81 / Max: 89.61Min: 43.39 / Avg: 88.68 / Max: 93.08Min: 20.82 / Avg: 94.1 / Max: 99.49Min: 26.07 / Avg: 125.08 / Max: 132.3Min: 34.63 / Avg: 146.68 / Max: 155.53Min: 105.79 / Avg: 152.81 / Max: 159.65Min: 75.92 / Avg: 152.85 / Max: 173.61Min: 52.27 / Avg: 202.48 / Max: 217.49Min: 40.98 / Avg: 208.45 / Max: 223.35Min: 58.06 / Avg: 256.93 / Max: 271.34Min: 34.94 / Avg: 287.83 / Max: 306.6Min: 99.68 / Avg: 289.97 / Max: 319.081. EPYC 8534PN: Approximate power consumption of 4433 Joules per run.2. EPYC 8534P: Approximate power consumption of 4583 Joules per run.3. Xeon 6766E: Approximate power consumption of 5606 Joules per run.4. Xeon 6780E: Approximate power consumption of 5794 Joules per run.5. EPYC 9754: Approximate power consumption of 6148 Joules per run.6. EPYC 9654: Approximate power consumption of 8130 Joules per run.7. EPYC 9684X: Approximate power consumption of 9534 Joules per run.8. Xeon 6780E 2P: Approximate power consumption of 10034 Joules per run.9. Xeon 6766E 2P: Approximate power consumption of 10007 Joules per run.10. Xeon Platinum 8380: Approximate power consumption of 13148 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 13549 Joules per run.12. EPYC 9654 2P: Approximate power consumption of 16700 Joules per run.13. EPYC 9684X 2P: Approximate power consumption of 18767 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 18848 Joules per run.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9684X 2PXeon Max 9468Xeon 6780EXeon Max 9480Xeon 6780E 2PXeon 6766EXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PXeon 6766E 2PEPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PNEPYC 8534P100200300400500SE +/- 1.00, N = 3SE +/- 0.84, N = 3SE +/- 3.01, N = 3SE +/- 2.62, N = 15SE +/- 4.93, N = 15SE +/- 0.26, N = 3SE +/- 1.35, N = 3SE +/- 4.17, N = 15SE +/- 3.95, N = 15SE +/- 0.17, N = 3SE +/- 0.51, N = 3SE +/- 1.00, N = 3SE +/- 0.35, N = 3SE +/- 1.31, N = 3SE +/- 1.08, N = 3SE +/- 0.89, N = 3SE +/- 11.98, N = 15SE +/- 1.86, N = 3SE +/- 1.16, N = 3SE +/- 1.15, N = 3SE +/- 0.54, N = 3SE +/- 0.98, N = 13460.78357.36356.76298.67292.52288.47279.64263.52219.53217.45215.13210.37207.94199.08187.01185.46178.11167.11131.00127.54127.21127.091. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9684X 2PXeon Max 9468Xeon 6780EXeon Max 9480Xeon 6780E 2PXeon 6766EXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9654 2PXeon 6766E 2PEPYC 9754EPYC 9754 2PEPYC 8534PNEPYC 8534P246810SE +/- 0.00472, N = 3SE +/- 0.00659, N = 3SE +/- 0.02371, N = 3SE +/- 0.03065, N = 15SE +/- 0.06148, N = 15SE +/- 0.00316, N = 3SE +/- 0.01718, N = 3SE +/- 0.06302, N = 15SE +/- 0.08827, N = 15SE +/- 0.00392, N = 3SE +/- 0.01103, N = 3SE +/- 0.02282, N = 3SE +/- 0.00782, N = 3SE +/- 0.03283, N = 3SE +/- 0.03084, N = 3SE +/- 0.02608, N = 3SE +/- 0.06624, N = 3SE +/- 0.56391, N = 15SE +/- 0.06745, N = 3SE +/- 0.07124, N = 3SE +/- 0.03354, N = 3SE +/- 0.06404, N = 132.169662.796942.802633.349663.431253.465713.575433.807924.575814.597034.647574.748594.807255.022675.346565.391235.984366.143277.633377.840657.860157.873251. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUXeon Platinum 8592+Xeon Max 9468Xeon Max 9468 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9480EPYC 9654 2PXeon Max 9480 2PEPYC 9754 2PXeon Platinum 8490HEPYC 9684XXeon Platinum 8380 2PEPYC 8534PNEPYC 9654EPYC 8534PEPYC 9754Xeon Platinum 8380Xeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P60120180240300SE +/- 0.09, N = 3SE +/- 0.18, N = 3SE +/- 0.10, N = 3SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.44, N = 15SE +/- 0.06, N = 3SE +/- 1.90, N = 15SE +/- 0.01, N = 3SE +/- 1.22, N = 15SE +/- 0.14, N = 3SE +/- 0.41, N = 3SE +/- 2.90, N = 15SE +/- 0.19, N = 3SE +/- 6.97, N = 15SE +/- 0.92, N = 3SE +/- 0.15, N = 3SE +/- 0.34, N = 3SE +/- 0.25, N = 3SE +/- 0.07, N = 339.6241.9342.1643.4143.7745.7859.6963.9864.9185.86100.39110.91113.70156.59157.45161.48230.24236.81266.91274.52283.83293.021. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon 6766EXeon Platinum 8380Xeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2P140280420560700Min: 16.08 / Avg: 138.77 / Max: 151.09Min: 19.75 / Avg: 155.49 / Max: 170.23Min: 34.28 / Avg: 219.81 / Max: 297.36Min: 43.7 / Avg: 221.35 / Max: 243.97Min: 51.68 / Avg: 253.57 / Max: 279.32Min: 43.59 / Avg: 263.16 / Max: 290.9Min: 20.51 / Avg: 267.71 / Max: 344.82Min: 28.22 / Avg: 304.28 / Max: 347.63Min: 59.06 / Avg: 327.33 / Max: 376.83Min: 75.73 / Avg: 330.51 / Max: 371.12Min: 74.3 / Avg: 331.92 / Max: 379.36Min: 34.13 / Avg: 363.03 / Max: 408.76Min: 104.28 / Avg: 438.97 / Max: 506.66Min: 101.92 / Avg: 505.26 / Max: 553.92Min: 106.87 / Avg: 515.24 / Max: 592.9Min: 83.28 / Avg: 525.5 / Max: 710.63Min: 40.79 / Avg: 578.55 / Max: 688.18Min: 55.49 / Avg: 628.28 / Max: 705.07Min: 166.26 / Avg: 657.43 / Max: 746.56Min: 198.61 / Avg: 661.77 / Max: 760.61Min: 197.25 / Avg: 664.45 / Max: 750.81Min: 69.94 / Avg: 750.87 / Max: 819.031. EPYC 8534PN: Approximate power consumption of 9112 Joules per run.2. EPYC 8534P: Approximate power consumption of 10314 Joules per run.3. Xeon Platinum 8592+: Approximate power consumption of 14361 Joules per run.4. Xeon 6766E: Approximate power consumption of 14757 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 16651 Joules per run.6. Xeon 6780E: Approximate power consumption of 17544 Joules per run.7. EPYC 9754: Approximate power consumption of 17919 Joules per run.8. EPYC 9654: Approximate power consumption of 20042 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 21495 Joules per run.10. Xeon Max 9468: Approximate power consumption of 21593 Joules per run.11. Xeon Max 9480: Approximate power consumption of 21685 Joules per run.12. EPYC 9684X: Approximate power consumption of 23912 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 31313 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 33178 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 36239 Joules per run.16. Xeon Platinum 8592+ 2P: Approximate power consumption of 35033 Joules per run.17. EPYC 9754 2P: Approximate power consumption of 39033 Joules per run.18. EPYC 9654 2P: Approximate power consumption of 41592 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 43391 Joules per run.20. Xeon Max 9480 2P: Approximate power consumption of 43897 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 43411 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 49808 Joules per run.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684XXeon Platinum 8592+EPYC 9654Xeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 9754Xeon 6780E 2PXeon 6766E 2PEPYC 8534PNEPYC 8534PXeon Platinum 8380 2PXeon 6780EXeon 6766EXeon Platinum 83802004006008001000SE +/- 2.17, N = 3SE +/- 20.94, N = 15SE +/- 5.47, N = 15SE +/- 1.42, N = 3SE +/- 0.69, N = 3SE +/- 0.55, N = 3SE +/- 1.28, N = 3SE +/- 5.20, N = 15SE +/- 0.95, N = 3SE +/- 7.13, N = 15SE +/- 0.52, N = 3SE +/- 0.04, N = 3SE +/- 1.23, N = 3SE +/- 13.40, N = 15SE +/- 0.34, N = 3SE +/- 0.07, N = 3SE +/- 0.56, N = 3SE +/- 0.25, N = 3SE +/- 0.23, N = 3SE +/- 0.05, N = 3SE +/- 0.09, N = 3SE +/- 0.34, N = 31095.79750.96750.11736.23654.84569.60568.81433.06403.20306.27301.30298.56285.95283.18261.64245.27204.05197.91175.72134.77126.6484.301. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8380Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9480EPYC 9684XEPYC 9684X 2PXeon 6780EXeon Max 9468 2PXeon 6766EXeon 6766E 2PXeon Max 9480 2PEPYC 9654EPYC 9654 2PXeon 6780E 2PEPYC 9754EPYC 8534PEPYC 8534PNEPYC 9754 2P3691215SE +/- 0.01631, N = 3SE +/- 0.15083, N = 15SE +/- 0.03075, N = 3SE +/- 0.04594, N = 3SE +/- 0.08423, N = 15SE +/- 0.03218, N = 3SE +/- 0.06596, N = 15SE +/- 0.06620, N = 3SE +/- 0.02661, N = 3SE +/- 0.01742, N = 3SE +/- 0.02008, N = 3SE +/- 0.02902, N = 3SE +/- 0.02403, N = 3SE +/- 0.02533, N = 3SE +/- 0.06105, N = 3SE +/- 0.08751, N = 5SE +/- 0.01221, N = 3SE +/- 0.80628, N = 15SE +/- 0.01807, N = 3SE +/- 0.03478, N = 3SE +/- 0.07964, N = 3SE +/- 0.20120, N = 153.696494.295314.499764.804185.164805.551015.677005.919616.166686.171906.746307.041117.164407.326107.532597.885849.7461410.5857111.1392011.2047011.2864011.577401. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon 6766E 2PEPYC 9684XXeon 6780E 2PXeon Platinum 8380EPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380 2P60120180240300Min: 15.72 / Avg: 69.12 / Max: 74.02Min: 16.03 / Avg: 72.08 / Max: 76.76Min: 43.72 / Avg: 86.91 / Max: 91.46Min: 43.54 / Avg: 90.3 / Max: 95.5Min: 20.73 / Avg: 94.62 / Max: 100.76Min: 27.83 / Avg: 127.32 / Max: 135.72Min: 103.86 / Avg: 148.82 / Max: 155.68Min: 34.75 / Avg: 149.45 / Max: 159.93Min: 105.25 / Avg: 166.09 / Max: 183.4Min: 52.71 / Avg: 203.23 / Max: 218.58Min: 39.34 / Avg: 208.62 / Max: 222.38Min: 55.76 / Avg: 257.41 / Max: 272.32Min: 65.9 / Avg: 291.34 / Max: 308.52Min: 97.22 / Avg: 292.43 / Max: 327.641. EPYC 8534PN: Approximate power consumption of 4562 Joules per run.2. EPYC 8534P: Approximate power consumption of 4733 Joules per run.3. Xeon 6766E: Approximate power consumption of 5765 Joules per run.4. Xeon 6780E: Approximate power consumption of 5990 Joules per run.5. EPYC 9754: Approximate power consumption of 6245 Joules per run.6. EPYC 9654: Approximate power consumption of 8301 Joules per run.7. Xeon 6766E 2P: Approximate power consumption of 9872 Joules per run.8. EPYC 9684X: Approximate power consumption of 9814 Joules per run.9. Xeon 6780E 2P: Approximate power consumption of 11051 Joules per run.10. Xeon Platinum 8380: Approximate power consumption of 13345 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 13686 Joules per run.12. EPYC 9654 2P: Approximate power consumption of 16818 Joules per run.13. EPYC 9684X 2P: Approximate power consumption of 18937 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 19183 Joules per run.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8380Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9480EPYC 9684XEPYC 9684X 2PXeon 6780EXeon Max 9468 2PXeon 6766EXeon 6766E 2PXeon Max 9480 2PEPYC 9654Xeon 6780E 2PEPYC 9654 2PEPYC 9754EPYC 8534PEPYC 8534PNEPYC 9754 2P60120180240300SE +/- 1.19, N = 3SE +/- 8.14, N = 15SE +/- 1.50, N = 3SE +/- 1.97, N = 3SE +/- 3.16, N = 15SE +/- 1.05, N = 3SE +/- 2.01, N = 15SE +/- 1.88, N = 3SE +/- 0.70, N = 3SE +/- 0.46, N = 3SE +/- 0.44, N = 3SE +/- 0.58, N = 3SE +/- 0.47, N = 3SE +/- 0.47, N = 3SE +/- 1.08, N = 3SE +/- 1.37, N = 5SE +/- 8.91, N = 15SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 0.28, N = 3SE +/- 0.63, N = 3SE +/- 1.43, N = 15270.33236.65222.03207.93194.15180.03176.33168.86162.09161.95148.11141.95139.45136.39132.71126.82103.89102.5789.7489.2188.5786.691. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8380Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9480EPYC 9684XEPYC 9684X 2PXeon 6780EXeon Max 9468 2PXeon 6766EXeon 6766E 2PXeon Max 9480 2PEPYC 9654EPYC 9654 2PXeon 6780E 2PEPYC 9754EPYC 8534PEPYC 8534PNEPYC 9754 2P3691215SE +/- 0.01631, N = 3SE +/- 0.15083, N = 15SE +/- 0.03075, N = 3SE +/- 0.04594, N = 3SE +/- 0.08423, N = 15SE +/- 0.03218, N = 3SE +/- 0.06596, N = 15SE +/- 0.06620, N = 3SE +/- 0.02661, N = 3SE +/- 0.01742, N = 3SE +/- 0.02008, N = 3SE +/- 0.02902, N = 3SE +/- 0.02403, N = 3SE +/- 0.02533, N = 3SE +/- 0.06105, N = 3SE +/- 0.08751, N = 5SE +/- 0.01221, N = 3SE +/- 0.80628, N = 15SE +/- 0.01807, N = 3SE +/- 0.03478, N = 3SE +/- 0.07964, N = 3SE +/- 0.20120, N = 153.696494.295314.499764.804185.164805.551015.677005.919616.166686.171906.746307.041117.164407.326107.532597.885849.7461410.5857111.1392011.2047011.2864011.577401. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: GoogLeNetXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9754Xeon Max 9480 2PXeon Platinum 8490HEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+EPYC 9684XXeon Platinum 8380 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2PXeon Max 9480Xeon Max 9468Xeon 6780E 2PEPYC 8534PXeon 6766E 2PXeon Platinum 8380EPYC 8534PNXeon 6780EXeon 6766E110220330440550SE +/- 4.87, N = 3SE +/- 2.68, N = 3SE +/- 10.93, N = 12SE +/- 4.80, N = 3SE +/- 0.24, N = 3SE +/- 3.87, N = 15SE +/- 2.29, N = 3SE +/- 2.30, N = 3SE +/- 2.76, N = 15SE +/- 0.69, N = 3SE +/- 1.02, N = 3SE +/- 1.11, N = 3SE +/- 0.51, N = 3SE +/- 1.91, N = 3SE +/- 1.67, N = 3SE +/- 2.49, N = 3SE +/- 0.04, N = 3SE +/- 3.73, N = 4SE +/- 0.16, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.31, N = 3528.93501.39462.79449.91448.46447.61447.50423.59406.58402.78401.84397.44391.40386.00375.73335.38308.46301.46290.27287.42281.62260.83
OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: GoogLeNetEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9684XXeon 6766EXeon Max 9480Xeon 6780EXeon Max 9468Xeon Platinum 8380Xeon Platinum 8592+ 2PEPYC 9754 2PXeon Platinum 8490H 2PXeon Platinum 8380 2PEPYC 9654 2PXeon 6766E 2PXeon 6780E 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2P0.51081.02161.53242.04322.5542.2702.1151.8961.6201.5031.3851.3051.2981.1701.1471.1411.1380.9360.9320.8330.8320.7750.7430.7260.6900.6840.666
OpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.16.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EXeon Platinum 8380EPYC 9654Xeon Platinum 8592+EPYC 9684XXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon 6766E 2PEPYC 9754 2PXeon 6780E 2PXeon Platinum 8380 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P130260390520650Min: 17.59 / Avg: 126.6 / Max: 137.81Min: 18.95 / Avg: 145.84 / Max: 158.71Min: 43.66 / Avg: 200.89 / Max: 222.56Min: 21.26 / Avg: 244.09 / Max: 296.43Min: 43.42 / Avg: 245.54 / Max: 272.59Min: 53.8 / Avg: 255 / Max: 274.03Min: 27.68 / Avg: 276.32 / Max: 312.83Min: 33.46 / Avg: 281.92 / Max: 317.12Min: 30.3 / Avg: 311.48 / Max: 350.99Min: 58.65 / Avg: 323.79 / Max: 362.41Min: 73.87 / Avg: 329.22 / Max: 366.78Min: 79.85 / Avg: 329.98 / Max: 363.65Min: 105.28 / Avg: 405.89 / Max: 469.79Min: 40.92 / Avg: 426.33 / Max: 487.57Min: 107.92 / Avg: 461.73 / Max: 537.33Min: 103.67 / Avg: 483.98 / Max: 536.18Min: 57.21 / Avg: 518.78 / Max: 576.81Min: 82.2 / Avg: 535.58 / Max: 613.03Min: 65.43 / Avg: 587.49 / Max: 655.55Min: 161.35 / Avg: 635.04 / Max: 705.2Min: 201.04 / Avg: 651.98 / Max: 714.73Min: 201.04 / Avg: 653.82 / Max: 709.071. EPYC 8534PN: Approximate power consumption of 13546 Joules per run.2. EPYC 8534P: Approximate power consumption of 14584 Joules per run.3. Xeon 6766E: Approximate power consumption of 23572 Joules per run.4. EPYC 9754: Approximate power consumption of 16964 Joules per run.5. Xeon 6780E: Approximate power consumption of 26846 Joules per run.6. Xeon Platinum 8380: Approximate power consumption of 26775 Joules per run.7. EPYC 9654: Approximate power consumption of 19508 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 20862 Joules per run.9. EPYC 9684X: Approximate power consumption of 23921 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 22881 Joules per run.11. Xeon Max 9468: Approximate power consumption of 27215 Joules per run.12. Xeon Max 9480: Approximate power consumption of 26618 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 42821 Joules per run.14. EPYC 9754 2P: Approximate power consumption of 34959 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 43711 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 38073 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 40811 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 34813 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 47195 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 39584 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 46726 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 46857 Joules per run.

OSPRay

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/ao/real_timeEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon 6780E 2PEPYC 9754Xeon Max 9480 2PXeon 6766E 2PEPYC 9684XXeon Platinum 8592+Xeon Max 9468 2PEPYC 9654Xeon Platinum 8490HXeon 6780EXeon 6766EXeon Max 9480EPYC 8534PXeon Platinum 8380 2PEPYC 8534PNXeon Max 9468Xeon Platinum 83801326395265SE +/- 0.01800, N = 3SE +/- 0.02899, N = 3SE +/- 0.07203, N = 3SE +/- 0.01406, N = 3SE +/- 0.02269, N = 3SE +/- 0.03595, N = 3SE +/- 0.03039, N = 3SE +/- 0.00297, N = 3SE +/- 0.03817, N = 3SE +/- 0.01754, N = 3SE +/- 0.01144, N = 3SE +/- 0.01945, N = 3SE +/- 0.01424, N = 3SE +/- 0.00975, N = 3SE +/- 0.01225, N = 3SE +/- 0.02488, N = 3SE +/- 0.01050, N = 3SE +/- 0.02190, N = 3SE +/- 0.03319, N = 3SE +/- 0.04390, N = 3SE +/- 0.03513, N = 3SE +/- 0.05948, N = 356.6936055.3382054.1195047.6143038.2235036.5043035.2461033.1125032.9663032.5188030.8404029.5018028.0956021.9324021.6222019.5159018.5533017.9668017.8269016.4504016.050209.77764
OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 3.1Benchmark: particle_volume/ao/real_timeEPYC 8534PNEPYC 8534PEPYC 9754Xeon 6766EEPYC 9654EPYC 9754 2PXeon 6780EXeon Platinum 8592+Xeon 6766E 2PEPYC 9684XXeon Platinum 8592+ 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380Xeon Platinum 8380 2P0.0290.0580.0870.1160.1450.1290.1210.1140.1070.0960.0950.0920.0910.0870.0850.0800.0790.0790.0720.0650.0600.0560.0560.0490.0430.0370.034
OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 3.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Platinum 8380Xeon Max 9468EPYC 9654EPYC 9754Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+Xeon 6766E 2PEPYC 9684XXeon 6780E 2PXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9684X 2P140280420560700Min: 16.71 / Avg: 127.12 / Max: 134.69Min: 17.75 / Avg: 148.12 / Max: 155.49Min: 43.7 / Avg: 183.09 / Max: 194.2Min: 43.56 / Avg: 235.42 / Max: 250.81Min: 53.36 / Avg: 261.49 / Max: 284.07Min: 74.5 / Avg: 268.43 / Max: 329.84Min: 28.62 / Avg: 291.85 / Max: 303.75Min: 23.11 / Avg: 308.84 / Max: 321.58Min: 78.47 / Avg: 334.1 / Max: 367.59Min: 59.83 / Avg: 336.31 / Max: 366.79Min: 35 / Avg: 338.48 / Max: 364.64Min: 106.01 / Avg: 377.24 / Max: 400.35Min: 36.05 / Avg: 383.1 / Max: 399.03Min: 108.67 / Avg: 463.55 / Max: 488.13Min: 103.11 / Avg: 521.41 / Max: 554.74Min: 42.49 / Avg: 596.49 / Max: 627.65Min: 60.35 / Avg: 600.41 / Max: 624.73Min: 77.58 / Avg: 677.36 / Max: 715.65Min: 195.3 / Avg: 681.19 / Max: 725.09Min: 176.11 / Avg: 681.46 / Max: 714.09Min: 200.34 / Avg: 682.67 / Max: 705.07Min: 61.93 / Avg: 764.28 / Max: 797.271. EPYC 8534PN: Approximate power consumption of 12754 Joules per run.2. EPYC 8534P: Approximate power consumption of 14664 Joules per run.3. Xeon 6766E: Approximate power consumption of 18065 Joules per run.4. Xeon 6780E: Approximate power consumption of 22914 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 28328 Joules per run.6. Xeon Max 9468: Approximate power consumption of 27111 Joules per run.7. EPYC 9654: Approximate power consumption of 36384 Joules per run.8. EPYC 9754: Approximate power consumption of 44885 Joules per run.9. Xeon Max 9480: Approximate power consumption of 33187 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 32622 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 41295 Joules per run.12. Xeon 6766E 2P: Approximate power consumption of 45772 Joules per run.13. EPYC 9684X: Approximate power consumption of 45845 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 67214 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 51967 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 74163 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 78253 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 85800 Joules per run.19. Xeon Max 9480 2P: Approximate power consumption of 78791 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 96994 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 84423 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 95026 Joules per run.

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8380Xeon Platinum 8490HXeon Max 9468Xeon Platinum 8592+ 2PXeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon 6780EXeon 6766EEPYC 9654EPYC 9684XEPYC 8534PEPYC 8534PNEPYC 9754Xeon 6780E 2PXeon 6766E 2PEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2P306090120150SE +/- 0.10, N = 3SE +/- 0.38, N = 3SE +/- 0.12, N = 3SE +/- 0.55, N = 15SE +/- 0.35, N = 3SE +/- 0.55, N = 15SE +/- 0.25, N = 3SE +/- 0.28, N = 3SE +/- 0.47, N = 14SE +/- 1.43, N = 15SE +/- 0.51, N = 3SE +/- 0.37, N = 3SE +/- 0.88, N = 8SE +/- 1.34, N = 3SE +/- 1.36, N = 4SE +/- 1.32, N = 5SE +/- 0.77, N = 3SE +/- 0.25, N = 3SE +/- 1.08, N = 3SE +/- 1.60, N = 3SE +/- 2.08, N = 3SE +/- 1.03, N = 343.5449.3950.3554.9658.9459.1860.9364.2969.2069.4572.3178.73101.47102.73112.73114.31120.56122.75133.36137.99148.21155.961. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EEPYC 9654Xeon Platinum 8380EPYC 9684XXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2P110220330440550Min: 16.87 / Avg: 112.11 / Max: 123.24Min: 18.9 / Avg: 123.51 / Max: 135.75Min: 43.64 / Avg: 163.17 / Max: 174.94Min: 20.25 / Avg: 189.72 / Max: 207.12Min: 43.43 / Avg: 192.41 / Max: 207.48Min: 25.1 / Avg: 234.83 / Max: 253.99Min: 48.27 / Avg: 242.83 / Max: 266.43Min: 34.28 / Avg: 276.26 / Max: 300.81Min: 103.87 / Avg: 332.75 / Max: 361.02Min: 105.31 / Avg: 380 / Max: 411.37Min: 40.24 / Avg: 404.21 / Max: 436.31Min: 98.37 / Avg: 446.63 / Max: 480.06Min: 60.04 / Avg: 479.74 / Max: 516.86Min: 67.43 / Avg: 546.46 / Max: 595.031. EPYC 8534PN: Approximate power consumption of 7287 Joules per run.2. EPYC 8534P: Approximate power consumption of 8090 Joules per run.3. Xeon 6766E: Approximate power consumption of 10606 Joules per run.4. EPYC 9754: Approximate power consumption of 12395 Joules per run.5. Xeon 6780E: Approximate power consumption of 12571 Joules per run.6. EPYC 9654: Approximate power consumption of 15235 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 15865 Joules per run.8. EPYC 9684X: Approximate power consumption of 17865 Joules per run.9. Xeon 6766E 2P: Approximate power consumption of 21850 Joules per run.10. Xeon 6780E 2P: Approximate power consumption of 25080 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 26139 Joules per run.12. Xeon Platinum 8380 2P: Approximate power consumption of 29031 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 31023 Joules per run.14. EPYC 9684X 2P: Approximate power consumption of 35520 Joules per run.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8380Xeon Platinum 8490HXeon Max 9468Xeon Platinum 8592+ 2PXeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PXeon 6780EXeon 6766EEPYC 9654EPYC 9684XEPYC 8534PEPYC 8534PNEPYC 9754Xeon 6780E 2PXeon 6766E 2PEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2P612182430SE +/- 0.05084, N = 3SE +/- 0.15605, N = 3SE +/- 0.04802, N = 3SE +/- 0.16821, N = 15SE +/- 0.09991, N = 3SE +/- 0.15263, N = 15SE +/- 0.06818, N = 3SE +/- 0.06825, N = 3SE +/- 0.29451, N = 15SE +/- 0.09595, N = 14SE +/- 0.09768, N = 3SE +/- 0.05969, N = 3SE +/- 0.08554, N = 8SE +/- 0.12519, N = 3SE +/- 0.10588, N = 4SE +/- 0.09781, N = 5SE +/- 0.05314, N = 3SE +/- 0.01654, N = 3SE +/- 0.06011, N = 3SE +/- 0.08454, N = 3SE +/- 0.09575, N = 3SE +/- 0.04207, N = 322.9689020.2495019.8593018.2179016.9672016.9166016.4123015.5555014.4831014.4583013.8295012.701509.860189.736858.874468.752338.295338.146157.499407.248696.749776.412291. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8380Xeon Platinum 8490HXeon Max 9468Xeon Platinum 8592+ 2PXeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon 6780EXeon 6766EEPYC 9654EPYC 9684XEPYC 8534PEPYC 8534PNEPYC 9754Xeon 6780E 2PXeon 6766E 2PEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2P306090120150SE +/- 0.10, N = 3SE +/- 0.38, N = 3SE +/- 0.12, N = 3SE +/- 0.55, N = 15SE +/- 0.35, N = 3SE +/- 0.55, N = 15SE +/- 0.25, N = 3SE +/- 0.28, N = 3SE +/- 0.47, N = 14SE +/- 1.43, N = 15SE +/- 0.51, N = 3SE +/- 0.37, N = 3SE +/- 0.88, N = 8SE +/- 1.34, N = 3SE +/- 1.36, N = 4SE +/- 1.32, N = 5SE +/- 0.77, N = 3SE +/- 0.25, N = 3SE +/- 1.08, N = 3SE +/- 1.60, N = 3SE +/- 2.08, N = 3SE +/- 1.03, N = 343.5449.3950.3554.9658.9459.1860.9364.2969.2069.4572.3178.73101.47102.73112.73114.31120.56122.75133.36137.99148.21155.961. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8380Xeon Platinum 8380 2PEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 8534PEPYC 9754EPYC 8534PNEPYC 9754 2PEPYC 9654 2PXeon 6780EXeon 6780E 2PXeon 6766E 2PXeon 6766E48121620SE +/- 0.00044, N = 3SE +/- 0.05342, N = 3SE +/- 0.00313, N = 3SE +/- 0.00187, N = 3SE +/- 0.00532, N = 3SE +/- 0.10855, N = 15SE +/- 0.05347, N = 4SE +/- 0.02558, N = 3SE +/- 0.04501, N = 3SE +/- 0.28946, N = 12SE +/- 0.03798, N = 3SE +/- 0.04482, N = 3SE +/- 0.18371, N = 12SE +/- 0.02616, N = 3SE +/- 0.02331, N = 3SE +/- 0.02847, N = 3SE +/- 0.26893, N = 15SE +/- 0.06617, N = 3SE +/- 0.07241, N = 3SE +/- 0.14238, N = 15SE +/- 0.07602, N = 3SE +/- 0.08782, N = 33.857743.980134.396494.589124.672694.725304.858185.002225.054275.298448.133268.150928.399699.386819.421779.7113110.2310610.4344015.1057015.1274016.8062016.863101. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorXeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9754Xeon 6766E 2PXeon 6780E 2PEPYC 9654EPYC 9684XEPYC 9754 2PXeon Platinum 8380EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380 2P60120180240300Min: 33.7 / Avg: 65.57 / Max: 67.97Min: 43.48 / Avg: 72.93 / Max: 75.76Min: 16.93 / Avg: 76.89 / Max: 81.74Min: 18.73 / Avg: 83.53 / Max: 88.8Min: 21.68 / Avg: 106.78 / Max: 113.35Min: 103.86 / Avg: 127.8 / Max: 131.15Min: 104.68 / Avg: 138.22 / Max: 146.78Min: 27.15 / Avg: 144.22 / Max: 153.32Min: 28.38 / Avg: 160.26 / Max: 175.87Min: 40.2 / Avg: 219.21 / Max: 234.95Min: 51.72 / Avg: 236.59 / Max: 257.65Min: 57.88 / Avg: 270.43 / Max: 286.65Min: 62.01 / Avg: 306.76 / Max: 325.52Min: 98.64 / Avg: 328.39 / Max: 359.381. Xeon 6766E: Approximate power consumption of 4218 Joules per run.2. Xeon 6780E: Approximate power consumption of 4668 Joules per run.3. EPYC 8534PN: Approximate power consumption of 4895 Joules per run.4. EPYC 8534P: Approximate power consumption of 5374 Joules per run.5. EPYC 9754: Approximate power consumption of 6834 Joules per run.6. Xeon 6766E 2P: Approximate power consumption of 8222 Joules per run.7. Xeon 6780E 2P: Approximate power consumption of 8864 Joules per run.8. EPYC 9654: Approximate power consumption of 9278 Joules per run.9. EPYC 9684X: Approximate power consumption of 10684 Joules per run.10. EPYC 9754 2P: Approximate power consumption of 14015 Joules per run.11. Xeon Platinum 8380: Approximate power consumption of 15221 Joules per run.12. EPYC 9654 2P: Approximate power consumption of 17308 Joules per run.13. EPYC 9684X 2P: Approximate power consumption of 19556 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 21017 Joules per run.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8380Xeon Platinum 8380 2PEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 8534PEPYC 9754EPYC 8534PNEPYC 9754 2PEPYC 9654 2PXeon 6780EXeon 6780E 2PXeon 6766E 2PXeon 6766E60120180240300SE +/- 0.03, N = 3SE +/- 3.39, N = 3SE +/- 0.16, N = 3SE +/- 0.09, N = 3SE +/- 0.25, N = 3SE +/- 4.15, N = 15SE +/- 2.30, N = 4SE +/- 1.02, N = 3SE +/- 1.75, N = 3SE +/- 6.83, N = 12SE +/- 0.58, N = 3SE +/- 0.67, N = 3SE +/- 2.15, N = 12SE +/- 0.30, N = 3SE +/- 0.26, N = 3SE +/- 0.30, N = 3SE +/- 2.46, N = 15SE +/- 0.61, N = 3SE +/- 0.32, N = 3SE +/- 0.60, N = 15SE +/- 0.27, N = 3SE +/- 0.31, N = 3259.19251.31227.42217.88213.99212.92205.89199.90197.85192.81122.95122.68119.56106.53106.13102.9798.6495.8466.2066.1859.5059.301. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8380Xeon Platinum 8380 2PEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 8534PEPYC 9754EPYC 8534PNEPYC 9754 2PEPYC 9654 2PXeon 6780EXeon 6780E 2PXeon 6766E 2PXeon 6766E48121620SE +/- 0.00044, N = 3SE +/- 0.05342, N = 3SE +/- 0.00313, N = 3SE +/- 0.00187, N = 3SE +/- 0.00532, N = 3SE +/- 0.10855, N = 15SE +/- 0.05347, N = 4SE +/- 0.02558, N = 3SE +/- 0.04501, N = 3SE +/- 0.28946, N = 12SE +/- 0.03798, N = 3SE +/- 0.04482, N = 3SE +/- 0.18371, N = 12SE +/- 0.02616, N = 3SE +/- 0.02331, N = 3SE +/- 0.02847, N = 3SE +/- 0.26893, N = 15SE +/- 0.06617, N = 3SE +/- 0.07241, N = 3SE +/- 0.14238, N = 15SE +/- 0.07602, N = 3SE +/- 0.08782, N = 33.857743.980134.396494.589124.672694.725304.858185.002225.054275.298448.133268.150928.399699.386819.421779.7113110.2310610.4344015.1057015.1274016.8062016.863101. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OSPRay Studio

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8380 2PXeon 6780E 2PXeon Platinum 8490HXeon 6766E 2PXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PNXeon 6780EXeon 6766EXeon Platinum 838020K40K60K80K100KSE +/- 47.34, N = 3SE +/- 14.62, N = 3SE +/- 109.43, N = 3SE +/- 16.05, N = 3SE +/- 64.24, N = 3SE +/- 13.86, N = 3SE +/- 312.83, N = 12SE +/- 193.23, N = 3SE +/- 37.55, N = 3SE +/- 42.05, N = 3SE +/- 90.37, N = 3SE +/- 152.29, N = 3SE +/- 605.82, N = 15SE +/- 102.40, N = 3SE +/- 739.02, N = 15SE +/- 64.91, N = 3SE +/- 134.33, N = 3SE +/- 172.59, N = 3SE +/- 346.19, N = 3SE +/- 424.84, N = 3SE +/- 541.85, N = 3SE +/- 175.68, N = 3169601785520750242493341136179373833864538926432905079855247560825802662449625406897372051780938100388579103461
OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754Xeon Platinum 8380EPYC 9654Xeon Platinum 8592+EPYC 9684XXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8380 2PEPYC 9754 2PXeon Platinum 8490H 2PEPYC 9654 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+ 2PEPYC 9684X 2P140280420560700Min: 17.4 / Avg: 117.68 / Max: 142.04Min: 17.98 / Avg: 135.52 / Max: 167.31Min: 43.65 / Avg: 164.56 / Max: 223.84Min: 43.57 / Avg: 204.48 / Max: 283.69Min: 21.62 / Avg: 219.88 / Max: 335.09Min: 54.98 / Avg: 238.47 / Max: 291.29Min: 30.06 / Avg: 244.64 / Max: 330.87Min: 35.11 / Avg: 281.84 / Max: 376.97Min: 30.5 / Avg: 290.44 / Max: 410.63Min: 60.65 / Avg: 292.18 / Max: 377.6Min: 78.44 / Avg: 306.37 / Max: 375.68Min: 69.88 / Avg: 308.64 / Max: 375.21Min: 104.78 / Avg: 311.45 / Max: 486.78Min: 107.48 / Avg: 352.84 / Max: 587.47Min: 102.98 / Avg: 432.31 / Max: 581.57Min: 42.88 / Avg: 522.41 / Max: 691.8Min: 168.48 / Avg: 535.88 / Max: 754.67Min: 60.75 / Avg: 559.19 / Max: 686.72Min: 197.25 / Avg: 571.94 / Max: 754.03Min: 213.26 / Avg: 577.01 / Max: 753.84Min: 79.71 / Avg: 606.49 / Max: 752.52Min: 69.54 / Avg: 653.11 / Max: 822.491. EPYC 8534PN: Approximate power consumption of 11180 Joules per run.2. EPYC 8534P: Approximate power consumption of 12016 Joules per run.3. Xeon 6766E: Approximate power consumption of 17773 Joules per run.4. Xeon 6780E: Approximate power consumption of 20311 Joules per run.5. EPYC 9754: Approximate power consumption of 11800 Joules per run.6. Xeon Platinum 8380: Approximate power consumption of 28378 Joules per run.7. EPYC 9654: Approximate power consumption of 14271 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 18038 Joules per run.9. EPYC 9684X: Approximate power consumption of 15490 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 21134 Joules per run.11. Xeon Max 9480: Approximate power consumption of 23386 Joules per run.12. Xeon Max 9468: Approximate power consumption of 25514 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 26328 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 27168 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 30838 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 38484 Joules per run.17. Xeon Platinum 8490H 2P: Approximate power consumption of 26258 Joules per run.18. EPYC 9654 2P: Approximate power consumption of 46226 Joules per run.19. Xeon Max 9480 2P: Approximate power consumption of 29550 Joules per run.20. Xeon Max 9468 2P: Approximate power consumption of 31543 Joules per run.21. Xeon Platinum 8592+ 2P: Approximate power consumption of 55393 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 48330 Joules per run.

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8380 2PXeon 6780E 2PXeon Platinum 8490HXeon 6766E 2PXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PNXeon 6780EXeon 6766EXeon Platinum 838030K60K90K120K150KSE +/- 28.11, N = 3SE +/- 27.74, N = 3SE +/- 756.08, N = 15SE +/- 47.16, N = 3SE +/- 125.33, N = 3SE +/- 141.04, N = 3SE +/- 50.97, N = 3SE +/- 89.57, N = 3SE +/- 155.80, N = 3SE +/- 231.95, N = 3SE +/- 162.52, N = 3SE +/- 32.38, N = 3SE +/- 176.25, N = 3SE +/- 58.68, N = 3SE +/- 900.17, N = 15SE +/- 65.97, N = 3SE +/- 41.33, N = 3SE +/- 29.36, N = 3SE +/- 13.58, N = 3SE +/- 189.03, N = 3SE +/- 365.52, N = 3SE +/- 623.29, N = 32007120893279433339138813419714294544349452115001959522641886648768006715837336680742842619164392175101444121734
OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754Xeon Platinum 8380EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9684XXeon Max 9480Xeon Max 9468Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2P140280420560700Min: 16.93 / Avg: 120.39 / Max: 142.49Min: 18.47 / Avg: 138.95 / Max: 167.41Min: 43.64 / Avg: 170.07 / Max: 223.38Min: 43.57 / Avg: 212.15 / Max: 289.98Min: 21.87 / Avg: 229.47 / Max: 334.93Min: 52.23 / Avg: 243.3 / Max: 290.85Min: 27.71 / Avg: 254.04 / Max: 331.67Min: 34.02 / Avg: 290.6 / Max: 377.55Min: 59.95 / Avg: 299.76 / Max: 377.1Min: 34.85 / Avg: 304.67 / Max: 411.05Min: 74.4 / Avg: 312.09 / Max: 377.67Min: 69.72 / Avg: 313.73 / Max: 377.15Min: 56.05 / Avg: 325.96 / Max: 489.46Min: 107.91 / Avg: 369.36 / Max: 547.58Min: 105.22 / Avg: 444.93 / Max: 582.81Min: 81.52 / Avg: 518.28 / Max: 753.01Min: 60.79 / Avg: 534.58 / Max: 678.46Min: 43.47 / Avg: 541.66 / Max: 691.2Min: 167.48 / Avg: 554.33 / Max: 756.36Min: 194.1 / Avg: 583.5 / Max: 754.71Min: 204.64 / Avg: 589.92 / Max: 755.25Min: 68.36 / Avg: 672.33 / Max: 821.451. EPYC 8534PN: Approximate power consumption of 13042 Joules per run.2. EPYC 8534P: Approximate power consumption of 14080 Joules per run.3. Xeon 6766E: Approximate power consumption of 20579 Joules per run.4. Xeon 6780E: Approximate power consumption of 23831 Joules per run.5. EPYC 9754: Approximate power consumption of 13615 Joules per run.6. Xeon Platinum 8380: Approximate power consumption of 33251 Joules per run.7. EPYC 9654: Approximate power consumption of 16428 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 21020 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 24680 Joules per run.10. EPYC 9684X: Approximate power consumption of 17976 Joules per run.11. Xeon Max 9480: Approximate power consumption of 27048 Joules per run.12. Xeon Max 9468: Approximate power consumption of 29595 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 30510 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 32257 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 35594 Joules per run.16. Xeon Platinum 8592+ 2P: Approximate power consumption of 24532 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 36494 Joules per run.18. EPYC 9754 2P: Approximate power consumption of 44957 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 29934 Joules per run.20. Xeon Max 9480 2P: Approximate power consumption of 33649 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 35985 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 55579 Joules per run.

Zstd Compression

This test measures the time needed to compress/decompress a sample file (silesia.tar) using Zstd (Zstandard) compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Decompression SpeedEPYC 9684X 2PEPYC 9654EPYC 9684XEPYC 9654 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 8534PNEPYC 9754EPYC 9754 2PXeon Max 9480Xeon Max 9468EPYC 8534PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P30060090012001500SE +/- 1.73, N = 3SE +/- 0.46, N = 3SE +/- 7.31, N = 3SE +/- 2.20, N = 3SE +/- 3.01, N = 4SE +/- 1.88, N = 3SE +/- 1.58, N = 3SE +/- 0.83, N = 3SE +/- 1.83, N = 3SE +/- 1.08, N = 15SE +/- 2.12, N = 3SE +/- 21.23, N = 3SE +/- 0.66, N = 15SE +/- 0.65, N = 15SE +/- 1.75, N = 3SE +/- 4.45, N = 3SE +/- 4.96, N = 3SE +/- 1.74, N = 4SE +/- 5.13, N = 3SE +/- 2.25, N = 3SE +/- 2.22, N = 3SE +/- 5.06, N = 31392.51388.91385.31382.11221.81165.81144.81139.91139.01127.51126.41118.81040.21039.21032.41032.0963.6900.5816.7774.4743.5721.41. (CC) gcc options: -O3 -pthread -lz -llzma
OpenBenchmarking.orgMB/s Per Watt, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Decompression SpeedEPYC 8534PNEPYC 8534PEPYC 9754Xeon 6780EEPYC 9654Xeon 6766EEPYC 9684XXeon Platinum 8380Xeon Platinum 8592+Xeon Platinum 8490HXeon 6780E 2PEPYC 9754 2PXeon 6766E 2PEPYC 9654 2PXeon Max 9468Xeon Max 9480EPYC 9684X 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P51015202520.54619.69814.06513.67913.30812.74611.7119.4398.7056.4656.1625.8755.8455.8185.6165.5485.2924.4544.0082.8282.5202.506
OpenBenchmarking.orgWatts, Fewer Is BetterZstd Compression 1.5.4CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8380EPYC 9684XXeon 6766E 2PXeon 6780E 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 9754 2PXeon Max 9468Xeon Platinum 8380 2PXeon Max 9480EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P80160240320400Min: 16.36 / Avg: 55.72 / Max: 65.47Min: 16.44 / Avg: 56.8 / Max: 67.51Min: 43.62 / Avg: 58.33 / Max: 74.24Min: 43.45 / Avg: 59.7 / Max: 75.66Min: 21.5 / Avg: 81.05 / Max: 92.77Min: 27.93 / Avg: 104.36 / Max: 120.51Min: 50.67 / Avg: 109.38 / Max: 135.43Min: 33.68 / Avg: 118.29 / Max: 136.36Min: 103.62 / Avg: 123.42 / Max: 157.28Min: 104.87 / Avg: 125.62 / Max: 159.28Min: 33.62 / Avg: 140.35 / Max: 172.45Min: 61.06 / Avg: 159.64 / Max: 183.39Min: 38.29 / Avg: 193.87 / Max: 209.99Min: 73.69 / Avg: 200.55 / Max: 225.84Min: 98.06 / Avg: 202.2 / Max: 229.76Min: 75.37 / Avg: 203.22 / Max: 228.29Min: 59.25 / Avg: 237.56 / Max: 259.24Min: 60.19 / Avg: 263.13 / Max: 287.32Min: 76.44 / Avg: 290.84 / Max: 334.48Min: 170.25 / Avg: 340.73 / Max: 371.6Min: 197.43 / Avg: 412.33 / Max: 448.69Min: 203.74 / Avg: 415.14 / Max: 451.391. EPYC 8534PN: Approximate power consumption of 3715 Joules per run.2. EPYC 8534P: Approximate power consumption of 3787 Joules per run.3. Xeon 6766E: Approximate power consumption of 4453 Joules per run.4. Xeon 6780E: Approximate power consumption of 4358 Joules per run.5. EPYC 9754: Approximate power consumption of 5403 Joules per run.6. EPYC 9654: Approximate power consumption of 7584 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 7328 Joules per run.8. EPYC 9684X: Approximate power consumption of 8596 Joules per run.9. Xeon 6766E 2P: Approximate power consumption of 9668 Joules per run.10. Xeon 6780E 2P: Approximate power consumption of 9338 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 10140 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 12718 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 12989 Joules per run.14. Xeon Max 9468: Approximate power consumption of 15175 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 15873 Joules per run.16. Xeon Max 9480: Approximate power consumption of 14239 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 17976 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 20436 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 21231 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 27600 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 28781 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 28202 Joules per run.

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Compression SpeedXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9654EPYC 9684XEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PEPYC 8534PEPYC 8534PNEPYC 9754Xeon Max 9468 2PEPYC 9754 2PXeon Platinum 8380Xeon Max 9480 2PXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2P48121620SE +/- 0.21, N = 4SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.22, N = 3SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 15SE +/- 0.15, N = 3SE +/- 0.17, N = 4SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 15SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.13, N = 15SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.07, N = 318.017.817.217.217.016.815.214.614.514.414.313.913.813.813.813.713.713.311.611.510.610.61. (CC) gcc options: -O3 -pthread -lz -llzma

Speedb

Speedb is a next-generation key value storage engine that is RocksDB compatible and aiming for stability, efficiency, and performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random ReadXeon 6780E 2PEPYC 9754 2PXeon 6766E 2PEPYC 9684X 2PEPYC 9654 2PXeon 6780EXeon 6766EEPYC 9754Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PXeon Platinum 8380 2PXeon Max 9480EPYC 8534PNXeon Max 9468Xeon Platinum 8380300M600M900M1200M1500MSE +/- 2674444.99, N = 3SE +/- 2399164.12, N = 3SE +/- 1272758.30, N = 3SE +/- 5954964.38, N = 3SE +/- 955915.20, N = 3SE +/- 1322733.50, N = 3SE +/- 998087.60, N = 3SE +/- 1606748.01, N = 3SE +/- 5399265.88, N = 15SE +/- 5393159.45, N = 3SE +/- 205170.43, N = 3SE +/- 2955608.21, N = 3SE +/- 66268.38, N = 3SE +/- 8491098.40, N = 15SE +/- 242146.75, N = 3SE +/- 168680.90, N = 3SE +/- 109015.29, N = 3SE +/- 706582.63, N = 3SE +/- 2763560.64, N = 13SE +/- 70537.88, N = 3SE +/- 3698537.65, N = 15SE +/- 232538.80, N = 313241633401169947385115849654610595465338576871796731592175969554945899510705861478715512869585376330344979074904285570544199435703151783812761796172740917782591364662440706742429401102114570481303591451. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s Per Watt, More Is BetterSpeedb 2.7Test: Random ReadXeon 6766EXeon 6766E 2PXeon 6780EXeon 6780E 2PEPYC 8534PNEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 9654EPYC 9654 2PEPYC 9684XEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468Xeon Max 9468 2PXeon Platinum 8380Xeon Platinum 8380 2P500K1000K1500K2000K2500K2531402.052449964.812159153.282130388.242023204.531991742.681962564.721818446.431563545.141511464.501404496.491380809.63962315.70894980.08834970.47834394.35747196.35744809.12680456.82644065.87509439.26506592.64
OpenBenchmarking.orgWatts, Fewer Is BetterSpeedb 2.7CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380EPYC 9654EPYC 9754Xeon Max 9468Xeon 6780EXeon Platinum 8592+Xeon Max 9480Xeon Platinum 8490HEPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9754 2PXeon 6780E 2PXeon Max 9468 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9684X 2P140280420560700Min: 18.13 / Avg: 120.08 / Max: 129.07Min: 18.42 / Avg: 150.73 / Max: 161.26Min: 43.69 / Avg: 235.82 / Max: 270.43Min: 54.55 / Avg: 255.89 / Max: 290.77Min: 29.2 / Avg: 274.09 / Max: 293.61Min: 22.11 / Avg: 296.2 / Max: 318.84Min: 71.79 / Avg: 310.76 / Max: 333.42Min: 43.47 / Avg: 311.77 / Max: 356.67Min: 27.16 / Avg: 327.52 / Max: 377.21Min: 70.78 / Avg: 327.7 / Max: 377.13Min: 54.25 / Avg: 330.77 / Max: 378.66Min: 33.89 / Avg: 382.79 / Max: 411.07Min: 105.77 / Avg: 472.86 / Max: 540.08Min: 103.26 / Avg: 511.53 / Max: 582.64Min: 60.4 / Avg: 567.45 / Max: 609.28Min: 40.77 / Avg: 596.13 / Max: 648.34Min: 107.84 / Avg: 621.56 / Max: 712.89Min: 185.93 / Avg: 652.02 / Max: 753.16Min: 68.16 / Avg: 654.93 / Max: 718.87Min: 168.96 / Avg: 660.7 / Max: 755.23Min: 196.64 / Avg: 666.37 / Max: 752.39Min: 69.56 / Avg: 767.34 / Max: 822.121. EPYC 8534PN: Approximate power consumption of 7725 Joules per run.2. EPYC 8534P: Approximate power consumption of 9647 Joules per run.3. Xeon 6766E: Approximate power consumption of 15171 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 16462 Joules per run.5. EPYC 9654: Approximate power consumption of 17542 Joules per run.6. EPYC 9754: Approximate power consumption of 18957 Joules per run.7. Xeon Max 9468: Approximate power consumption of 19909 Joules per run.8. Xeon 6780E: Approximate power consumption of 20057 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 21180 Joules per run.10. Xeon Max 9480: Approximate power consumption of 21451 Joules per run.11. Xeon Platinum 8490H: Approximate power consumption of 21169 Joules per run.12. EPYC 9684X: Approximate power consumption of 24626 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 30578 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 32908 Joules per run.15. EPYC 9654 2P: Approximate power consumption of 36128 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 38152 Joules per run.17. Xeon 6780E 2P: Approximate power consumption of 39987 Joules per run.18. Xeon Max 9468 2P: Approximate power consumption of 41816 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 42003 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 42946 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 42870 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 48598 Joules per run.

VVenC

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FastEPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9480Xeon Platinum 8490H 2PEPYC 9754Xeon Max 9468EPYC 8534PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PNXeon Platinum 8380 2PXeon Platinum 8380Xeon 6780EXeon 6766E246810SE +/- 0.057, N = 3SE +/- 0.048, N = 3SE +/- 0.023, N = 3SE +/- 0.038, N = 3SE +/- 0.022, N = 3SE +/- 0.033, N = 3SE +/- 0.047, N = 3SE +/- 0.045, N = 3SE +/- 0.010, N = 3SE +/- 0.038, N = 3SE +/- 0.043, N = 15SE +/- 0.081, N = 3SE +/- 0.041, N = 3SE +/- 0.028, N = 3SE +/- 0.010, N = 3SE +/- 0.007, N = 3SE +/- 0.008, N = 37.5477.4317.3926.9606.7196.5016.4806.4656.3246.1186.0776.0236.0005.8775.5834.4404.0521. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects
OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FastEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8592+Xeon Platinum 8380Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P0.01510.03020.04530.06040.07550.0670.0620.0520.0500.0480.0420.0370.0320.0280.0280.0230.0230.0180.0170.0150.0120.012
OpenBenchmarking.orgWatts, Fewer Is BetterVVenC 1.11CPU Power Consumption MonitorXeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8380EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P110220330440550Min: 43.59 / Avg: 78.47 / Max: 122.17Min: 43.46 / Avg: 89.13 / Max: 146.7Min: 15.3 / Avg: 89.82 / Max: 125.64Min: 16.24 / Avg: 99.45 / Max: 145.04Min: 20.88 / Avg: 134.72 / Max: 195.13Min: 27.21 / Avg: 177.95 / Max: 263.84Min: 52.86 / Avg: 196.6 / Max: 265.58Min: 31.5 / Avg: 204.88 / Max: 302.64Min: 26.5 / Avg: 232.82 / Max: 325.56Min: 59.59 / Avg: 242.83 / Max: 330.87Min: 71.41 / Avg: 273.3 / Max: 339.11Min: 84.83 / Avg: 277.48 / Max: 349.11Min: 100.2 / Avg: 328.02 / Max: 463.25Min: 77.27 / Avg: 413.94 / Max: 550.57Min: 154.77 / Avg: 444.48 / Max: 576.57Min: 218.19 / Avg: 515.79 / Max: 625.23Min: 193.59 / Avg: 516.46 / Max: 637.281. Xeon 6766E: Approximate power consumption of 12216 Joules per run.2. Xeon 6780E: Approximate power consumption of 12687 Joules per run.3. EPYC 8534PN: Approximate power consumption of 9641 Joules per run.4. EPYC 8534P: Approximate power consumption of 10476 Joules per run.5. EPYC 9754: Approximate power consumption of 13832 Joules per run.6. EPYC 9654: Approximate power consumption of 15719 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 22215 Joules per run.8. EPYC 9684X: Approximate power consumption of 17825 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 20256 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 23150 Joules per run.11. Xeon Max 9468: Approximate power consumption of 27513 Joules per run.12. Xeon Max 9480: Approximate power consumption of 27193 Joules per run.13. Xeon Platinum 8380 2P: Approximate power consumption of 35973 Joules per run.14. Xeon Platinum 8592+ 2P: Approximate power consumption of 39324 Joules per run.15. Xeon Platinum 8490H 2P: Approximate power consumption of 45189 Joules per run.16. Xeon Max 9468 2P: Approximate power consumption of 55877 Joules per run.17. Xeon Max 9480 2P: Approximate power consumption of 55743 Joules per run.

Video Input: Bosphorus 4K - Video Preset: Fast

EPYC 9684X 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

EPYC 9654 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

EPYC 9754 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

Xeon 6766E 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

Xeon 6780E 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

Zstd Compression

This test measures the time needed to compress/decompress a sample file (silesia.tar) using Zstd (Zstandard) compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Decompression SpeedEPYC 9654EPYC 9684XEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468EPYC 9754 2PEPYC 9754EPYC 8534PEPYC 8534PNXeon Platinum 8490HXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380Xeon Platinum 8490H 2PXeon Platinum 8380 2PXeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P30060090012001500SE +/- 1.17, N = 3SE +/- 1.99, N = 3SE +/- 1.87, N = 3SE +/- 2.93, N = 3SE +/- 0.84, N = 3SE +/- 1.60, N = 3SE +/- 1.45, N = 3SE +/- 0.56, N = 3SE +/- 0.19, N = 3SE +/- 1.95, N = 3SE +/- 2.09, N = 3SE +/- 0.92, N = 3SE +/- 0.43, N = 3SE +/- 1.78, N = 15SE +/- 1.00, N = 3SE +/- 4.15, N = 3SE +/- 3.69, N = 3SE +/- 0.30, N = 3SE +/- 1.05, N = 3SE +/- 1.54, N = 3SE +/- 3.99, N = 3SE +/- 4.61, N = 31328.51324.91324.61321.41242.61189.71133.31131.11104.21102.21101.41096.51069.11046.01041.81018.3992.1912.9797.7753.2739.1701.21. (CC) gcc options: -O3 -pthread -lz -llzma
OpenBenchmarking.orgMB/s Per Watt, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Decompression SpeedEPYC 8534PNEPYC 8534PXeon 6780EXeon 6766EEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8380Xeon Platinum 8592+Xeon Platinum 8490HXeon 6780E 2PXeon 6766E 2PEPYC 9754 2PXeon Max 9468Xeon Max 9480EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P51015202520.79720.51415.03414.31114.04213.26811.6619.8339.2416.9316.3336.0015.8165.7875.6745.6435.0894.6754.1732.9562.5392.512
OpenBenchmarking.orgWatts, Fewer Is BetterZstd Compression 1.5.4CPU Power Consumption MonitorXeon 6766EEPYC 8534PNXeon 6780EEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8380EPYC 9684XXeon 6766E 2PXeon 6780E 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 9754 2PXeon Platinum 8380 2PXeon Max 9468Xeon Max 9480EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P80160240320400Min: 43.63 / Avg: 51.65 / Max: 69.7Min: 15.43 / Avg: 52.72 / Max: 59.1Min: 43.37 / Avg: 53.06 / Max: 71.35Min: 17.05 / Avg: 53.69 / Max: 60.18Min: 18.92 / Avg: 78.5 / Max: 87.36Min: 28.35 / Avg: 100.13 / Max: 109.97Min: 49.33 / Avg: 103.56 / Max: 117.6Min: 33.27 / Avg: 113.62 / Max: 124.55Min: 103.71 / Avg: 116.84 / Max: 150.87Min: 105.69 / Avg: 118.94 / Max: 149.49Min: 33.99 / Avg: 134.46 / Max: 153.43Min: 61.25 / Avg: 154.25 / Max: 170.09Min: 39.89 / Avg: 189.86 / Max: 203.51Min: 96.44 / Avg: 195.29 / Max: 212.05Min: 73.9 / Avg: 195.37 / Max: 210.14Min: 82.48 / Avg: 199.75 / Max: 214.36Min: 57.79 / Avg: 234.74 / Max: 249.39Min: 64.16 / Avg: 259.66 / Max: 276.36Min: 75.89 / Avg: 285.1 / Max: 313.97Min: 172.05 / Avg: 335.67 / Max: 356.47Min: 201.8 / Avg: 412.05 / Max: 436.43Min: 208.83 / Avg: 414.8 / Max: 438.111. Xeon 6766E: Approximate power consumption of 3805 Joules per run.2. EPYC 8534PN: Approximate power consumption of 3550 Joules per run.3. Xeon 6780E: Approximate power consumption of 3714 Joules per run.4. EPYC 8534P: Approximate power consumption of 3615 Joules per run.5. EPYC 9754: Approximate power consumption of 5285 Joules per run.6. EPYC 9654: Approximate power consumption of 8711 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 9596 Joules per run.8. EPYC 9684X: Approximate power consumption of 9734 Joules per run.9. Xeon 6766E 2P: Approximate power consumption of 8646 Joules per run.10. Xeon 6780E 2P: Approximate power consumption of 8484 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 10667 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 13831 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 12784 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 17707 Joules per run.15. Xeon Max 9468: Approximate power consumption of 18365 Joules per run.16. Xeon Max 9480: Approximate power consumption of 18444 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 20423 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 22677 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 22998 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 29875 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 38595 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 40927 Joules per run.

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Compression SpeedXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9684X 2PEPYC 9654EPYC 9654 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8380 2PXeon Max 9468Xeon Max 9480Xeon Max 9468 2PXeon Platinum 8380Xeon Max 9480 2PEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9754 2PXeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P3691215SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 15SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 39.809.678.458.428.388.308.167.947.837.767.727.627.527.466.766.746.686.646.196.105.655.601. (CC) gcc options: -O3 -pthread -lz -llzma

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468EPYC 9684X 2PEPYC 9654 2PXeon Max 9480EPYC 9754 2PXeon Platinum 8490HXeon Platinum 8380 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9654Xeon Platinum 8592+EPYC 8534PXeon Platinum 8380EPYC 8534PNEPYC 9754Xeon 6780E 2PXeon 6766E 2PXeon 6780EXeon 6766E0.3060.6120.9181.2241.53SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 15SE +/- 0.00, N = 3SE +/- 0.00, N = 7SE +/- 0.00, N = 15SE +/- 0.01, N = 3SE +/- 0.00, N = 9SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.280.290.300.330.350.350.370.410.430.450.450.460.480.490.530.560.600.731.091.201.251.361. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8592+Xeon 6780EXeon Platinum 8380Xeon 6766E 2PXeon 6780E 2PEPYC 9754EPYC 9654Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9684XEPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PEPYC 9654 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Max 9480 2PXeon Max 9468 2P120240360480600Min: 16.42 / Avg: 129.12 / Max: 139.81Min: 19.35 / Avg: 152.78 / Max: 164.84Min: 43.65 / Avg: 203.6 / Max: 221.29Min: 33.52 / Avg: 235.56 / Max: 293.33Min: 43.63 / Avg: 241.33 / Max: 263.98Min: 51.57 / Avg: 255.35 / Max: 290.92Min: 104.83 / Avg: 274.08 / Max: 295.37Min: 107.98 / Avg: 302.19 / Max: 331.56Min: 21.53 / Avg: 310.47 / Max: 338.08Min: 26.97 / Avg: 310.58 / Max: 341.7Min: 59.31 / Avg: 328.19 / Max: 373.29Min: 73.52 / Avg: 330.72 / Max: 377.05Min: 83.36 / Avg: 331.78 / Max: 377.93Min: 34.06 / Avg: 367.01 / Max: 400.16Min: 40.6 / Avg: 436.99 / Max: 487.81Min: 81.83 / Avg: 472.9 / Max: 559.21Min: 104.06 / Avg: 507.52 / Max: 580.05Min: 57.78 / Avg: 545.61 / Max: 614.54Min: 169.81 / Avg: 585.54 / Max: 631.87Min: 36.23 / Avg: 623.56 / Max: 689.59Min: 200.92 / Avg: 627.67 / Max: 669.86Min: 201.96 / Avg: 633.47 / Max: 674.771. EPYC 8534PN: Approximate power consumption of 8393 Joules per run.2. EPYC 8534P: Approximate power consumption of 9880 Joules per run.3. Xeon 6766E: Approximate power consumption of 13234 Joules per run.4. Xeon Platinum 8592+: Approximate power consumption of 15311 Joules per run.5. Xeon 6780E: Approximate power consumption of 15767 Joules per run.6. Xeon Platinum 8380: Approximate power consumption of 16512 Joules per run.7. Xeon 6766E 2P: Approximate power consumption of 17906 Joules per run.8. Xeon 6780E 2P: Approximate power consumption of 19743 Joules per run.9. EPYC 9754: Approximate power consumption of 20180 Joules per run.10. EPYC 9654: Approximate power consumption of 20291 Joules per run.11. Xeon Platinum 8490H: Approximate power consumption of 21442 Joules per run.12. Xeon Max 9468: Approximate power consumption of 21387 Joules per run.13. Xeon Max 9480: Approximate power consumption of 21565 Joules per run.14. EPYC 9684X: Approximate power consumption of 23734 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 28501 Joules per run.16. Xeon Platinum 8592+ 2P: Approximate power consumption of 30896 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 33158 Joules per run.18. EPYC 9654 2P: Approximate power consumption of 35319 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 38646 Joules per run.20. EPYC 9684X 2P: Approximate power consumption of 40354 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 40840 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 41176 Joules per run.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon Platinum 8490H 2PEPYC 9684X 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8380 2PXeon Max 9480EPYC 9684XXeon Max 9468EPYC 9654EPYC 9754Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon 6780EEPYC 8534PXeon 6766EXeon Platinum 8592+EPYC 8534PNXeon 6780E 2PXeon 6766E 2PXeon Platinum 838040K80K120K160K200KSE +/- 2494.14, N = 3SE +/- 1640.61, N = 7SE +/- 1422.88, N = 15SE +/- 18.38, N = 3SE +/- 1922.38, N = 15SE +/- 1374.23, N = 9SE +/- 696.52, N = 3SE +/- 1761.33, N = 3SE +/- 162.47, N = 3SE +/- 383.22, N = 3SE +/- 205.87, N = 3SE +/- 89.35, N = 3SE +/- 1158.60, N = 3SE +/- 75.30, N = 3SE +/- 100.17, N = 3SE +/- 86.99, N = 3SE +/- 68.06, N = 3SE +/- 988.12, N = 3SE +/- 55.52, N = 3SE +/- 1067.91, N = 3SE +/- 1048.23, N = 3SE +/- 95.54, N = 3189893.31178488.03176900.32174862.56172688.50166151.42151627.42140144.01138605.52135075.07133779.62132973.43128566.81115106.3091273.0287511.1184584.1381279.7978334.9276895.2975761.5061956.931. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OSPRay Studio

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon 6780E 2PXeon Platinum 8592+Xeon 6766E 2PXeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PXeon 6780EEPYC 8534PNXeon 6766EXeon Platinum 83807001400210028003500SE +/- 0.88, N = 3SE +/- 1.20, N = 3SE +/- 0.58, N = 3SE +/- 0.88, N = 3SE +/- 0.58, N = 3SE +/- 1.20, N = 3SE +/- 0.58, N = 3SE +/- 1.15, N = 3SE +/- 1.76, N = 3SE +/- 0.58, N = 3SE +/- 24.01, N = 12SE +/- 0.88, N = 3SE +/- 21.79, N = 12SE +/- 0.33, N = 3SE +/- 0.58, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 3SE +/- 11.06, N = 3SE +/- 1.20, N = 3SE +/- 7.84, N = 3SE +/- 4.62, N = 3531561661759894954961103710491180134214411497155316571792198820432090224023183052
OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Platinum 8380EPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon 6766E 2PEPYC 9684XXeon 6780E 2PXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2P140280420560700Min: 16.85 / Avg: 112.81 / Max: 142.09Min: 18.36 / Avg: 131.28 / Max: 167.17Min: 43.68 / Avg: 147 / Max: 223.13Min: 43.56 / Avg: 188.73 / Max: 285.39Min: 52 / Avg: 225.09 / Max: 290.77Min: 22.93 / Avg: 248.39 / Max: 335.61Min: 29.72 / Avg: 259.52 / Max: 331.33Min: 35.06 / Avg: 288.94 / Max: 377.45Min: 60.62 / Avg: 292.35 / Max: 377.02Min: 75.94 / Avg: 303.61 / Max: 375.87Min: 74.38 / Avg: 304.87 / Max: 378.48Min: 56.57 / Avg: 313.79 / Max: 485.54Min: 34.89 / Avg: 319.28 / Max: 410.78Min: 108 / Avg: 365.31 / Max: 571.25Min: 104.51 / Avg: 436.59 / Max: 581.52Min: 41.9 / Avg: 518.09 / Max: 690.69Min: 57.88 / Avg: 533.99 / Max: 677.83Min: 81.36 / Avg: 571.36 / Max: 749.47Min: 171.28 / Avg: 584.71 / Max: 751.6Min: 198.09 / Avg: 602.84 / Max: 752.6Min: 203.09 / Avg: 603.55 / Max: 753.72Min: 62.5 / Avg: 640.62 / Max: 822.31. EPYC 8534PN: Approximate power consumption of 8987 Joules per run.2. EPYC 8534P: Approximate power consumption of 10327 Joules per run.3. Xeon 6766E: Approximate power consumption of 12446 Joules per run.4. Xeon 6780E: Approximate power consumption of 15476 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 18457 Joules per run.6. EPYC 9754: Approximate power consumption of 17553 Joules per run.7. EPYC 9654: Approximate power consumption of 18339 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 20418 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 21147 Joules per run.10. Xeon Max 9480: Approximate power consumption of 22062 Joules per run.11. Xeon Max 9468: Approximate power consumption of 22662 Joules per run.12. Xeon 6766E 2P: Approximate power consumption of 26698 Joules per run.13. EPYC 9684X: Approximate power consumption of 22350 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 29803 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 32598 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 36957 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 36133 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 38091 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 40735 Joules per run.20. Xeon Max 9480 2P: Approximate power consumption of 41596 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 42449 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 43135 Joules per run.

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: ResNet-50Xeon Platinum 8380Xeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Platinum 8380 2PEPYC 9654EPYC 9684XXeon Platinum 8592+EPYC 9754Xeon Max 9468 2PXeon 6780EXeon 6766EXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9684X 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754 2PXeon 6780E 2PXeon 6766E 2P48121620SE +/- 0.08, N = 5SE +/- 0.09, N = 4SE +/- 0.08, N = 15SE +/- 0.08, N = 15SE +/- 0.05, N = 4SE +/- 0.10, N = 4SE +/- 0.13, N = 15SE +/- 0.01, N = 4SE +/- 0.09, N = 15SE +/- 0.05, N = 9SE +/- 0.05, N = 15SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 15SE +/- 0.04, N = 15SE +/- 0.01, N = 3SE +/- 0.03, N = 15SE +/- 0.06, N = 15SE +/- 0.03, N = 15SE +/- 0.02, N = 3SE +/- 0.01, N = 1517.8211.2910.7910.7010.539.999.139.018.966.436.195.115.024.674.394.373.923.853.662.471.991.76
OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: ResNet-50EPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon 6766EXeon 6780EEPYC 9654Xeon Platinum 8490HXeon Max 9468EPYC 9684XEPYC 9754Xeon Max 9480Xeon Platinum 8592+Xeon Platinum 8380 2PXeon Max 9468 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon 6780E 2PXeon 6766E 2PEPYC 9754 2PXeon Max 9480 2P0.03150.0630.09450.1260.15750.1400.1320.1300.0620.0600.0570.0560.0530.0500.0480.0450.0420.0320.0110.0110.0100.0100.0100.0090.0090.0090.009
OpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.16.1CPU Power Consumption MonitorXeon 6766EEPYC 8534PNEPYC 8534PXeon 6780EEPYC 9754Xeon Platinum 8380Xeon Platinum 8592+EPYC 9654EPYC 9684XXeon Platinum 8490HXeon 6766E 2PXeon 6780E 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P100200300400500Min: 43.57 / Avg: 74.94 / Max: 90.44Min: 15.23 / Avg: 76.32 / Max: 109.67Min: 16.58 / Avg: 81.51 / Max: 118.9Min: 43.51 / Avg: 83.13 / Max: 101.84Min: 20.21 / Avg: 128.28 / Max: 166.19Min: 49.72 / Avg: 137.42 / Max: 216.79Min: 26.03 / Avg: 152.5 / Max: 203.99Min: 29.81 / Avg: 157.26 / Max: 218.19Min: 32.53 / Avg: 179.99 / Max: 250.99Min: 59.45 / Avg: 188.55 / Max: 248.97Min: 103.83 / Avg: 203.64 / Max: 238.14Min: 104.65 / Avg: 212.41 / Max: 239.17Min: 74.86 / Avg: 214.64 / Max: 277.01Min: 74.4 / Avg: 220.35 / Max: 283.28Min: 98.96 / Avg: 285.87 / Max: 395.19Min: 39.45 / Avg: 288.27 / Max: 343.12Min: 77.73 / Avg: 351.48 / Max: 431.04Min: 55.24 / Avg: 357.87 / Max: 424.3Min: 64.93 / Avg: 389.7 / Max: 463.09Min: 139.48 / Avg: 455.97 / Max: 550.2Min: 196.38 / Avg: 479.87 / Max: 557.8Min: 193.89 / Avg: 495.88 / Max: 584.141. Xeon 6766E: Approximate power consumption of 2573 Joules per run.2. EPYC 8534PN: Approximate power consumption of 1476 Joules per run.3. EPYC 8534P: Approximate power consumption of 1560 Joules per run.4. Xeon 6780E: Approximate power consumption of 2660 Joules per run.5. EPYC 9754: Approximate power consumption of 3438 Joules per run.6. Xeon Platinum 8380: Approximate power consumption of 2061 Joules per run.7. Xeon Platinum 8592+: Approximate power consumption of 3779 Joules per run.8. EPYC 9654: Approximate power consumption of 3224 Joules per run.9. EPYC 9684X: Approximate power consumption of 3648 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 3535 Joules per run.11. Xeon 6766E 2P: Approximate power consumption of 15042 Joules per run.12. Xeon 6780E 2P: Approximate power consumption of 14161 Joules per run.13. Xeon Max 9468: Approximate power consumption of 3864 Joules per run.14. Xeon Max 9480: Approximate power consumption of 4297 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 5984 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 15432 Joules per run.17. Xeon Platinum 8592+ 2P: Approximate power consumption of 12770 Joules per run.18. EPYC 9654 2P: Approximate power consumption of 13670 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 14159 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 15169 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 14556 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 16595 Joules per run.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: ResNet-50Xeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8380 2PXeon Max 9480 2PEPYC 9754EPYC 9684XXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8380EPYC 8534PEPYC 9684X 2PEPYC 9654 2PEPYC 8534PNXeon 6780EXeon 6766EXeon 6780E 2PEPYC 9754 2PXeon 6766E 2P306090120150SE +/- 0.04, N = 3SE +/- 1.12, N = 3SE +/- 0.64, N = 3SE +/- 0.39, N = 3SE +/- 1.42, N = 3SE +/- 1.28, N = 3SE +/- 0.60, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 0.93, N = 3SE +/- 0.70, N = 3SE +/- 0.50, N = 3SE +/- 0.36, N = 3SE +/- 0.05, N = 3SE +/- 1.04, N = 4SE +/- 0.91, N = 5SE +/- 0.11, N = 3SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.76, N = 3SE +/- 0.88, N = 3SE +/- 0.56, N = 3120.93115.47114.63111.71108.32107.30106.14104.52104.23103.5694.6691.5190.7287.3186.0882.9480.8676.3771.4168.5267.0861.48
OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: ResNet-50EPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon 6766EXeon Platinum 8490HXeon Platinum 8592+Xeon 6780EXeon Platinum 8380EPYC 9684XXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon 6780E 2PXeon 6766E 2PXeon Max 9468 2PEPYC 9754 2PXeon Max 9480 2PEPYC 9654 2PEPYC 9684X 2P0.14720.29440.44160.58880.7360.6540.6100.4770.4480.4230.3980.3820.3780.3620.3540.3300.3260.2360.2020.2020.1880.1860.1860.1790.1780.1700.159
OpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.16.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754Xeon Platinum 8592+Xeon Platinum 8380EPYC 9654EPYC 9684XXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P120240360480600Min: 15.94 / Avg: 123.62 / Max: 139.7Min: 17.24 / Avg: 143.22 / Max: 160.51Min: 43.68 / Avg: 168.94 / Max: 189.35Min: 43.53 / Avg: 201.8 / Max: 232.09Min: 19.21 / Avg: 222.65 / Max: 256.54Min: 35.02 / Avg: 239.37 / Max: 274.93Min: 51.52 / Avg: 250.55 / Max: 277.16Min: 28.64 / Avg: 256.02 / Max: 290.14Min: 33.94 / Avg: 295.36 / Max: 331.29Min: 57.29 / Avg: 303.56 / Max: 335.19Min: 73.44 / Avg: 315.74 / Max: 344.17Min: 75.88 / Avg: 317.98 / Max: 346.3Min: 104.2 / Avg: 330.36 / Max: 365.9Min: 53.44 / Avg: 364.61 / Max: 411.61Min: 40.87 / Avg: 375.57 / Max: 410.97Min: 104.27 / Avg: 458.39 / Max: 515.43Min: 81.35 / Avg: 469.58 / Max: 533.37Min: 53.67 / Avg: 487.46 / Max: 539.03Min: 66.65 / Avg: 542.07 / Max: 602.63Min: 158.09 / Avg: 571.99 / Max: 633.85Min: 206.91 / Avg: 601.85 / Max: 661.69Min: 193.17 / Avg: 603.74 / Max: 661.051. EPYC 8534PN: Approximate power consumption of 11950 Joules per run.2. EPYC 8534P: Approximate power consumption of 12938 Joules per run.3. Xeon 6766E: Approximate power consumption of 18752 Joules per run.4. Xeon 6780E: Approximate power consumption of 20987 Joules per run.5. EPYC 9754: Approximate power consumption of 16996 Joules per run.6. Xeon Platinum 8592+: Approximate power consumption of 20585 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 21631 Joules per run.8. EPYC 9654: Approximate power consumption of 18007 Joules per run.9. EPYC 9684X: Approximate power consumption of 22448 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 20440 Joules per run.11. Xeon Max 9468: Approximate power consumption of 24627 Joules per run.12. Xeon Max 9480: Approximate power consumption of 24696 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 42947 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 42781 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 43566 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 34685 Joules per run.17. Xeon Platinum 8592+ 2P: Approximate power consumption of 39445 Joules per run.18. EPYC 9654 2P: Approximate power consumption of 46016 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 49464 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 40992 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 44136 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 46689 Joules per run.

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8490HXeon Platinum 8380 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 9754EPYC 8534PNXeon Platinum 8380Xeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P60120180240300SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.16, N = 3SE +/- 0.34, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.44, N = 3SE +/- 0.59, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.60, N = 11SE +/- 0.77, N = 7SE +/- 0.13, N = 3SE +/- 1.05, N = 5SE +/- 0.05, N = 3SE +/- 0.39, N = 3SE +/- 0.06, N = 3SE +/- 0.48, N = 3SE +/- 3.14, N = 3SE +/- 2.84, N = 1526.8528.1728.7329.9837.5838.5041.5743.1748.4356.7362.4670.9583.1191.16100.67102.84109.00127.89240.38259.66271.14294.691. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon 6780EEPYC 9754Xeon Platinum 8490HEPYC 9654Xeon Platinum 8592+Xeon Max 9480Xeon Max 9468EPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2P140280420560700Min: 17.99 / Avg: 135.1 / Max: 150.13Min: 18.55 / Avg: 159.63 / Max: 174.23Min: 43.66 / Avg: 230.17 / Max: 253.31Min: 50.83 / Avg: 254.14 / Max: 284.65Min: 43.55 / Avg: 296.98 / Max: 325.95Min: 20.94 / Avg: 299.63 / Max: 344.93Min: 59.14 / Avg: 321.95 / Max: 371.05Min: 29.13 / Avg: 323.9 / Max: 362.47Min: 34.43 / Avg: 325.81 / Max: 362.26Min: 74.79 / Avg: 330.98 / Max: 373.36Min: 70.61 / Avg: 331.05 / Max: 366.72Min: 31.03 / Avg: 374.75 / Max: 410.94Min: 106.93 / Avg: 441.51 / Max: 532Min: 102.32 / Avg: 507.36 / Max: 566.08Min: 108.68 / Avg: 553.41 / Max: 653.25Min: 39.45 / Avg: 607.43 / Max: 679.21Min: 52.92 / Avg: 645.83 / Max: 711.68Min: 86.44 / Avg: 651.59 / Max: 748.25Min: 167.2 / Avg: 656.03 / Max: 736.45Min: 203.57 / Avg: 662.79 / Max: 751.8Min: 196.83 / Avg: 663.81 / Max: 748.85Min: 69.87 / Avg: 750.94 / Max: 819.61. EPYC 8534PN: Approximate power consumption of 8917 Joules per run.2. EPYC 8534P: Approximate power consumption of 10535 Joules per run.3. Xeon 6766E: Approximate power consumption of 15268 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 16604 Joules per run.5. Xeon 6780E: Approximate power consumption of 19700 Joules per run.6. EPYC 9754: Approximate power consumption of 19836 Joules per run.7. Xeon Platinum 8490H: Approximate power consumption of 21571 Joules per run.8. EPYC 9654: Approximate power consumption of 21192 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 21286 Joules per run.10. Xeon Max 9480: Approximate power consumption of 21624 Joules per run.11. Xeon Max 9468: Approximate power consumption of 21518 Joules per run.12. EPYC 9684X: Approximate power consumption of 24495 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 30405 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 33148 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 38001 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 40495 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 42625 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 43005 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 43298 Joules per run.20. Xeon Max 9480 2P: Approximate power consumption of 43744 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 43369 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 49562 Joules per run.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9754Xeon Platinum 8592+EPYC 9684XEPYC 9654Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 8380 2PXeon 6780E 2PXeon 6766E 2PXeon Platinum 8380Xeon 6780EXeon 6766E2004006008001000SE +/- 0.85, N = 3SE +/- 11.78, N = 3SE +/- 0.37, N = 3SE +/- 8.96, N = 3SE +/- 1.13, N = 3SE +/- 1.99, N = 3SE +/- 3.48, N = 3SE +/- 6.34, N = 5SE +/- 0.54, N = 3SE +/- 4.29, N = 11SE +/- 4.59, N = 7SE +/- 0.17, N = 3SE +/- 4.09, N = 3SE +/- 1.21, N = 3SE +/- 0.39, N = 3SE +/- 0.13, N = 3SE +/- 0.17, N = 3SE +/- 3.00, N = 3SE +/- 2.30, N = 15SE +/- 0.45, N = 3SE +/- 0.03, N = 3SE +/- 0.25, N = 31128.781127.051110.49990.16889.18795.63793.64621.42592.20576.98525.88477.77467.08415.96317.38293.07281.36264.66243.76156.13149.63138.531. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelXeon Max 9468Xeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480EPYC 8534PEPYC 8534PNXeon Platinum 8380 2PEPYC 9654EPYC 9684XXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P816243240SE +/- 0.01698, N = 3SE +/- 0.01736, N = 3SE +/- 0.00544, N = 3SE +/- 0.02630, N = 3SE +/- 0.03023, N = 3SE +/- 0.03641, N = 15SE +/- 0.03633, N = 15SE +/- 0.03509, N = 3SE +/- 0.06505, N = 4SE +/- 0.04669, N = 3SE +/- 0.01680, N = 3SE +/- 0.02968, N = 3SE +/- 0.06875, N = 3SE +/- 0.03080, N = 3SE +/- 0.02258, N = 3SE +/- 0.05309, N = 3SE +/- 0.05293, N = 3SE +/- 0.08457, N = 3SE +/- 0.07856, N = 3SE +/- 0.08701, N = 3SE +/- 0.32730, N = 6SE +/- 0.34399, N = 33.133663.173603.192983.237803.320304.825064.926535.180705.253215.594916.005256.390316.496936.517446.523679.952459.9624511.3148015.5856017.9000035.2266036.400901. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754Xeon Platinum 8380EPYC 9654EPYC 9684XXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2P100200300400500Min: 16.2 / Avg: 115 / Max: 124.26Min: 18.11 / Avg: 126.52 / Max: 135.68Min: 43.72 / Avg: 144.55 / Max: 152.6Min: 43.63 / Avg: 170.55 / Max: 180.89Min: 21.2 / Avg: 199.22 / Max: 213.69Min: 53.36 / Avg: 238.84 / Max: 254.78Min: 28.74 / Avg: 240.91 / Max: 259.49Min: 36.05 / Avg: 285.19 / Max: 306.51Min: 104.68 / Avg: 302.86 / Max: 321.76Min: 108.09 / Avg: 347.86 / Max: 369.84Min: 42.14 / Avg: 407.23 / Max: 436.3Min: 101.46 / Avg: 445.87 / Max: 473.79Min: 51.2 / Avg: 478.17 / Max: 512.01Min: 64.35 / Avg: 547.96 / Max: 588.361. EPYC 8534PN: Approximate power consumption of 7360 Joules per run.2. EPYC 8534P: Approximate power consumption of 8106 Joules per run.3. Xeon 6766E: Approximate power consumption of 9299 Joules per run.4. Xeon 6780E: Approximate power consumption of 10972 Joules per run.5. EPYC 9754: Approximate power consumption of 12750 Joules per run.6. Xeon Platinum 8380: Approximate power consumption of 15286 Joules per run.7. EPYC 9654: Approximate power consumption of 15418 Joules per run.8. EPYC 9684X: Approximate power consumption of 18252 Joules per run.9. Xeon 6766E 2P: Approximate power consumption of 19484 Joules per run.10. Xeon 6780E 2P: Approximate power consumption of 22379 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 25927 Joules per run.12. Xeon Platinum 8380 2P: Approximate power consumption of 28684 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 30603 Joules per run.14. EPYC 9684X 2P: Approximate power consumption of 35069 Joules per run.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelXeon Max 9468Xeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480EPYC 8534PEPYC 8534PNXeon Platinum 8380 2PEPYC 9654EPYC 9684XXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P70140210280350SE +/- 1.74, N = 3SE +/- 1.73, N = 3SE +/- 0.53, N = 3SE +/- 2.50, N = 3SE +/- 2.72, N = 3SE +/- 1.54, N = 15SE +/- 1.50, N = 15SE +/- 1.30, N = 3SE +/- 2.31, N = 4SE +/- 1.50, N = 3SE +/- 0.47, N = 3SE +/- 0.73, N = 3SE +/- 1.63, N = 3SE +/- 0.73, N = 3SE +/- 0.53, N = 3SE +/- 0.54, N = 3SE +/- 0.54, N = 3SE +/- 0.66, N = 3SE +/- 0.32, N = 3SE +/- 0.27, N = 3SE +/- 0.27, N = 6SE +/- 0.26, N = 3319.04315.03313.10308.80301.14207.34203.06192.99190.38178.70166.49156.46153.92153.41153.25100.46100.3688.3764.1655.8628.4027.471. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelXeon Max 9468Xeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480EPYC 8534PEPYC 8534PNXeon Platinum 8380 2PEPYC 9654EPYC 9684XXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P816243240SE +/- 0.01698, N = 3SE +/- 0.01736, N = 3SE +/- 0.00544, N = 3SE +/- 0.02630, N = 3SE +/- 0.03023, N = 3SE +/- 0.03641, N = 15SE +/- 0.03633, N = 15SE +/- 0.03509, N = 3SE +/- 0.06505, N = 4SE +/- 0.04669, N = 3SE +/- 0.01680, N = 3SE +/- 0.02968, N = 3SE +/- 0.06875, N = 3SE +/- 0.03080, N = 3SE +/- 0.02258, N = 3SE +/- 0.05309, N = 3SE +/- 0.05293, N = 3SE +/- 0.08457, N = 3SE +/- 0.07856, N = 3SE +/- 0.08701, N = 3SE +/- 0.32730, N = 6SE +/- 0.34399, N = 33.133663.173603.192983.237803.320304.825064.926535.180705.253215.594916.005256.390316.496936.517446.523679.952459.9624511.3148015.5856017.9000035.2266036.400901. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUXeon Platinum 8592+Xeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9654Xeon Max 9468 2PEPYC 8534PEPYC 8534PNXeon Max 9480 2PEPYC 9684X 2PEPYC 9754EPYC 9654 2PXeon Platinum 8380Xeon Platinum 8380 2PEPYC 9754 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P70140210280350SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.05, N = 3SE +/- 0.16, N = 14SE +/- 0.12, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.45, N = 12SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.65, N = 3SE +/- 0.66, N = 3SE +/- 0.86, N = 3SE +/- 4.48, N = 39.4011.3712.7213.1513.5213.9515.9616.3217.1517.3018.4918.7222.2022.6723.1225.9126.3328.1075.2282.12293.36340.261. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Platinum 8380EPYC 9754Xeon 6766E 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon 6780E 2PEPYC 9684XEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P140280420560700Min: 17.49 / Avg: 137.08 / Max: 149.27Min: 17.46 / Avg: 161.25 / Max: 175.66Min: 43.71 / Avg: 207.06 / Max: 230.09Min: 43.5 / Avg: 248.78 / Max: 279.12Min: 51.5 / Avg: 253.93 / Max: 289.36Min: 20.78 / Avg: 292.63 / Max: 342.23Min: 105.02 / Avg: 307.84 / Max: 385.97Min: 29.75 / Avg: 315.18 / Max: 357.38Min: 34.54 / Avg: 324.07 / Max: 405.42Min: 60.51 / Avg: 327.19 / Max: 379.48Min: 73.68 / Avg: 329.15 / Max: 372.33Min: 85.86 / Avg: 330.63 / Max: 384.53Min: 108.4 / Avg: 354.62 / Max: 434.65Min: 34.79 / Avg: 374.52 / Max: 409.97Min: 41.91 / Avg: 488.86 / Max: 570.14Min: 103.92 / Avg: 501.31 / Max: 570.17Min: 61.14 / Avg: 581.56 / Max: 658.32Min: 43.35 / Avg: 637.42 / Max: 766.05Min: 171.01 / Avg: 649.04 / Max: 743.64Min: 204.87 / Avg: 656.57 / Max: 725.7Min: 205.34 / Avg: 657.37 / Max: 743.06Min: 67.53 / Avg: 716.78 / Max: 816.611. EPYC 8534PN: Approximate power consumption of 9093 Joules per run.2. EPYC 8534P: Approximate power consumption of 10643 Joules per run.3. Xeon 6766E: Approximate power consumption of 14218 Joules per run.4. Xeon 6780E: Approximate power consumption of 17000 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 16505 Joules per run.6. EPYC 9754: Approximate power consumption of 19948 Joules per run.7. Xeon 6766E 2P: Approximate power consumption of 24422 Joules per run.8. EPYC 9654: Approximate power consumption of 21027 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 21497 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 21704 Joules per run.11. Xeon Max 9468: Approximate power consumption of 21724 Joules per run.12. Xeon Max 9480: Approximate power consumption of 21711 Joules per run.13. Xeon 6780E 2P: Approximate power consumption of 28015 Joules per run.14. EPYC 9684X: Approximate power consumption of 24843 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 36501 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 33588 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 41291 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 43770 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 44351 Joules per run.20. Xeon Max 9468 2P: Approximate power consumption of 44647 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 44701 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 50891 Joules per run.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PEPYC 9684XXeon Platinum 8592+EPYC 9754 2PXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PEPYC 9754Xeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 8380 2PXeon 6780EXeon 6766EXeon Platinum 8380Xeon 6780E 2PXeon 6766E 2P2K4K6K8K10KSE +/- 24.76, N = 3SE +/- 59.51, N = 3SE +/- 77.59, N = 3SE +/- 13.31, N = 3SE +/- 1.84, N = 3SE +/- 10.14, N = 3SE +/- 27.90, N = 3SE +/- 28.98, N = 3SE +/- 67.22, N = 14SE +/- 37.79, N = 3SE +/- 139.41, N = 12SE +/- 7.60, N = 3SE +/- 1.87, N = 3SE +/- 15.13, N = 3SE +/- 0.64, N = 3SE +/- 3.67, N = 3SE +/- 6.96, N = 3SE +/- 16.46, N = 3SE +/- 13.67, N = 3SE +/- 1.70, N = 3SE +/- 2.88, N = 3SE +/- 11.12, N = 39360.898231.727810.657356.636963.316757.266513.365933.655697.515565.235310.074386.484209.104208.493636.333405.942963.821906.991747.501525.57978.46843.921. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

libavif avifenc

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 0Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9480EPYC 9754EPYC 9754 2PEPYC 8534PXeon Max 9468EPYC 8534PNXeon Platinum 8380 2PXeon Platinum 8380Xeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P306090120150SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.32, N = 3SE +/- 0.29, N = 3SE +/- 0.32, N = 3SE +/- 0.22, N = 3SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 0.19, N = 3SE +/- 0.15, N = 3SE +/- 0.18, N = 3SE +/- 0.18, N = 3SE +/- 0.52, N = 3SE +/- 0.12, N = 3SE +/- 0.18, N = 3SE +/- 0.03, N = 3SE +/- 0.22, N = 360.5361.6361.9962.8963.4064.4867.3868.4469.6569.9373.0673.2774.6975.8676.9278.2488.07100.46126.97129.91140.86143.801. (CXX) g++ options: -O3 -fPIC -lm
OpenBenchmarking.orgWatts, Fewer Is Betterlibavif avifenc 1.0CPU Power Consumption MonitorXeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9754Xeon 6766E 2PXeon 6780E 2PEPYC 9654Xeon Platinum 8380EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HEPYC 9754 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P130260390520650Min: 43.56 / Avg: 65.01 / Max: 148.96Min: 43.39 / Avg: 72.37 / Max: 182.54Min: 16.02 / Avg: 77.61 / Max: 131.52Min: 17.01 / Avg: 85.23 / Max: 156.74Min: 19.55 / Avg: 121.7 / Max: 248.44Min: 104.01 / Avg: 131.11 / Max: 231.48Min: 105.44 / Avg: 139.04 / Max: 263.97Min: 29.48 / Avg: 156.52 / Max: 318.36Min: 49.17 / Avg: 165.96 / Max: 290.88Min: 30.24 / Avg: 180.87 / Max: 389.03Min: 34.78 / Avg: 197.77 / Max: 373.2Min: 61.27 / Avg: 218.41 / Max: 375.95Min: 39.64 / Avg: 234.99 / Max: 370.06Min: 69.59 / Avg: 253.47 / Max: 376.81Min: 75.95 / Avg: 254.61 / Max: 372.81Min: 96.24 / Avg: 285.14 / Max: 552.25Min: 58.14 / Avg: 295.3 / Max: 499.26Min: 62.98 / Avg: 324.3 / Max: 548.71Min: 77.6 / Avg: 391.09 / Max: 728.04Min: 152.89 / Avg: 425.04 / Max: 708.08Min: 208.88 / Avg: 485.4 / Max: 727.55Min: 205.63 / Avg: 494.12 / Max: 704.891. Xeon 6766E: Approximate power consumption of 9404 Joules per run.2. Xeon 6780E: Approximate power consumption of 9504 Joules per run.3. EPYC 8534PN: Approximate power consumption of 6364 Joules per run.4. EPYC 8534P: Approximate power consumption of 6819 Joules per run.5. EPYC 9754: Approximate power consumption of 9371 Joules per run.6. Xeon 6766E 2P: Approximate power consumption of 19405 Joules per run.7. Xeon 6780E 2P: Approximate power consumption of 18631 Joules per run.8. EPYC 9654: Approximate power consumption of 10383 Joules per run.9. Xeon Platinum 8380: Approximate power consumption of 17371 Joules per run.10. EPYC 9684X: Approximate power consumption of 11817 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 13646 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 16162 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 18486 Joules per run.14. Xeon Max 9480: Approximate power consumption of 19602 Joules per run.15. Xeon Max 9468: Approximate power consumption of 20623 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 26328 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 19588 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 21728 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 25421 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 30462 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 35111 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 36071 Joules per run.

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: ParallelXeon Platinum 8592+EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 9754Xeon Platinum 8380EPYC 9684X 2PEPYC 9654 2PEPYC 8534PEPYC 8534PNXeon Max 9480 2PEPYC 9754 2PXeon Platinum 8380 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P3691215SE +/- 0.01801, N = 3SE +/- 0.01812, N = 3SE +/- 0.00389, N = 3SE +/- 0.01381, N = 3SE +/- 0.01443, N = 3SE +/- 0.03338, N = 15SE +/- 0.00807, N = 3SE +/- 0.02990, N = 3SE +/- 0.02857, N = 3SE +/- 0.00852, N = 3SE +/- 0.03309, N = 3SE +/- 0.03399, N = 3SE +/- 0.02993, N = 3SE +/- 0.02633, N = 15SE +/- 0.01019, N = 3SE +/- 0.01782, N = 3SE +/- 0.04072, N = 3SE +/- 0.04801, N = 3SE +/- 0.01135, N = 3SE +/- 0.01143, N = 3SE +/- 0.14331, N = 3SE +/- 0.12596, N = 32.159802.239222.667112.817392.887342.970943.065003.129043.542423.617923.680013.910063.924553.958193.987354.006754.052704.058814.062724.2035510.5883010.806601. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654EPYC 9684XXeon 6766E 2PXeon 6780E 2PXeon Platinum 8380EPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380 2P60120180240300Min: 15.18 / Avg: 80.15 / Max: 85.73Min: 17.28 / Avg: 82.81 / Max: 89.26Min: 43.59 / Avg: 101.11 / Max: 106.64Min: 43.42 / Avg: 105.34 / Max: 111.27Min: 21.09 / Avg: 108.61 / Max: 116.43Min: 29.55 / Avg: 141.28 / Max: 150.78Min: 33.5 / Avg: 163.65 / Max: 174.8Min: 103.76 / Avg: 180.19 / Max: 189.22Min: 105.65 / Avg: 182.76 / Max: 192.69Min: 52.52 / Avg: 218.31 / Max: 234.43Min: 40.04 / Avg: 220.47 / Max: 233.47Min: 57.25 / Avg: 267.87 / Max: 282.78Min: 64.84 / Avg: 297.41 / Max: 317.19Min: 99.27 / Avg: 314.65 / Max: 333.571. EPYC 8534PN: Approximate power consumption of 5210 Joules per run.2. EPYC 8534P: Approximate power consumption of 5410 Joules per run.3. Xeon 6766E: Approximate power consumption of 6606 Joules per run.4. Xeon 6780E: Approximate power consumption of 6882 Joules per run.5. EPYC 9754: Approximate power consumption of 7024 Joules per run.6. EPYC 9654: Approximate power consumption of 9136 Joules per run.7. EPYC 9684X: Approximate power consumption of 10583 Joules per run.8. Xeon 6766E 2P: Approximate power consumption of 11893 Joules per run.9. Xeon 6780E 2P: Approximate power consumption of 12062 Joules per run.10. Xeon Platinum 8380: Approximate power consumption of 14190 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 14330 Joules per run.12. EPYC 9654 2P: Approximate power consumption of 17322 Joules per run.13. EPYC 9684X 2P: Approximate power consumption of 19232 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 20452 Joules per run.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: ParallelXeon Platinum 8592+EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 9754Xeon Platinum 8380EPYC 9684X 2PEPYC 9654 2PEPYC 8534PEPYC 8534PNXeon Max 9480 2PEPYC 9754 2PXeon Platinum 8380 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P100200300400500SE +/- 3.84, N = 3SE +/- 3.58, N = 3SE +/- 0.55, N = 3SE +/- 1.73, N = 3SE +/- 1.74, N = 3SE +/- 3.48, N = 15SE +/- 0.86, N = 3SE +/- 3.02, N = 3SE +/- 2.25, N = 3SE +/- 0.65, N = 3SE +/- 2.43, N = 3SE +/- 2.24, N = 3SE +/- 1.96, N = 3SE +/- 1.67, N = 15SE +/- 0.64, N = 3SE +/- 1.11, N = 3SE +/- 2.44, N = 3SE +/- 2.94, N = 3SE +/- 0.69, N = 3SE +/- 0.65, N = 3SE +/- 1.28, N = 3SE +/- 1.08, N = 3462.86446.30374.75354.75346.21337.00326.14319.45282.25276.21271.62255.67254.73252.67250.63249.48246.68246.34246.04237.8094.4292.511. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: ParallelXeon Platinum 8592+EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 9754Xeon Platinum 8380EPYC 9684X 2PEPYC 9654 2PEPYC 8534PEPYC 8534PNXeon Max 9480 2PEPYC 9754 2PXeon Platinum 8380 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P3691215SE +/- 0.01801, N = 3SE +/- 0.01812, N = 3SE +/- 0.00389, N = 3SE +/- 0.01381, N = 3SE +/- 0.01443, N = 3SE +/- 0.03338, N = 15SE +/- 0.00807, N = 3SE +/- 0.02990, N = 3SE +/- 0.02857, N = 3SE +/- 0.00852, N = 3SE +/- 0.03309, N = 3SE +/- 0.03399, N = 3SE +/- 0.02993, N = 3SE +/- 0.02633, N = 15SE +/- 0.01019, N = 3SE +/- 0.01782, N = 3SE +/- 0.04072, N = 3SE +/- 0.04801, N = 3SE +/- 0.01135, N = 3SE +/- 0.01143, N = 3SE +/- 0.14331, N = 3SE +/- 0.12596, N = 32.159802.239222.667112.817392.887342.970943.065003.129043.542423.617923.680013.910063.924553.958193.987354.006754.052704.058814.062724.2035510.5883010.806601. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ASKAP

ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMpix/sec, More Is BetterASKAP 1.0Test: tConvolve MPI - GriddingEPYC 9684X 2PEPYC 9654 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+EPYC 9754Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 8534PEPYC 8534PNXeon Platinum 8380 2PXeon Platinum 838030K60K90K120K150KSE +/- 19579.11, N = 3SE +/- 2386.93, N = 4SE +/- 581.17, N = 3SE +/- 1080.03, N = 3SE +/- 1180.69, N = 14SE +/- 1853.72, N = 3SE +/- 802.88, N = 3SE +/- 194.30, N = 3SE +/- 412.68, N = 4SE +/- 219.20, N = 3SE +/- 685.49, N = 12SE +/- 0.00, N = 3SE +/- 99.83, N = 3SE +/- 76.67, N = 3SE +/- 86.77, N = 3SE +/- 0.00, N = 3SE +/- 46.25, N = 3SE +/- 47.29, N = 3121976.9086757.7074389.0072004.0054066.0046233.7045195.1042939.2041773.0037265.9028854.3023250.2021766.5021314.2016573.2016399.7014497.309623.771. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
OpenBenchmarking.orgMpix/sec Per Watt, More Is BetterASKAP 1.0Test: tConvolve MPI - GriddingEPYC 9684XEPYC 9684X 2PEPYC 9654EPYC 9654 2PEPYC 8534PNEPYC 9754EPYC 8534PXeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9754 2PXeon Max 9480Xeon Max 9480 2PXeon Max 9468Xeon Platinum 8490HXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8380Xeon Platinum 8380 2P50100150200250247.30199.37188.14167.00142.12134.70130.96128.04125.14109.7475.1470.8769.9667.8567.7766.7238.7629.22
OpenBenchmarking.orgWatts, Fewer Is BetterASKAP 1.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8380Xeon Platinum 8592+EPYC 9684XXeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P140280420560700Min: 16.5 / Avg: 115.4 / Max: 136.82Min: 19.03 / Avg: 126.56 / Max: 161.28Min: 20.61 / Avg: 214.21 / Max: 327.89Min: 29.47 / Avg: 245.74 / Max: 336.85Min: 52.74 / Avg: 248.29 / Max: 286.59Min: 24.59 / Avg: 297.8 / Max: 352.67Min: 31.29 / Avg: 300.8 / Max: 409.34Min: 73.2 / Avg: 309.44 / Max: 360.17Min: 74.39 / Avg: 311.12 / Max: 354.1Min: 57.81 / Avg: 314.14 / Max: 357.36Min: 37.58 / Avg: 492.69 / Max: 670.56Min: 97.93 / Avg: 496.22 / Max: 563.93Min: 57.21 / Avg: 519.5 / Max: 681.6Min: 74.42 / Avg: 562.35 / Max: 727.39Min: 64.2 / Avg: 611.81 / Max: 819.12Min: 163.2 / Avg: 626.07 / Max: 724.87Min: 196.26 / Avg: 633.57 / Max: 720.17Min: 196.89 / Avg: 637.73 / Max: 729.761. EPYC 8534PN: Approximate power consumption of 6385 Joules per run.2. EPYC 8534P: Approximate power consumption of 6961 Joules per run.3. EPYC 9754: Approximate power consumption of 17351 Joules per run.4. EPYC 9654: Approximate power consumption of 10485 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 11669 Joules per run.6. Xeon Platinum 8592+: Approximate power consumption of 10522 Joules per run.7. EPYC 9684X: Approximate power consumption of 10328 Joules per run.8. Xeon Max 9480: Approximate power consumption of 12687 Joules per run.9. Xeon Max 9468: Approximate power consumption of 11304 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 13717 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 48389 Joules per run.12. Xeon Platinum 8380 2P: Approximate power consumption of 27458 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 27793 Joules per run.14. Xeon Platinum 8592+ 2P: Approximate power consumption of 23431 Joules per run.15. EPYC 9684X 2P: Approximate power consumption of 23453 Joules per run.16. Xeon Platinum 8490H 2P: Approximate power consumption of 29112 Joules per run.17. Xeon Max 9468 2P: Approximate power consumption of 24498 Joules per run.18. Xeon Max 9480 2P: Approximate power consumption of 26785 Joules per run.

OpenBenchmarking.orgMpix/sec, More Is BetterASKAP 1.0Test: tConvolve MPI - DegriddingEPYC 9684X 2PEPYC 9654 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+EPYC 9754Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 8534PEPYC 8534PNXeon Platinum 8380 2PXeon Platinum 838030K60K90K120K150KSE +/- 0.00, N = 3SE +/- 882.91, N = 4SE +/- 0.00, N = 3SE +/- 480.95, N = 3SE +/- 1077.92, N = 14SE +/- 189.10, N = 3SE +/- 0.00, N = 3SE +/- 143.60, N = 3SE +/- 378.22, N = 4SE +/- 153.57, N = 3SE +/- 598.81, N = 12SE +/- 76.47, N = 3SE +/- 0.00, N = 3SE +/- 93.91, N = 3SE +/- 44.43, N = 3SE +/- 69.57, N = 3SE +/- 62.13, N = 3SE +/- 64.71, N = 3123480.0081025.8064260.2059139.2052639.5042172.4040368.6036900.5034614.1031177.2028476.6020561.4018522.0017891.6016704.4015903.4012800.408429.131. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

Helsing

Helsing is an open-source POSIX vampire number generator. This test profile measures the time it takes to generate vampire numbers between varying numbers of digits. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterHelsing 1.0-betaDigit Range: 14 digitEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8490H 2PXeon 6780E 2PEPYC 9684XXeon Max 9480 2PXeon 6766E 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8380 2PXeon Platinum 8592+Xeon Platinum 8490HXeon 6780EEPYC 8534PXeon Max 9480Xeon 6766EEPYC 8534PNXeon Max 9468Xeon Platinum 83804080120160200SE +/- 0.32, N = 3SE +/- 0.42, N = 3SE +/- 0.38, N = 5SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.14, N = 3SE +/- 0.42, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.26, N = 3SE +/- 0.10, N = 3SE +/- 0.27, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.53, N = 3SE +/- 0.08, N = 326.7830.6933.6848.0948.8550.8353.0256.9158.2558.9662.1765.0382.9689.0793.35103.86105.68107.24115.46120.56123.83165.791. (CC) gcc options: -O2 -pthread
OpenBenchmarking.orgWatts, Fewer Is BetterHelsing 1.0-betaCPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2P150300450600750Min: 17.86 / Avg: 131.19 / Max: 137.88Min: 18.11 / Avg: 166.23 / Max: 176.55Min: 43.76 / Avg: 217.84 / Max: 231.94Min: 52.7 / Avg: 264.22 / Max: 291.17Min: 43.52 / Avg: 283.2 / Max: 302.38Min: 21.32 / Avg: 315.34 / Max: 347.42Min: 28.89 / Avg: 322.19 / Max: 348.84Min: 32.85 / Avg: 334.81 / Max: 377.7Min: 56.9 / Avg: 336.32 / Max: 376.98Min: 87.46 / Avg: 338.48 / Max: 364.16Min: 73.73 / Avg: 338.57 / Max: 364.52Min: 34.66 / Avg: 378.16 / Max: 412.26Min: 105.07 / Avg: 444.27 / Max: 495.95Min: 102.73 / Avg: 517.9 / Max: 581.32Min: 107.47 / Avg: 552.92 / Max: 634.15Min: 41.44 / Avg: 591.29 / Max: 696.59Min: 58.49 / Avg: 624.24 / Max: 716.4Min: 74.95 / Avg: 643.2 / Max: 755.25Min: 173.59 / Avg: 654.95 / Max: 756.78Min: 203.6 / Avg: 662.24 / Max: 747.53Min: 210.37 / Avg: 664.49 / Max: 742.91Min: 67.93 / Avg: 711.96 / Max: 830.11. EPYC 8534PN: Approximate power consumption of 16311 Joules per run.2. EPYC 8534P: Approximate power consumption of 18175 Joules per run.3. Xeon 6766E: Approximate power consumption of 25923 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 44741 Joules per run.5. Xeon 6780E: Approximate power consumption of 30397 Joules per run.6. EPYC 9754: Approximate power consumption of 16608 Joules per run.7. EPYC 9654: Approximate power consumption of 21264 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 31137 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 32735 Joules per run.10. Xeon Max 9480: Approximate power consumption of 37572 Joules per run.11. Xeon Max 9468: Approximate power consumption of 43225 Joules per run.12. EPYC 9684X: Approximate power consumption of 22942 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 27989 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 44885 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 31517 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 18133 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 23222 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 33875 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 36022 Joules per run.20. Xeon Max 9480 2P: Approximate power consumption of 41059 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 45850 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 24444 Joules per run.

OSPRay Studio

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480Xeon 6780E 2PXeon Max 9468Xeon 6766E 2PEPYC 8534PEPYC 8534PNXeon 6780EXeon 6766EXeon Platinum 838012K24K36K48K60KSE +/- 12.34, N = 3SE +/- 17.16, N = 3SE +/- 32.74, N = 3SE +/- 7.13, N = 3SE +/- 34.10, N = 3SE +/- 33.33, N = 3SE +/- 51.39, N = 3SE +/- 39.30, N = 3SE +/- 72.42, N = 3SE +/- 44.33, N = 3SE +/- 37.49, N = 3SE +/- 53.03, N = 3SE +/- 62.46, N = 3SE +/- 83.47, N = 3SE +/- 429.71, N = 4SE +/- 28.06, N = 3SE +/- 409.89, N = 15SE +/- 250.73, N = 3SE +/- 31.02, N = 3SE +/- 371.33, N = 3SE +/- 199.93, N = 3SE +/- 148.46, N = 3841389161042812124141381528615357166031664518896231253044231380337903508137055382283881142513468755208354456
OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Platinum 8380EPYC 9754Xeon 6766E 2PXeon Platinum 8490HEPYC 9654Xeon 6780E 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8592+EPYC 9684XXeon Platinum 8380 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9684X 2P140280420560700Min: 17.28 / Avg: 103.3 / Max: 141.73Min: 17.86 / Avg: 118.24 / Max: 166.58Min: 43.63 / Avg: 134.74 / Max: 219.04Min: 43.51 / Avg: 165.73 / Max: 285.29Min: 53.95 / Avg: 217.25 / Max: 291.65Min: 21.92 / Avg: 245.02 / Max: 336.36Min: 105.3 / Avg: 248.8 / Max: 487.82Min: 61.9 / Avg: 259.12 / Max: 377.23Min: 29.03 / Avg: 265.51 / Max: 331.71Min: 107.79 / Avg: 277.62 / Max: 555.46Min: 78.1 / Avg: 281.43 / Max: 376.32Min: 74.46 / Avg: 283.63 / Max: 375.94Min: 35.35 / Avg: 299.63 / Max: 376.51Min: 35.54 / Avg: 320.39 / Max: 411.05Min: 95.78 / Avg: 375.01 / Max: 583.47Min: 61.04 / Avg: 548.32 / Max: 683.37Min: 41.91 / Avg: 564.91 / Max: 692.23Min: 78.22 / Avg: 573.74 / Max: 753.21Min: 201.01 / Avg: 599.93 / Max: 754.22Min: 210.55 / Avg: 606.6 / Max: 753.89Min: 175.84 / Avg: 622.79 / Max: 756.66Min: 66.57 / Avg: 696.59 / Max: 822.151. EPYC 8534PN: Approximate power consumption of 6129 Joules per run.2. EPYC 8534P: Approximate power consumption of 6582 Joules per run.3. Xeon 6766E: Approximate power consumption of 9657 Joules per run.4. Xeon 6780E: Approximate power consumption of 10827 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 15063 Joules per run.6. EPYC 9754: Approximate power consumption of 16907 Joules per run.7. Xeon 6766E 2P: Approximate power consumption of 15061 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 11833 Joules per run.9. EPYC 9654: Approximate power consumption of 20356 Joules per run.10. Xeon 6780E 2P: Approximate power consumption of 15616 Joules per run.11. Xeon Max 9480: Approximate power consumption of 13321 Joules per run.12. Xeon Max 9468: Approximate power consumption of 14371 Joules per run.13. Xeon Platinum 8592+: Approximate power consumption of 26068 Joules per run.14. EPYC 9684X: Approximate power consumption of 22321 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 17500 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 41490 Joules per run.17. EPYC 9754 2P: Approximate power consumption of 55173 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 38440 Joules per run.19. Xeon Max 9480 2P: Approximate power consumption of 39996 Joules per run.20. Xeon Max 9468 2P: Approximate power consumption of 43069 Joules per run.21. Xeon Platinum 8490H 2P: Approximate power consumption of 65600 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 69659 Joules per run.

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480Xeon 6780E 2PXeon Max 9468Xeon 6766E 2PEPYC 8534PEPYC 8534PNXeon 6780EXeon 6766EXeon Platinum 838014K28K42K56K70KSE +/- 16.90, N = 3SE +/- 32.79, N = 3SE +/- 27.79, N = 3SE +/- 8.00, N = 3SE +/- 29.96, N = 3SE +/- 10.97, N = 3SE +/- 21.05, N = 3SE +/- 24.66, N = 3SE +/- 25.12, N = 3SE +/- 5.55, N = 3SE +/- 26.00, N = 3SE +/- 28.75, N = 3SE +/- 61.20, N = 3SE +/- 74.33, N = 3SE +/- 301.00, N = 12SE +/- 36.47, N = 3SE +/- 51.90, N = 3SE +/- 111.72, N = 3SE +/- 197.99, N = 3SE +/- 26.58, N = 3SE +/- 500.31, N = 3SE +/- 62.75, N = 310015105141242714358168371811118129195351970122305319933486636649392383928342837439064537748844525015765763035
OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Platinum 8380Xeon Platinum 8592+EPYC 9754Xeon 6766E 2PXeon Platinum 8490HEPYC 9654Xeon Max 9480Xeon Max 9468Xeon 6780E 2PEPYC 9684XXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+ 2PEPYC 9684X 2P140280420560700Min: 17.31 / Avg: 107.81 / Max: 142.82Min: 17.33 / Avg: 121.97 / Max: 166.66Min: 43.65 / Avg: 142.62 / Max: 223.55Min: 43.5 / Avg: 175.23 / Max: 284.38Min: 53.28 / Avg: 223.15 / Max: 291.09Min: 26.59 / Avg: 252.77 / Max: 377.16Min: 22.55 / Avg: 256.1 / Max: 337.04Min: 105.47 / Avg: 265.24 / Max: 464.47Min: 59.63 / Avg: 268.15 / Max: 377.52Min: 27.99 / Avg: 273.01 / Max: 332.14Min: 76.02 / Avg: 287.68 / Max: 377.28Min: 68.84 / Avg: 291.26 / Max: 378.07Min: 107.96 / Avg: 295.44 / Max: 567.47Min: 35.75 / Avg: 329.8 / Max: 411.04Min: 106.2 / Avg: 388.48 / Max: 582.9Min: 42.24 / Avg: 558.27 / Max: 695.79Min: 63.21 / Avg: 573.82 / Max: 678.02Min: 175.58 / Avg: 588.27 / Max: 757.42Min: 199.93 / Avg: 609.51 / Max: 752.77Min: 210.27 / Avg: 614.16 / Max: 754.39Min: 78.39 / Avg: 616.75 / Max: 753.89Min: 63.78 / Avg: 623.33 / Max: 822.161. EPYC 8534PN: Approximate power consumption of 7079 Joules per run.2. EPYC 8534P: Approximate power consumption of 7562 Joules per run.3. Xeon 6766E: Approximate power consumption of 11029 Joules per run.4. Xeon 6780E: Approximate power consumption of 12441 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 17554 Joules per run.6. Xeon Platinum 8592+: Approximate power consumption of 11375 Joules per run.7. EPYC 9754: Approximate power consumption of 19719 Joules per run.8. Xeon 6766E 2P: Approximate power consumption of 17506 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 13676 Joules per run.10. EPYC 9654: Approximate power consumption of 23752 Joules per run.11. Xeon Max 9480: Approximate power consumption of 15247 Joules per run.12. Xeon Max 9468: Approximate power consumption of 16408 Joules per run.13. Xeon 6780E 2P: Approximate power consumption of 17874 Joules per run.14. EPYC 9684X: Approximate power consumption of 25944 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 19683 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 51174 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 54322 Joules per run.18. Xeon Platinum 8490H 2P: Approximate power consumption of 41767 Joules per run.19. Xeon Max 9480 2P: Approximate power consumption of 46120 Joules per run.20. Xeon Max 9468 2P: Approximate power consumption of 49133 Joules per run.21. Xeon Platinum 8592+ 2P: Approximate power consumption of 64348 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 38854 Joules per run.

CloverLeaf

CloverLeaf is a Lagrangian-Eulerian hydrodynamics benchmark. This test profile currently makes use of CloverLeaf's OpenMP version. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm64_shortEPYC 9684X 2PXeon Platinum 8490H 2PEPYC 9754 2PXeon 6780E 2PXeon 6766E 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8380 2PXeon 6766EXeon 6780EXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468EPYC 9684XXeon Max 9480EPYC 9654EPYC 9754EPYC 8534PEPYC 8534PNXeon Platinum 83801428425670SE +/- 0.23, N = 3SE +/- 0.24, N = 3SE +/- 0.30, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 1.11, N = 12SE +/- 0.45, N = 3SE +/- 0.31, N = 15SE +/- 0.40, N = 4SE +/- 0.31, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.15, N = 3SE +/- 1.81, N = 15SE +/- 0.17, N = 3SE +/- 2.15, N = 15SE +/- 2.07, N = 12SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 322.8326.5827.7428.9228.9930.0531.9032.2532.4435.2938.0138.0139.3839.4841.4342.1742.2246.5048.3657.3857.5460.891. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
OpenBenchmarking.orgWatts, Fewer Is BetterCloverLeaf 1.3CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EEPYC 9654Xeon Platinum 8380EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon 6766E 2PEPYC 9754 2PXeon 6780E 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P130260390520650Min: 17.1 / Avg: 122.03 / Max: 133.14Min: 19.22 / Avg: 132.55 / Max: 146.42Min: 43.65 / Avg: 168.7 / Max: 186.26Min: 19.77 / Avg: 183.89 / Max: 245.13Min: 43.45 / Avg: 184.14 / Max: 204.33Min: 25.91 / Avg: 223.18 / Max: 288.87Min: 53.35 / Avg: 254.93 / Max: 281.37Min: 33.05 / Avg: 264.63 / Max: 353.22Min: 32.08 / Avg: 299.62 / Max: 336.85Min: 57.26 / Avg: 320.54 / Max: 366.56Min: 74.72 / Avg: 323.64 / Max: 372.82Min: 76.4 / Avg: 324.2 / Max: 367.03Min: 104.9 / Avg: 364.67 / Max: 444.64Min: 42.14 / Avg: 366.92 / Max: 461.67Min: 107.36 / Avg: 389.09 / Max: 472.12Min: 56.35 / Avg: 437.97 / Max: 551.54Min: 102.86 / Avg: 479 / Max: 543.07Min: 68.07 / Avg: 499.33 / Max: 638.11Min: 75.65 / Avg: 552.24 / Max: 662.73Min: 166.73 / Avg: 611.92 / Max: 712.51Min: 195.63 / Avg: 623.99 / Max: 717.07Min: 199.64 / Avg: 627.92 / Max: 713.691. EPYC 8534PN: Approximate power consumption of 7688 Joules per run.2. EPYC 8534P: Approximate power consumption of 8306 Joules per run.3. Xeon 6766E: Approximate power consumption of 7310 Joules per run.4. EPYC 9754: Approximate power consumption of 9869 Joules per run.5. Xeon 6780E: Approximate power consumption of 7979 Joules per run.6. EPYC 9654: Approximate power consumption of 11531 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 16825 Joules per run.8. EPYC 9684X: Approximate power consumption of 12490 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 13183 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 14318 Joules per run.11. Xeon Max 9480: Approximate power consumption of 15211 Joules per run.12. Xeon Max 9468: Approximate power consumption of 15021 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 12642 Joules per run.14. EPYC 9754 2P: Approximate power consumption of 12108 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 13489 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 15438 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 19000 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 13981 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 20433 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 19581 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 23212 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 23390 Joules per run.

OSPRay Studio

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon 6780E 2PXeon Platinum 8592+Xeon 6766E 2PXeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PXeon 6780EEPYC 8534PNXeon 6766EXeon Platinum 83808001600240032004000SE +/- 0.67, N = 3SE +/- 1.45, N = 3SE +/- 0.58, N = 3SE +/- 0.00, N = 3SE +/- 0.88, N = 3SE +/- 0.88, N = 3SE +/- 0.33, N = 3SE +/- 1.53, N = 3SE +/- 2.65, N = 3SE +/- 1.00, N = 3SE +/- 16.65, N = 5SE +/- 1.45, N = 3SE +/- 4.67, N = 3SE +/- 2.73, N = 3SE +/- 0.88, N = 3SE +/- 1.20, N = 3SE +/- 1.20, N = 3SE +/- 1.00, N = 3SE +/- 3.51, N = 3SE +/- 3.06, N = 3SE +/- 6.23, N = 3SE +/- 3.79, N = 3630660780898106311301143122512371391163117091832183319772123235724212472264927313616
OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Platinum 8380EPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon 6766E 2PEPYC 9684XXeon 6780E 2PXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P140280420560700Min: 17.17 / Avg: 114.16 / Max: 142.74Min: 18.61 / Avg: 131.5 / Max: 167.12Min: 43.67 / Avg: 146.96 / Max: 222.56Min: 43.6 / Avg: 190.51 / Max: 286.01Min: 54.18 / Avg: 227.88 / Max: 291.87Min: 22.69 / Avg: 249.28 / Max: 335.5Min: 31.26 / Avg: 263.32 / Max: 331.82Min: 26.01 / Avg: 290.77 / Max: 377.76Min: 61.31 / Avg: 293.93 / Max: 377.6Min: 74.64 / Avg: 306.2 / Max: 376.48Min: 71.66 / Avg: 307.39 / Max: 377.12Min: 105.7 / Avg: 310.43 / Max: 465.96Min: 30.75 / Avg: 323.21 / Max: 411.04Min: 108.07 / Avg: 363.45 / Max: 555.01Min: 103.42 / Avg: 440.54 / Max: 582.66Min: 42.39 / Avg: 515 / Max: 688.22Min: 59.99 / Avg: 534.76 / Max: 676.92Min: 79.09 / Avg: 574.5 / Max: 751.34Min: 179.12 / Avg: 588.21 / Max: 753.37Min: 204.32 / Avg: 605.57 / Max: 755.38Min: 208.56 / Avg: 606.68 / Max: 753.95Min: 67.19 / Avg: 642.74 / Max: 821.111. EPYC 8534PN: Approximate power consumption of 9285 Joules per run.2. EPYC 8534P: Approximate power consumption of 10432 Joules per run.3. Xeon 6766E: Approximate power consumption of 12247 Joules per run.4. Xeon 6780E: Approximate power consumption of 15939 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 19522 Joules per run.6. EPYC 9754: Approximate power consumption of 17948 Joules per run.7. EPYC 9654: Approximate power consumption of 18959 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 21130 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 21849 Joules per run.10. Xeon Max 9480: Approximate power consumption of 23169 Joules per run.11. Xeon Max 9468: Approximate power consumption of 23772 Joules per run.12. Xeon 6766E 2P: Approximate power consumption of 26904 Joules per run.13. EPYC 9684X: Approximate power consumption of 22948 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 30385 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 33628 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 35879 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 36185 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 38874 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 41763 Joules per run.20. Xeon Max 9468 2P: Approximate power consumption of 43197 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 42670 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 43492 Joules per run.

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8380 2PEPYC 9684XEPYC 9654Xeon Platinum 8380EPYC 8534PEPYC 8534PNXeon 6780EXeon 6780E 2PEPYC 9754Xeon 6766EXeon 6766E 2PXeon Platinum 8592+Xeon Max 9468Xeon Platinum 8490HXeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9480Xeon Platinum 8490H 2P1530456075SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.26, N = 15SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.15, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 3SE +/- 0.28, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 3SE +/- 0.03, N = 311.9514.3015.8416.8421.6327.4631.0531.9934.7635.3037.1738.2138.8741.5055.0755.7455.9956.7157.1362.1162.5365.021. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380EPYC 9754Xeon 6780EEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P140280420560700Min: 17.95 / Avg: 130.31 / Max: 141.74Min: 16.37 / Avg: 152.34 / Max: 164.44Min: 43.66 / Avg: 218.36 / Max: 239.94Min: 50.28 / Avg: 253.24 / Max: 288.06Min: 21.36 / Avg: 269.44 / Max: 322.88Min: 43.56 / Avg: 269.61 / Max: 298.84Min: 30.63 / Avg: 302.4 / Max: 328.21Min: 34.63 / Avg: 325.47 / Max: 376.24Min: 59.15 / Avg: 327.9 / Max: 376.83Min: 84.64 / Avg: 330.18 / Max: 380.81Min: 74.41 / Avg: 330.18 / Max: 376.61Min: 33.63 / Avg: 370.93 / Max: 400.44Min: 106.85 / Avg: 458.61 / Max: 523.13Min: 99.46 / Avg: 509.59 / Max: 578.94Min: 109.15 / Avg: 564.61 / Max: 636.36Min: 40.64 / Avg: 591.23 / Max: 648.1Min: 60.61 / Avg: 599.17 / Max: 650.25Min: 81.23 / Avg: 641.35 / Max: 755.31Min: 168.6 / Avg: 652.87 / Max: 754.8Min: 200.42 / Avg: 659.67 / Max: 754.38Min: 201 / Avg: 659.95 / Max: 753.12Min: 67.8 / Avg: 760.09 / Max: 819.061. EPYC 8534PN: Approximate power consumption of 8514 Joules per run.2. EPYC 8534P: Approximate power consumption of 9902 Joules per run.3. Xeon 6766E: Approximate power consumption of 14412 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 16545 Joules per run.5. EPYC 9754: Approximate power consumption of 17639 Joules per run.6. Xeon 6780E: Approximate power consumption of 17615 Joules per run.7. EPYC 9654: Approximate power consumption of 19656 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 21373 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 21641 Joules per run.10. Xeon Max 9480: Approximate power consumption of 21792 Joules per run.11. Xeon Max 9468: Approximate power consumption of 21682 Joules per run.12. EPYC 9684X: Approximate power consumption of 24110 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 31033 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 33123 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 38017 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 39218 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 39146 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 43398 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 44178 Joules per run.20. Xeon Max 9468 2P: Approximate power consumption of 43978 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 44437 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 49406 Joules per run.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684XXeon 6780E 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9654Xeon 6766E 2PXeon Max 9468 2PEPYC 9754Xeon Platinum 8380 2PXeon Platinum 8592+Xeon Platinum 8490HXeon 6780EEPYC 8534PXeon 6766EEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon Platinum 83809001800270036004500SE +/- 5.40, N = 3SE +/- 5.33, N = 3SE +/- 3.90, N = 3SE +/- 11.53, N = 3SE +/- 1.09, N = 3SE +/- 2.23, N = 3SE +/- 0.66, N = 3SE +/- 1.74, N = 3SE +/- 6.85, N = 3SE +/- 2.08, N = 3SE +/- 1.56, N = 3SE +/- 11.41, N = 15SE +/- 3.75, N = 3SE +/- 0.47, N = 3SE +/- 2.65, N = 3SE +/- 2.82, N = 3SE +/- 0.65, N = 3SE +/- 2.69, N = 3SE +/- 0.81, N = 3SE +/- 2.94, N = 3SE +/- 2.29, N = 3SE +/- 0.62, N = 34032.664013.963353.732237.692212.411933.081843.611801.891743.491731.501691.791671.231186.241159.661068.431018.18998.09924.90918.53894.87860.64642.441. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PXeon Max 9468 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Max 9480 2PXeon Platinum 8490H 2PEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P60120180240300SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.17, N = 3SE +/- 0.37, N = 3SE +/- 0.11, N = 3SE +/- 0.28, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.17, N = 3SE +/- 0.35, N = 3SE +/- 0.13, N = 3SE +/- 0.22, N = 3SE +/- 0.25, N = 3SE +/- 0.45, N = 3SE +/- 0.89, N = 3SE +/- 0.84, N = 3SE +/- 1.74, N = 15SE +/- 3.87, N = 316.5521.3422.5923.6624.5525.9830.4731.7933.5034.1634.2534.3136.6138.1040.6366.4466.6383.77146.78160.13266.10285.991. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8380EPYC 9684XXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2P100200300400500Min: 16.96 / Avg: 119.46 / Max: 129.05Min: 19.18 / Avg: 133.31 / Max: 143.64Min: 43.73 / Avg: 146.66 / Max: 157.5Min: 43.59 / Avg: 175.34 / Max: 190.81Min: 21.46 / Avg: 198.94 / Max: 215.69Min: 30.05 / Avg: 245.24 / Max: 265.47Min: 51.87 / Avg: 247.61 / Max: 266.6Min: 34.21 / Avg: 290.09 / Max: 313.77Min: 104.82 / Avg: 306.33 / Max: 331.18Min: 107.98 / Avg: 351.03 / Max: 380.24Min: 35.54 / Avg: 404.89 / Max: 435.36Min: 102.55 / Avg: 456.44 / Max: 489.76Min: 55.89 / Avg: 483.5 / Max: 517.8Min: 62.47 / Avg: 550.79 / Max: 593.021. EPYC 8534PN: Approximate power consumption of 7765 Joules per run.2. EPYC 8534P: Approximate power consumption of 8665 Joules per run.3. Xeon 6766E: Approximate power consumption of 9631 Joules per run.4. Xeon 6780E: Approximate power consumption of 11456 Joules per run.5. EPYC 9754: Approximate power consumption of 12865 Joules per run.6. EPYC 9654: Approximate power consumption of 15859 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 16094 Joules per run.8. EPYC 9684X: Approximate power consumption of 18759 Joules per run.9. Xeon 6766E 2P: Approximate power consumption of 20320 Joules per run.10. Xeon 6780E 2P: Approximate power consumption of 23215 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 26318 Joules per run.12. Xeon Platinum 8380 2P: Approximate power consumption of 29669 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 31266 Joules per run.14. EPYC 9684X 2P: Approximate power consumption of 35434 Joules per run.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PXeon Max 9468 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Max 9480 2PXeon Platinum 8490H 2PEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P1428425670SE +/- 0.27014, N = 3SE +/- 0.09731, N = 3SE +/- 0.10899, N = 3SE +/- 0.20934, N = 3SE +/- 0.27882, N = 3SE +/- 0.55506, N = 3SE +/- 0.11901, N = 3SE +/- 0.27122, N = 3SE +/- 0.04145, N = 3SE +/- 0.03174, N = 3SE +/- 0.11212, N = 3SE +/- 0.09239, N = 3SE +/- 0.12474, N = 3SE +/- 0.23936, N = 3SE +/- 0.07716, N = 3SE +/- 0.05013, N = 3SE +/- 0.05569, N = 3SE +/- 0.06474, N = 3SE +/- 0.04131, N = 3SE +/- 0.03255, N = 3SE +/- 0.02474, N = 15SE +/- 0.04782, N = 360.4094046.8491044.2748042.2711040.7289038.5025032.8141031.4589029.8493029.2690029.1955029.1487027.3128026.2475024.6095015.0516015.0082011.938206.813306.245213.760033.497851. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PXeon Max 9468 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Max 9480 2PXeon Platinum 8490H 2PEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P60120180240300SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.17, N = 3SE +/- 0.37, N = 3SE +/- 0.11, N = 3SE +/- 0.28, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.17, N = 3SE +/- 0.35, N = 3SE +/- 0.13, N = 3SE +/- 0.22, N = 3SE +/- 0.25, N = 3SE +/- 0.45, N = 3SE +/- 0.89, N = 3SE +/- 0.84, N = 3SE +/- 1.74, N = 15SE +/- 3.87, N = 316.5521.3422.5923.6624.5525.9830.4731.7933.5034.1634.2534.3136.6138.1040.6366.4466.6383.77146.78160.13266.10285.991. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9684XEPYC 9684X 2PEPYC 9654Xeon Platinum 8490HEPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon Platinum 8380 2PXeon Platinum 8380Xeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P4080120160200SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.02, N = 3SE +/- 0.45, N = 15SE +/- 0.46, N = 3SE +/- 0.10, N = 3SE +/- 0.33, N = 3SE +/- 0.34, N = 3SE +/- 0.13, N = 321.8722.9623.1224.0024.9425.1225.7232.0033.1834.9236.2036.9038.8539.8641.3845.7160.9062.64153.76157.28172.72180.291. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon 6780EXeon Platinum 8592+EPYC 9754Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9654EPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2P140280420560700Min: 16.48 / Avg: 135.3 / Max: 146.77Min: 17.94 / Avg: 165.08 / Max: 177.71Min: 43.65 / Avg: 235.17 / Max: 270.9Min: 49.49 / Avg: 255.74 / Max: 292.14Min: 43.62 / Avg: 308.92 / Max: 356.46Min: 24.83 / Avg: 318.97 / Max: 381.52Min: 23.52 / Avg: 323.53 / Max: 352.29Min: 59.81 / Avg: 328.72 / Max: 377.28Min: 75.49 / Avg: 331.88 / Max: 373.56Min: 87.21 / Avg: 332.74 / Max: 375.71Min: 30.45 / Avg: 333.47 / Max: 360.29Min: 31.71 / Avg: 382.65 / Max: 411.13Min: 106.76 / Avg: 462.61 / Max: 540.57Min: 102.66 / Avg: 511.4 / Max: 581.89Min: 108.82 / Avg: 608.93 / Max: 712.7Min: 42.75 / Avg: 632.45 / Max: 690.87Min: 59.67 / Avg: 652.58 / Max: 705.65Min: 79.4 / Avg: 653.57 / Max: 770.7Min: 175.49 / Avg: 660.59 / Max: 741.22Min: 200.26 / Avg: 664.69 / Max: 755.11Min: 208.68 / Avg: 665.43 / Max: 751.81Min: 67.9 / Avg: 760.8 / Max: 819.211. EPYC 8534PN: Approximate power consumption of 8795 Joules per run.2. EPYC 8534P: Approximate power consumption of 10730 Joules per run.3. Xeon 6766E: Approximate power consumption of 15364 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 16538 Joules per run.5. Xeon 6780E: Approximate power consumption of 20183 Joules per run.6. Xeon Platinum 8592+: Approximate power consumption of 20733 Joules per run.7. EPYC 9754: Approximate power consumption of 20921 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 21367 Joules per run.9. Xeon Max 9468: Approximate power consumption of 21351 Joules per run.10. Xeon Max 9480: Approximate power consumption of 21517 Joules per run.11. EPYC 9654: Approximate power consumption of 21453 Joules per run.12. EPYC 9684X: Approximate power consumption of 24744 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 30841 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 33071 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 40799 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 41531 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 42418 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 42918 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 43379 Joules per run.20. Xeon Max 9480 2P: Approximate power consumption of 43205 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 43253 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 49452 Joules per run.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 9684XXeon Platinum 8592+EPYC 9654Xeon Max 9480Xeon Max 9468Xeon 6780E 2PXeon Platinum 8490HXeon 6766E 2PEPYC 8534PEPYC 8534PNXeon Platinum 8380 2PXeon 6780EXeon 6766EXeon Platinum 838014002800420056007000SE +/- 14.68, N = 3SE +/- 13.59, N = 3SE +/- 3.43, N = 3SE +/- 9.83, N = 3SE +/- 2.46, N = 3SE +/- 2.81, N = 3SE +/- 1.09, N = 3SE +/- 7.27, N = 3SE +/- 4.06, N = 3SE +/- 0.73, N = 3SE +/- 4.84, N = 3SE +/- 4.55, N = 3SE +/- 3.41, N = 3SE +/- 3.81, N = 3SE +/- 1.46, N = 3SE +/- 1.20, N = 3SE +/- 3.51, N = 3SE +/- 0.47, N = 3SE +/- 9.58, N = 15SE +/- 0.61, N = 3SE +/- 1.73, N = 3SE +/- 4.60, N = 36400.945766.625570.635178.294744.054351.593998.023280.252986.332924.662739.012243.842074.301826.821643.431593.881542.611396.781313.39934.97832.29637.761. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9754 2PEPYC 9684XEPYC 9654Xeon Platinum 8380EPYC 8534PEPYC 9754EPYC 8534PNXeon Platinum 8592+Xeon 6780EXeon 6780E 2PXeon Platinum 8592+ 2PXeon 6766EXeon 6766E 2PXeon Max 9468Xeon Max 9468 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9480 2PXeon Platinum 8490H 2P510152025SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.12, N = 15SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 34.084.464.545.007.858.589.2610.7810.9711.4813.7314.0114.3014.6715.1116.2816.3317.1917.8419.4420.2421.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon 6780EXeon Platinum 8592+EPYC 9754EPYC 9654Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P140280420560700Min: 17.95 / Avg: 132.64 / Max: 143.89Min: 17.62 / Avg: 156.89 / Max: 169.02Min: 43.79 / Avg: 234.55 / Max: 257.28Min: 49.67 / Avg: 255.11 / Max: 289.85Min: 43.53 / Avg: 284.95 / Max: 316.24Min: 33.71 / Avg: 302.37 / Max: 379.73Min: 21.25 / Avg: 305.35 / Max: 334.91Min: 29.58 / Avg: 315.71 / Max: 340.19Min: 59.46 / Avg: 330.49 / Max: 383.24Min: 71.96 / Avg: 331 / Max: 377.8Min: 75.87 / Avg: 332.1 / Max: 380.66Min: 34.99 / Avg: 371.14 / Max: 399.65Min: 107.07 / Avg: 468.4 / Max: 537.67Min: 100.89 / Avg: 510.45 / Max: 581Min: 110.43 / Avg: 596.74 / Max: 654.1Min: 43.09 / Avg: 614.49 / Max: 665.93Min: 60.42 / Avg: 615.26 / Max: 666.72Min: 85.37 / Avg: 650.24 / Max: 758.93Min: 169.19 / Avg: 657.97 / Max: 750.83Min: 209.95 / Avg: 663.67 / Max: 754.1Min: 203.39 / Avg: 666.38 / Max: 758.84Min: 68.28 / Avg: 749.07 / Max: 815.771. EPYC 8534PN: Approximate power consumption of 8578 Joules per run.2. EPYC 8534P: Approximate power consumption of 10146 Joules per run.3. Xeon 6766E: Approximate power consumption of 15246 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 16497 Joules per run.5. Xeon 6780E: Approximate power consumption of 18427 Joules per run.6. Xeon Platinum 8592+: Approximate power consumption of 21468 Joules per run.7. EPYC 9754: Approximate power consumption of 19746 Joules per run.8. EPYC 9654: Approximate power consumption of 20311 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 21482 Joules per run.10. Xeon Max 9468: Approximate power consumption of 21404 Joules per run.11. Xeon Max 9480: Approximate power consumption of 21586 Joules per run.12. EPYC 9684X: Approximate power consumption of 23877 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 30602 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 33009 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 39385 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 39942 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 39787 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 43133 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 43645 Joules per run.20. Xeon Max 9468 2P: Approximate power consumption of 43360 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 43314 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 48190 Joules per run.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9754Xeon Max 9468 2PEPYC 9654Xeon Max 9480 2PXeon Platinum 8490H 2PXeon 6780E 2PXeon Platinum 8592+Xeon Platinum 8380 2PXeon 6766E 2PXeon Platinum 8490HEPYC 8534PXeon Max 9468Xeon Max 9480EPYC 8534PNXeon 6780EXeon 6766EXeon Platinum 83803K6K9K12K15KSE +/- 1.24, N = 3SE +/- 4.04, N = 3SE +/- 4.21, N = 3SE +/- 6.25, N = 3SE +/- 3.54, N = 3SE +/- 66.33, N = 15SE +/- 4.11, N = 3SE +/- 8.39, N = 3SE +/- 8.70, N = 3SE +/- 11.51, N = 3SE +/- 5.08, N = 3SE +/- 0.73, N = 3SE +/- 2.84, N = 3SE +/- 8.74, N = 3SE +/- 0.81, N = 3SE +/- 2.22, N = 3SE +/- 8.09, N = 3SE +/- 5.68, N = 3SE +/- 2.89, N = 3SE +/- 2.61, N = 3SE +/- 1.12, N = 3SE +/- 1.06, N = 312750.5911735.4210708.918719.376017.195778.515576.865528.155525.565483.814992.784656.924390.814376.093325.902943.082935.472877.322763.482553.552366.832120.331. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XXeon Max 9468Xeon Max 9480Xeon Platinum 8380EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9754 2PXeon 6780EXeon Platinum 8380 2PEPYC 9654 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2PXeon 6766EXeon 6780E 2PXeon 6766E 2P1326395265SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.00, N = 3SE +/- 0.06, N = 3SE +/- 0.41, N = 3SE +/- 0.22, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.30, N = 3SE +/- 0.18, N = 3SE +/- 0.33, N = 3SE +/- 0.43, N = 4SE +/- 0.35, N = 7SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.55, N = 3SE +/- 0.32, N = 3SE +/- 0.15, N = 3SE +/- 0.05, N = 3SE +/- 0.12, N = 3SE +/- 0.71, N = 329.9630.9231.5333.2933.5234.8135.0735.1135.6035.7935.8836.4538.0038.4238.5239.0240.4540.5241.5742.9054.2556.771. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8380EPYC 9684XXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2P80160240320400Min: 16.17 / Avg: 95.68 / Max: 104.17Min: 17.92 / Avg: 105.97 / Max: 115.61Min: 43.71 / Avg: 132.85 / Max: 145.13Min: 43.46 / Avg: 155.26 / Max: 169.97Min: 21.43 / Avg: 160.48 / Max: 176.89Min: 29.71 / Avg: 198.61 / Max: 217.44Min: 53.88 / Avg: 210.59 / Max: 230.53Min: 33.52 / Avg: 227.41 / Max: 249.95Min: 104.02 / Avg: 236.43 / Max: 258.12Min: 106.52 / Avg: 256.16 / Max: 280.65Min: 41.16 / Avg: 302.54 / Max: 329.11Min: 101.44 / Avg: 386.17 / Max: 431.52Min: 58.29 / Avg: 391.03 / Max: 427.27Min: 65.93 / Avg: 426.21 / Max: 468.571. EPYC 8534PN: Approximate power consumption of 6347 Joules per run.2. EPYC 8534P: Approximate power consumption of 6994 Joules per run.3. Xeon 6766E: Approximate power consumption of 8945 Joules per run.4. Xeon 6780E: Approximate power consumption of 10402 Joules per run.5. EPYC 9754: Approximate power consumption of 10632 Joules per run.6. EPYC 9654: Approximate power consumption of 13042 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 13969 Joules per run.8. EPYC 9684X: Approximate power consumption of 14933 Joules per run.9. Xeon 6766E 2P: Approximate power consumption of 16077 Joules per run.10. Xeon 6780E 2P: Approximate power consumption of 17248 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 20097 Joules per run.12. Xeon Platinum 8380 2P: Approximate power consumption of 25745 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 25808 Joules per run.14. EPYC 9684X 2P: Approximate power consumption of 27988 Joules per run.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XXeon Max 9468Xeon Max 9480Xeon Platinum 8380EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9754 2PXeon 6780EXeon Platinum 8380 2PEPYC 9654 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2PXeon 6766EXeon 6780E 2PXeon 6766E 2P816243240SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.00, N = 3SE +/- 0.06, N = 3SE +/- 0.36, N = 3SE +/- 0.19, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.24, N = 3SE +/- 0.14, N = 3SE +/- 0.25, N = 3SE +/- 0.33, N = 4SE +/- 0.24, N = 7SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.34, N = 3SE +/- 0.19, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.22, N = 333.3832.3431.7130.0429.8428.7328.5228.4828.0927.9427.8727.4526.3326.0325.9625.6324.7324.6824.0523.3118.4317.621. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XXeon Max 9468Xeon Max 9480Xeon Platinum 8380EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9754 2PXeon 6780EXeon Platinum 8380 2PEPYC 9654 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2PXeon 6766EXeon 6780E 2PXeon 6766E 2P1326395265SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.00, N = 3SE +/- 0.06, N = 3SE +/- 0.41, N = 3SE +/- 0.22, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.30, N = 3SE +/- 0.18, N = 3SE +/- 0.33, N = 3SE +/- 0.43, N = 4SE +/- 0.35, N = 7SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.55, N = 3SE +/- 0.32, N = 3SE +/- 0.15, N = 3SE +/- 0.05, N = 3SE +/- 0.12, N = 3SE +/- 0.71, N = 329.9630.9231.5333.2933.5234.8135.0735.1135.6035.7935.8836.4538.0038.4238.5239.0240.4540.5241.5742.9054.2556.771. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: AlexNetXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Max 9480 2PEPYC 9754Xeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8380 2PEPYC 9684XEPYC 9654Xeon Platinum 8490HXeon Max 9480Xeon 6780E 2PXeon Max 9468Xeon 6766E 2PXeon Platinum 8380EPYC 8534PEPYC 8534PNXeon 6780EXeon 6766E400800120016002000SE +/- 19.23, N = 3SE +/- 18.52, N = 3SE +/- 23.15, N = 4SE +/- 7.97, N = 3SE +/- 12.71, N = 3SE +/- 8.55, N = 3SE +/- 4.07, N = 3SE +/- 17.88, N = 4SE +/- 1.84, N = 3SE +/- 5.91, N = 3SE +/- 0.49, N = 3SE +/- 0.67, N = 3SE +/- 0.51, N = 3SE +/- 5.13, N = 3SE +/- 38.99, N = 12SE +/- 3.89, N = 3SE +/- 20.10, N = 12SE +/- 1.47, N = 3SE +/- 0.35, N = 3SE +/- 0.57, N = 3SE +/- 0.86, N = 3SE +/- 2.03, N = 32039.631899.641897.641876.661862.791677.621620.531604.111486.121470.461392.911363.331278.451108.951064.181047.96979.89883.00875.23796.82732.79677.40
OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: AlexNetEPYC 8534PNEPYC 9754EPYC 8534PEPYC 9654Xeon Platinum 8592+EPYC 9684XEPYC 9754 2PXeon Platinum 8490HXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380Xeon 6766EXeon Max 9480Xeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8380 2PXeon 6780EXeon Max 9480 2PXeon Max 9468 2PXeon 6766E 2PXeon 6780E 2P2468106.9906.8996.4945.2944.8614.6754.5694.4263.9033.8533.5263.5173.5023.4093.2203.1473.1013.0502.6742.5372.4062.310
OpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.16.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EXeon Platinum 8380EPYC 9654Xeon Platinum 8490HEPYC 9684XXeon Platinum 8592+Xeon Max 9480Xeon Max 9468Xeon 6766E 2PEPYC 9754 2PXeon 6780E 2PXeon Platinum 8380 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P120240360480600Min: 17.15 / Avg: 114 / Max: 136.39Min: 19.53 / Avg: 134.77 / Max: 159.36Min: 43.65 / Avg: 193.42 / Max: 225.02Min: 21.12 / Avg: 234.91 / Max: 276.8Min: 43.52 / Avg: 240.23 / Max: 284.38Min: 53.82 / Avg: 251.06 / Max: 280.69Min: 29.56 / Avg: 257.54 / Max: 304.86Min: 60.6 / Avg: 288.85 / Max: 359.42Min: 32.89 / Avg: 297.93 / Max: 351.95Min: 33.58 / Avg: 305.73 / Max: 353.3Min: 83.71 / Avg: 325.32 / Max: 365.52Min: 73.05 / Avg: 325.43 / Max: 363.64Min: 105.98 / Avg: 407.31 / Max: 478.77Min: 42.21 / Avg: 410.73 / Max: 503.82Min: 108.97 / Avg: 460.62 / Max: 565.85Min: 99.17 / Avg: 474.18 / Max: 540.4Min: 59.19 / Avg: 483.44 / Max: 576.3Min: 84.88 / Avg: 522.57 / Max: 631.68Min: 64.96 / Avg: 538.13 / Max: 644.98Min: 161.55 / Avg: 603.65 / Max: 700.57Min: 209.29 / Avg: 625.4 / Max: 706.28Min: 200.65 / Avg: 632.22 / Max: 705.951. EPYC 8534PN: Approximate power consumption of 8892 Joules per run.2. EPYC 8534P: Approximate power consumption of 9613 Joules per run.3. Xeon 6766E: Approximate power consumption of 17472 Joules per run.4. EPYC 9754: Approximate power consumption of 9788 Joules per run.5. Xeon 6780E: Approximate power consumption of 20179 Joules per run.6. Xeon Platinum 8380: Approximate power consumption of 17742 Joules per run.7. EPYC 9654: Approximate power consumption of 12362 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 16272 Joules per run.9. EPYC 9684X: Approximate power consumption of 13903 Joules per run.10. Xeon Platinum 8592+: Approximate power consumption of 13452 Joules per run.11. Xeon Max 9480: Approximate power consumption of 18652 Joules per run.12. Xeon Max 9468: Approximate power consumption of 19635 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 26441 Joules per run.14. EPYC 9754 2P: Approximate power consumption of 15471 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 27983 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 21338 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 18209 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 18116 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 19507 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 22134 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 25433 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 26553 Joules per run.

QuantLib

QuantLib is an open-source library/framework around quantitative finance for modeling, trading and risk management scenarios. QuantLib is written in C++ with Boost and its built-in benchmark used reports the QuantLib Benchmark Index benchmark score. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-ThreadedEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon 6780E 2PXeon 6766E 2PXeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon 6780EXeon 6766EXeon Platinum 8592+Xeon Platinum 8380 2PXeon Platinum 8490HEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 9468Xeon Platinum 8380160K320K480K640K800KSE +/- 804.57, N = 3SE +/- 1065.76, N = 3SE +/- 713.18, N = 3SE +/- 1647.70, N = 3SE +/- 1610.78, N = 3SE +/- 248.00, N = 3SE +/- 156.35, N = 3SE +/- 362.38, N = 3SE +/- 412.72, N = 3SE +/- 160.59, N = 3SE +/- 86.78, N = 3SE +/- 286.86, N = 3SE +/- 846.02, N = 3SE +/- 306.14, N = 3SE +/- 63.14, N = 3SE +/- 457.00, N = 3SE +/- 105.60, N = 3SE +/- 82.80, N = 3SE +/- 40.48, N = 3SE +/- 86.28, N = 3SE +/- 155.19, N = 3SE +/- 395.04, N = 3759922.1644091.0593246.9519392.2456271.0380867.5374413.5350187.5319827.2316359.2294183.2288129.1262432.6233836.3195648.8182366.9179647.5172566.8162727.4153920.8143755.391036.51. (CXX) g++ options: -O3 -march=native -fPIE -pie
OpenBenchmarking.orgMFLOPS Per Watt, More Is BetterQuantLib 1.32Configuration: Multi-ThreadedEPYC 8534PNEPYC 9754EPYC 9754 2PXeon 6766EEPYC 8534PXeon 6766E 2PXeon 6780EXeon 6780E 2PEPYC 9654EPYC 9654 2PEPYC 9684X 2PEPYC 9684XXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9480 2PXeon Max 9468Xeon Max 9468 2PXeon Platinum 8380 2PXeon Platinum 8380300600900120015001202.801200.711200.401113.281092.361089.21960.37956.27930.70921.01881.58864.58605.78585.75552.74537.18495.61477.83447.64436.19359.31358.69
OpenBenchmarking.orgWatts, Fewer Is BetterQuantLib 1.32CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon 6780EEPYC 9754EPYC 9654Xeon Max 9468Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P140280420560700Min: 16.19 / Avg: 127.97 / Max: 140.32Min: 17.59 / Avg: 157.98 / Max: 175.08Min: 43.59 / Avg: 210.04 / Max: 270.15Min: 49.64 / Avg: 253.81 / Max: 290.36Min: 43.42 / Avg: 273.26 / Max: 357.57Min: 21.13 / Avg: 311.83 / Max: 350.73Min: 28.93 / Avg: 316.09 / Max: 352.6Min: 72.72 / Avg: 321.14 / Max: 375.61Min: 31.57 / Avg: 322.97 / Max: 378.63Min: 58.59 / Avg: 325.01 / Max: 377.73Min: 83.08 / Avg: 328.34 / Max: 376.88Min: 33.64 / Avg: 369.92 / Max: 411.04Min: 103.76 / Avg: 418.9 / Max: 541.48Min: 100.73 / Avg: 507.54 / Max: 581.6Min: 104.62 / Avg: 543.14 / Max: 713.12Min: 40.73 / Avg: 633.06 / Max: 715.84Min: 55.66 / Avg: 644.13 / Max: 715.22Min: 77.95 / Avg: 650.23 / Max: 756.48Min: 167.37 / Avg: 651.9 / Max: 756.65Min: 205.33 / Avg: 660.57 / Max: 754.82Min: 203.63 / Avg: 662.07 / Max: 755.13Min: 65.34 / Avg: 730.61 / Max: 822.151. EPYC 8534PN: Approximate power consumption of 11091 Joules per run.2. EPYC 8534P: Approximate power consumption of 12322 Joules per run.3. Xeon 6766E: Approximate power consumption of 12673 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 22673 Joules per run.5. Xeon 6780E: Approximate power consumption of 14756 Joules per run.6. EPYC 9754: Approximate power consumption of 22867 Joules per run.7. EPYC 9654: Approximate power consumption of 21915 Joules per run.8. Xeon Max 9468: Approximate power consumption of 21088 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 20670 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 21126 Joules per run.11. Xeon Max 9480: Approximate power consumption of 22108 Joules per run.12. EPYC 9684X: Approximate power consumption of 23798 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 26530 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 45510 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 30054 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 47268 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 44874 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 42698 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 44329 Joules per run.20. Xeon Max 9468 2P: Approximate power consumption of 43377 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 45904 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 48464 Joules per run.

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUXeon Platinum 8380 2PXeon Platinum 8592+EPYC 9684X 2PXeon Platinum 8592+ 2PXeon Max 9468EPYC 9654 2PXeon Max 9468 2PXeon Max 9480EPYC 9754 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8380EPYC 9684XEPYC 9654EPYC 9754EPYC 8534PXeon 6780EXeon 6780E 2PEPYC 8534PNXeon 6766EXeon 6766E 2P160320480640800SE +/- 0.22, N = 3SE +/- 0.69, N = 3SE +/- 0.43, N = 3SE +/- 0.33, N = 3SE +/- 0.15, N = 3SE +/- 0.02, N = 3SE +/- 0.40, N = 3SE +/- 0.47, N = 3SE +/- 0.03, N = 3SE +/- 0.35, N = 3SE +/- 0.00, N = 3SE +/- 0.28, N = 3SE +/- 3.13, N = 3SE +/- 0.43, N = 3SE +/- 0.07, N = 3SE +/- 0.18, N = 3SE +/- 0.18, N = 3SE +/- 1.47, N = 3SE +/- 1.63, N = 3SE +/- 0.12, N = 3SE +/- 0.99, N = 3SE +/- 1.58, N = 3207.84224.64233.63234.24236.52253.63256.63257.50275.53278.52283.11356.38415.89471.98510.10551.07592.22618.97630.23654.83692.79719.831. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380EPYC 9754Xeon 6780EEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2P140280420560700Min: 17.81 / Avg: 126.81 / Max: 139.78Min: 18.22 / Avg: 153 / Max: 168.49Min: 43.56 / Avg: 225.98 / Max: 269.62Min: 50.07 / Avg: 251.32 / Max: 290.45Min: 20.35 / Avg: 295.9 / Max: 332.78Min: 43.45 / Avg: 297.23 / Max: 353.99Min: 28.86 / Avg: 317.58 / Max: 349.47Min: 35.2 / Avg: 319.39 / Max: 384.58Min: 58.75 / Avg: 323.68 / Max: 377.26Min: 73.05 / Avg: 326.77 / Max: 376.97Min: 82.85 / Avg: 327.08 / Max: 376.47Min: 35.31 / Avg: 374.05 / Max: 411.15Min: 105.04 / Avg: 434 / Max: 540.8Min: 102.18 / Avg: 501.41 / Max: 578.17Min: 107.91 / Avg: 568.65 / Max: 711.11Min: 42.88 / Avg: 582.16 / Max: 663.93Min: 74.99 / Avg: 625.11 / Max: 757.77Min: 53.33 / Avg: 629.45 / Max: 695.56Min: 166.52 / Avg: 639.29 / Max: 750.58Min: 200.71 / Avg: 649.1 / Max: 748.61Min: 204.33 / Avg: 649.97 / Max: 743.7Min: 67.22 / Avg: 740.61 / Max: 819.791. EPYC 8534PN: Approximate power consumption of 8623 Joules per run.2. EPYC 8534P: Approximate power consumption of 10353 Joules per run.3. Xeon 6766E: Approximate power consumption of 15668 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 16755 Joules per run.5. EPYC 9754: Approximate power consumption of 20417 Joules per run.6. Xeon 6780E: Approximate power consumption of 20608 Joules per run.7. EPYC 9654: Approximate power consumption of 21490 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 21719 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 22010 Joules per run.10. Xeon Max 9468: Approximate power consumption of 22112 Joules per run.11. Xeon Max 9480: Approximate power consumption of 22242 Joules per run.12. EPYC 9684X: Approximate power consumption of 25310 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 32261 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 33595 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 41701 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 40752 Joules per run.17. Xeon Platinum 8592+ 2P: Approximate power consumption of 44800 Joules per run.18. EPYC 9654 2P: Approximate power consumption of 42593 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 45816 Joules per run.20. Xeon Max 9480 2P: Approximate power consumption of 45870 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 45931 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 50115 Joules per run.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 9754 2PXeon Max 9480EPYC 9684X 2PXeon Max 9468EPYC 9654 2PXeon Platinum 8490HEPYC 9754Xeon 6780E 2PEPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PEPYC 9654Xeon 6780EEPYC 8534PXeon 6766EEPYC 8534PNXeon Platinum 8380120240360480600SE +/- 0.77, N = 3SE +/- 0.01, N = 3SE +/- 0.54, N = 3SE +/- 0.58, N = 3SE +/- 0.69, N = 3SE +/- 0.04, N = 3SE +/- 0.41, N = 3SE +/- 0.41, N = 3SE +/- 0.14, N = 3SE +/- 0.01, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.12, N = 3SE +/- 0.18, N = 3SE +/- 0.10, N = 3SE +/- 0.01, N = 3SE +/- 0.15, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.36, N = 3545.21423.18401.45373.50284.64231.83217.11205.03202.59188.74167.83115.78113.68101.5199.7296.0893.9958.0653.8951.8548.7347.991. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OSPRay

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754Xeon Max 9468 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon 6780E 2PXeon Platinum 8380 2PXeon Max 9480Xeon 6766E 2PXeon Max 9468EPYC 8534PEPYC 8534PNXeon 6780EXeon 6766EXeon Platinum 83801428425670SE +/- 0.05, N = 3SE +/- 0.14, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.16, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.23, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 363.8560.3752.6748.7642.8239.3437.7435.9334.6430.6127.1024.6423.1222.5122.3621.2219.9118.4716.9213.4012.1711.86
OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654EPYC 9754 2PEPYC 9684XEPYC 9654 2PXeon Platinum 8592+EPYC 9684X 2PXeon 6766EXeon Platinum 8490HXeon Platinum 8592+ 2PXeon Max 9480Xeon 6780EXeon Platinum 8490H 2PXeon Max 9468Xeon 6766E 2PXeon Max 9480 2PXeon 6780E 2PXeon Max 9468 2PXeon Platinum 8380Xeon Platinum 8380 2P0.0320.0640.0960.1280.160.1420.1350.1300.1120.1110.0940.0910.0880.0840.0790.0790.0770.0700.0690.0680.0630.0610.0600.0580.0550.0490.047
OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 3.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Platinum 8380EPYC 9654EPYC 9754Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon 6766E 2PEPYC 9684XXeon 6780E 2PXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2P140280420560700Min: 16.8 / Avg: 119.14 / Max: 138.68Min: 18.46 / Avg: 136.83 / Max: 158.83Min: 43.64 / Avg: 154.91 / Max: 191.69Min: 43.52 / Avg: 195.57 / Max: 243.19Min: 53.09 / Avg: 241.12 / Max: 287.29Min: 29.59 / Avg: 273.92 / Max: 319.11Min: 23.6 / Avg: 289.58 / Max: 332.39Min: 26.13 / Avg: 308.08 / Max: 376.91Min: 61.9 / Avg: 311.6 / Max: 375.6Min: 76.02 / Avg: 317.76 / Max: 373.98Min: 78.8 / Avg: 318.09 / Max: 375.14Min: 105.18 / Avg: 346.87 / Max: 441Min: 35.77 / Avg: 367.12 / Max: 410.2Min: 107.82 / Avg: 395.24 / Max: 502.47Min: 100.97 / Avg: 476.45 / Max: 565.54Min: 42.2 / Avg: 573.28 / Max: 670.75Min: 60.47 / Avg: 577.89 / Max: 656.09Min: 77.1 / Avg: 630.9 / Max: 750.84Min: 174.41 / Avg: 631.92 / Max: 708.59Min: 207.37 / Avg: 650.92 / Max: 752.3Min: 206.3 / Avg: 652.41 / Max: 753.05Min: 65.72 / Avg: 718.49 / Max: 821.141. EPYC 8534PN: Approximate power consumption of 7148 Joules per run.2. EPYC 8534P: Approximate power consumption of 8073 Joules per run.3. Xeon 6766E: Approximate power consumption of 10430 Joules per run.4. Xeon 6780E: Approximate power consumption of 12777 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 14869 Joules per run.6. EPYC 9654: Approximate power consumption of 15157 Joules per run.7. EPYC 9754: Approximate power consumption of 24325 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 17150 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 17761 Joules per run.10. Xeon Max 9468: Approximate power consumption of 18112 Joules per run.11. Xeon Max 9480: Approximate power consumption of 18025 Joules per run.12. Xeon 6766E 2P: Approximate power consumption of 22315 Joules per run.13. EPYC 9684X: Approximate power consumption of 31205 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 24900 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 27316 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 40703 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 42764 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 47948 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 50553 Joules per run.20. Xeon Max 9480 2P: Approximate power consumption of 53375 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 55020 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 51013 Joules per run.

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Pabellon Barcelona - Compute: CPU-OnlyEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon 6780E 2PXeon 6766E 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon 6780EXeon 6766EXeon Platinum 8380 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon Platinum 8380306090120150SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.17, N = 3SE +/- 0.29, N = 3SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 0.16, N = 3SE +/- 0.26, N = 3SE +/- 0.04, N = 3SE +/- 0.20, N = 3SE +/- 0.08, N = 3SE +/- 0.25, N = 3SE +/- 0.13, N = 3SE +/- 0.26, N = 3SE +/- 0.09, N = 3SE +/- 0.16, N = 3SE +/- 0.15, N = 3SE +/- 0.05, N = 3SE +/- 0.44, N = 3SE +/- 0.31, N = 3SE +/- 0.15, N = 321.6623.8426.3531.2835.1139.8341.8544.8746.3848.8851.2955.2660.1165.6776.1080.2985.1287.9294.4197.80106.96150.39
OpenBenchmarking.orgWatts, Fewer Is BetterBlender 4.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9684XXeon 6766E 2PEPYC 9754 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2P140280420560700Min: 17.1 / Avg: 133.17 / Max: 140.81Min: 19.07 / Avg: 163.93 / Max: 175Min: 43.71 / Avg: 217.74 / Max: 239.54Min: 52.51 / Avg: 261.74 / Max: 291.09Min: 43.58 / Avg: 280.84 / Max: 315.47Min: 21.64 / Avg: 304.63 / Max: 348.18Min: 30.54 / Avg: 312.47 / Max: 346.36Min: 34.2 / Avg: 330.4 / Max: 377.77Min: 60.61 / Avg: 332.25 / Max: 377.75Min: 76.03 / Avg: 336.64 / Max: 376.9Min: 76.38 / Avg: 337.24 / Max: 375.65Min: 31.38 / Avg: 370.95 / Max: 410.68Min: 105.22 / Avg: 415.82 / Max: 498.21Min: 41.28 / Avg: 465.54 / Max: 700.45Min: 98.03 / Avg: 509.42 / Max: 580.91Min: 108.3 / Avg: 523.16 / Max: 632.46Min: 58.1 / Avg: 592.5 / Max: 710.39Min: 77.37 / Avg: 624.76 / Max: 738.53Min: 172.77 / Avg: 638.84 / Max: 757.46Min: 208.34 / Avg: 654.26 / Max: 753.55Min: 211.91 / Avg: 656.12 / Max: 755.31Min: 65.23 / Avg: 677.05 / Max: 822.11. EPYC 8534PN: Approximate power consumption of 13184 Joules per run.2. EPYC 8534P: Approximate power consumption of 14699 Joules per run.3. Xeon 6766E: Approximate power consumption of 15387 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 40657 Joules per run.5. Xeon 6780E: Approximate power consumption of 18255 Joules per run.6. EPYC 9754: Approximate power consumption of 13607 Joules per run.7. EPYC 9654: Approximate power consumption of 16665 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 27974 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 30789 Joules per run.10. Xeon Max 9468: Approximate power consumption of 37591 Joules per run.11. Xeon Max 9480: Approximate power consumption of 34398 Joules per run.12. EPYC 9684X: Approximate power consumption of 18177 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 16771 Joules per run.14. EPYC 9754 2P: Approximate power consumption of 14897 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 41093 Joules per run.16. Xeon 6780E 2P: Approximate power consumption of 19008 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 18170 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 29364 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 33007 Joules per run.20. Xeon Max 9480 2P: Approximate power consumption of 36420 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 39149 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 19183 Joules per run.

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XEPYC 9654Xeon Platinum 8380 2PXeon Platinum 8592+EPYC 8534PEPYC 9754Xeon Platinum 8592+ 2PXeon Max 9468EPYC 8534PNXeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8380Xeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P612182430SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 34.915.206.278.489.479.8211.1711.2211.3511.6912.5412.6713.3413.5914.4215.0416.5018.0823.4924.2425.3326.121. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Max 9468Xeon Platinum 8490HXeon Max 9480EPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2P140280420560700Min: 15.14 / Avg: 128.27 / Max: 140.82Min: 18.03 / Avg: 158.07 / Max: 171.2Min: 43.71 / Avg: 214.7 / Max: 232.23Min: 50.78 / Avg: 254.29 / Max: 289.74Min: 43.7 / Avg: 257.32 / Max: 280.77Min: 22.15 / Avg: 293.51 / Max: 329.03Min: 29.5 / Avg: 315.59 / Max: 344.89Min: 33.49 / Avg: 325.49 / Max: 379.56Min: 73.58 / Avg: 327.03 / Max: 377.73Min: 60.78 / Avg: 328.2 / Max: 380.56Min: 83.78 / Avg: 329.87 / Max: 374.74Min: 34.6 / Avg: 368.08 / Max: 403.09Min: 107.91 / Avg: 444.05 / Max: 496.43Min: 101.65 / Avg: 506.94 / Max: 559.01Min: 110.24 / Avg: 513.09 / Max: 584.23Min: 43.98 / Avg: 604.36 / Max: 672.48Min: 35.7 / Avg: 634.64 / Max: 688.41Min: 84.22 / Avg: 639.31 / Max: 759.19Min: 174.42 / Avg: 651.12 / Max: 753.13Min: 204.78 / Avg: 655.73 / Max: 753.37Min: 206.04 / Avg: 658.8 / Max: 752.52Min: 70.55 / Avg: 710.38 / Max: 794.961. EPYC 8534PN: Approximate power consumption of 8380 Joules per run.2. EPYC 8534P: Approximate power consumption of 10327 Joules per run.3. Xeon 6766E: Approximate power consumption of 14098 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 16444 Joules per run.5. Xeon 6780E: Approximate power consumption of 16897 Joules per run.6. EPYC 9754: Approximate power consumption of 19371 Joules per run.7. EPYC 9654: Approximate power consumption of 20724 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 21482 Joules per run.9. Xeon Max 9468: Approximate power consumption of 21475 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 21661 Joules per run.11. Xeon Max 9480: Approximate power consumption of 21661 Joules per run.12. EPYC 9684X: Approximate power consumption of 24048 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 30491 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 33120 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 35232 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 40291 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 41675 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 43686 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 44493 Joules per run.20. Xeon Max 9480 2P: Approximate power consumption of 44590 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 44140 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 46648 Joules per run.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 9684XEPYC 9754EPYC 9654Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HXeon 6780E 2PEPYC 8534PXeon 6766E 2PEPYC 8534PNXeon Platinum 8380 2PXeon 6780EXeon 6766EXeon Platinum 83802K4K6K8K10KSE +/- 3.37, N = 3SE +/- 4.91, N = 3SE +/- 10.88, N = 3SE +/- 6.56, N = 3SE +/- 8.98, N = 3SE +/- 3.66, N = 3SE +/- 4.05, N = 3SE +/- 4.97, N = 3SE +/- 18.02, N = 3SE +/- 54.09, N = 3SE +/- 25.68, N = 3SE +/- 9.37, N = 3SE +/- 7.17, N = 3SE +/- 4.52, N = 3SE +/- 3.86, N = 3SE +/- 2.97, N = 3SE +/- 5.02, N = 3SE +/- 3.87, N = 3SE +/- 1.00, N = 3SE +/- 2.87, N = 3SE +/- 2.55, N = 3SE +/- 0.24, N = 310934.1710182.169752.899203.197862.587689.327127.285725.035608.075594.815024.324093.733802.613606.122957.692830.122743.392506.102030.971525.261414.861100.181. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8380Xeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 9754Xeon 6780EEPYC 8534PNEPYC 9654 2PEPYC 9684X 2PXeon 6766EEPYC 9754 2PXeon 6780E 2PXeon 6766E 2P306090120150SE +/- 0.57, N = 3SE +/- 0.49, N = 3SE +/- 0.23, N = 3SE +/- 0.18, N = 3SE +/- 0.31, N = 3SE +/- 0.12, N = 3SE +/- 0.56, N = 3SE +/- 0.11, N = 3SE +/- 0.50, N = 3SE +/- 0.23, N = 3SE +/- 0.57, N = 3SE +/- 0.60, N = 3SE +/- 1.08, N = 3SE +/- 0.60, N = 3SE +/- 0.31, N = 3SE +/- 1.29, N = 4SE +/- 0.65, N = 3SE +/- 0.60, N = 3SE +/- 0.10, N = 3SE +/- 0.30, N = 3SE +/- 0.21, N = 3SE +/- 0.90, N = 350.8359.9461.2562.1363.5464.7966.9168.8372.8073.9781.4381.60102.05103.60105.22112.76113.52114.16116.64125.24140.07149.991. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8380EPYC 9684XXeon 6766E 2PEPYC 9754 2PXeon 6780E 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2P90180270360450Min: 16.6 / Avg: 99.26 / Max: 116.55Min: 18.28 / Avg: 121.13 / Max: 131.61Min: 43.69 / Avg: 144.23 / Max: 154.04Min: 43.61 / Avg: 168.62 / Max: 180.75Min: 20.48 / Avg: 190.15 / Max: 204.22Min: 30.08 / Avg: 223.68 / Max: 241.02Min: 53.86 / Avg: 240.25 / Max: 259.56Min: 33.93 / Avg: 264.24 / Max: 286.38Min: 104.24 / Avg: 292.81 / Max: 313.39Min: 40.61 / Avg: 307.67 / Max: 327.17Min: 105.38 / Avg: 317.3 / Max: 341.18Min: 58.35 / Avg: 411.86 / Max: 441.41Min: 103.61 / Avg: 436.17 / Max: 466.43Min: 68.13 / Avg: 462.27 / Max: 4951. EPYC 8534PN: Approximate power consumption of 6452 Joules per run.2. EPYC 8534P: Approximate power consumption of 7873 Joules per run.3. Xeon 6766E: Approximate power consumption of 9471 Joules per run.4. Xeon 6780E: Approximate power consumption of 11072 Joules per run.5. EPYC 9754: Approximate power consumption of 12360 Joules per run.6. EPYC 9654: Approximate power consumption of 14539 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 15616 Joules per run.8. EPYC 9684X: Approximate power consumption of 17175 Joules per run.9. Xeon 6766E 2P: Approximate power consumption of 19423 Joules per run.10. EPYC 9754 2P: Approximate power consumption of 19999 Joules per run.11. Xeon 6780E 2P: Approximate power consumption of 20942 Joules per run.12. EPYC 9654 2P: Approximate power consumption of 26633 Joules per run.13. Xeon Platinum 8380 2P: Approximate power consumption of 28351 Joules per run.14. EPYC 9684X 2P: Approximate power consumption of 30202 Joules per run.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8380Xeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 9754Xeon 6780EEPYC 8534PNEPYC 9654 2PEPYC 9684X 2PXeon 6766EEPYC 9754 2PXeon 6780E 2PXeon 6766E 2P510152025SE +/- 0.21736, N = 3SE +/- 0.13407, N = 3SE +/- 0.06023, N = 3SE +/- 0.04566, N = 3SE +/- 0.07567, N = 3SE +/- 0.02832, N = 3SE +/- 0.12404, N = 3SE +/- 0.02421, N = 3SE +/- 0.09371, N = 3SE +/- 0.04124, N = 3SE +/- 0.08493, N = 3SE +/- 0.09004, N = 3SE +/- 0.10485, N = 3SE +/- 0.05587, N = 3SE +/- 0.02804, N = 3SE +/- 0.10146, N = 4SE +/- 0.05052, N = 3SE +/- 0.04604, N = 3SE +/- 0.00728, N = 3SE +/- 0.01907, N = 3SE +/- 0.01071, N = 3SE +/- 0.03979, N = 319.6773016.6863016.3251016.0956015.7394015.4341014.9460014.5280013.7366013.5190012.2807012.254909.800909.652969.503538.871448.809308.759718.572867.984027.139176.667181. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8380Xeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 9754Xeon 6780EEPYC 8534PNEPYC 9654 2PEPYC 9684X 2PXeon 6766EEPYC 9754 2PXeon 6780E 2PXeon 6766E 2P306090120150SE +/- 0.57, N = 3SE +/- 0.49, N = 3SE +/- 0.23, N = 3SE +/- 0.18, N = 3SE +/- 0.31, N = 3SE +/- 0.12, N = 3SE +/- 0.56, N = 3SE +/- 0.11, N = 3SE +/- 0.50, N = 3SE +/- 0.23, N = 3SE +/- 0.57, N = 3SE +/- 0.60, N = 3SE +/- 1.08, N = 3SE +/- 0.60, N = 3SE +/- 0.31, N = 3SE +/- 1.29, N = 4SE +/- 0.65, N = 3SE +/- 0.60, N = 3SE +/- 0.10, N = 3SE +/- 0.30, N = 3SE +/- 0.21, N = 3SE +/- 0.90, N = 350.8359.9461.2562.1363.5464.7966.9168.8372.8073.9781.4381.60102.05103.60105.22112.76113.52114.16116.64125.24140.07149.991. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+EPYC 9684XXeon Platinum 8592+ 2PXeon Max 9468EPYC 9654Xeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9480 2PEPYC 9754EPYC 8534PEPYC 8534PNXeon Platinum 8490HXeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2PXeon Platinum 8380Xeon Platinum 8380 2P612182430SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.16, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 33.783.984.376.726.936.957.137.237.327.727.767.978.038.599.469.7916.3616.7317.8118.7523.2524.391. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon 6780EEPYC 9754Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9654EPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P140280420560700Min: 18.47 / Avg: 133.6 / Max: 149.13Min: 18.98 / Avg: 159.92 / Max: 172.73Min: 43.82 / Avg: 230.25 / Max: 249.52Min: 49.85 / Avg: 255.01 / Max: 291.18Min: 43.64 / Avg: 297.75 / Max: 328.7Min: 23.26 / Avg: 322.4 / Max: 353.88Min: 34.07 / Avg: 323.98 / Max: 378.14Min: 57.71 / Avg: 328.31 / Max: 374.69Min: 73.88 / Avg: 330.38 / Max: 377.07Min: 83.77 / Avg: 330.51 / Max: 377.23Min: 29.57 / Avg: 331.39 / Max: 358.09Min: 33.67 / Avg: 380.02 / Max: 410.65Min: 107.09 / Avg: 456.74 / Max: 515.82Min: 101.18 / Avg: 504.36 / Max: 573.33Min: 110.7 / Avg: 588.97 / Max: 656.55Min: 41.99 / Avg: 631.93 / Max: 700.82Min: 84.79 / Avg: 638.38 / Max: 770.92Min: 60.33 / Avg: 641.88 / Max: 698.45Min: 172.39 / Avg: 651.14 / Max: 755.22Min: 198.29 / Avg: 659.86 / Max: 754.53Min: 209.53 / Avg: 660.24 / Max: 754.29Min: 64.76 / Avg: 750.99 / Max: 819.51. EPYC 8534PN: Approximate power consumption of 8684 Joules per run.2. EPYC 8534P: Approximate power consumption of 10448 Joules per run.3. Xeon 6766E: Approximate power consumption of 15043 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 16576 Joules per run.5. Xeon 6780E: Approximate power consumption of 19453 Joules per run.6. EPYC 9754: Approximate power consumption of 21171 Joules per run.7. Xeon Platinum 8592+: Approximate power consumption of 21383 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 21449 Joules per run.9. Xeon Max 9468: Approximate power consumption of 21585 Joules per run.10. Xeon Max 9480: Approximate power consumption of 21704 Joules per run.11. EPYC 9654: Approximate power consumption of 21540 Joules per run.12. EPYC 9684X: Approximate power consumption of 24828 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 31058 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 33120 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 39658 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 41918 Joules per run.17. Xeon Platinum 8592+ 2P: Approximate power consumption of 43835 Joules per run.18. EPYC 9654 2P: Approximate power consumption of 41936 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 44060 Joules per run.20. Xeon Max 9468 2P: Approximate power consumption of 43991 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 44456 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 49315 Joules per run.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+EPYC 9754Xeon Max 9480EPYC 9684XXeon Max 9468EPYC 9654Xeon Platinum 8490HXeon 6780E 2PXeon 6766E 2PEPYC 8534PEPYC 8534PNXeon Platinum 8380 2PXeon 6780EXeon 6766EXeon Platinum 83804K8K12K16K20KSE +/- 7.74, N = 3SE +/- 4.14, N = 3SE +/- 10.13, N = 3SE +/- 7.22, N = 3SE +/- 3.67, N = 3SE +/- 7.99, N = 3SE +/- 7.03, N = 3SE +/- 5.57, N = 3SE +/- 4.98, N = 3SE +/- 0.46, N = 3SE +/- 4.58, N = 3SE +/- 3.72, N = 3SE +/- 4.14, N = 3SE +/- 3.97, N = 3SE +/- 4.90, N = 3SE +/- 6.55, N = 3SE +/- 3.18, N = 3SE +/- 1.89, N = 3SE +/- 2.06, N = 3SE +/- 11.75, N = 3SE +/- 20.57, N = 3SE +/- 1.47, N = 318375.6315519.9214601.5214033.9413102.2812665.6212024.189515.867862.657207.746846.796717.656554.125943.664259.993787.943692.673355.733263.032179.992006.001698.051. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 1 - Model: ResNet-50Xeon Platinum 8592+Xeon Platinum 8380Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Max 9468 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PEPYC 9684XEPYC 8534PEPYC 8534PNEPYC 9654Xeon 6780EXeon Platinum 8490H 2PXeon Max 9480 2PXeon 6766EEPYC 9754EPYC 9684X 2PEPYC 9654 2PXeon 6780E 2PXeon 6766E 2PEPYC 9754 2P20406080100SE +/- 0.16, N = 3SE +/- 0.22, N = 3SE +/- 0.03, N = 3SE +/- 0.28, N = 3SE +/- 0.36, N = 3SE +/- 0.38, N = 8SE +/- 0.52, N = 3SE +/- 0.20, N = 3SE +/- 0.15, N = 3SE +/- 0.12, N = 3SE +/- 0.30, N = 3SE +/- 0.15, N = 3SE +/- 0.45, N = 4SE +/- 0.49, N = 3SE +/- 0.44, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 0.37, N = 12SE +/- 0.28, N = 15SE +/- 0.22, N = 4SE +/- 0.20, N = 3SE +/- 0.06, N = 377.5261.3251.4650.9948.5946.4945.6942.6441.1741.1140.9740.4535.8535.5335.4632.4531.6219.8419.3417.9116.4514.90
OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 1 - Model: ResNet-50EPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon Platinum 8380Xeon 6766EXeon 6780EXeon Platinum 8490HEPYC 9654EPYC 9754Xeon Max 9468EPYC 9684XXeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9654 2PXeon 6766E 2PEPYC 9754 2PXeon 6780E 2PEPYC 9684X 2P0.10260.20520.30780.41040.5130.4560.4350.3770.3460.2580.2510.2340.2310.2210.2140.2000.1930.1550.1020.0880.0830.0660.0560.0530.0530.0520.052
OpenBenchmarking.orgWatts, Fewer Is BetterPyTorch 2.2.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8380Xeon Platinum 8592+EPYC 9684XXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PEPYC 9754 2PXeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2P110220330440550Min: 16.55 / Avg: 89.88 / Max: 106.44Min: 17.99 / Avg: 94.53 / Max: 112.2Min: 43.63 / Avg: 125.95 / Max: 146.47Min: 43.45 / Avg: 142.9 / Max: 169.81Min: 21.5 / Avg: 143.05 / Max: 166.54Min: 30.07 / Avg: 174.93 / Max: 206.71Min: 52.57 / Avg: 177.33 / Max: 220.98Min: 33.19 / Avg: 205.45 / Max: 273.87Min: 33.48 / Avg: 206.21 / Max: 246.32Min: 58.92 / Avg: 219.54 / Max: 264.14Min: 73.83 / Avg: 237.82 / Max: 286.68Min: 78.78 / Avg: 251.12 / Max: 295.23Min: 101.16 / Avg: 274.76 / Max: 317.28Min: 41.67 / Avg: 279.95 / Max: 308.17Min: 105.53 / Avg: 307.69 / Max: 344.16Min: 108.69 / Avg: 341.29 / Max: 380.81Min: 58.39 / Avg: 343.94 / Max: 402.47Min: 62.51 / Avg: 384.75 / Max: 433.08Min: 160.89 / Avg: 425.75 / Max: 563.56Min: 81.45 / Avg: 450.14 / Max: 553.23Min: 204.28 / Avg: 527.85 / Max: 604.75Min: 199.22 / Avg: 540.93 / Max: 610.221. EPYC 8534PN: Approximate power consumption of 3116 Joules per run.2. EPYC 8534P: Approximate power consumption of 3309 Joules per run.3. Xeon 6766E: Approximate power consumption of 5374 Joules per run.4. Xeon 6780E: Approximate power consumption of 5609 Joules per run.5. EPYC 9754: Approximate power consumption of 6199 Joules per run.6. EPYC 9654: Approximate power consumption of 6122 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 4551 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 4451 Joules per run.9. EPYC 9684X: Approximate power consumption of 7149 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 6440 Joules per run.11. Xeon Max 9468: Approximate power consumption of 6976 Joules per run.12. Xeon Max 9480: Approximate power consumption of 8119 Joules per run.13. Xeon Platinum 8380 2P: Approximate power consumption of 9342 Joules per run.14. EPYC 9754 2P: Approximate power consumption of 23143 Joules per run.15. Xeon 6766E 2P: Approximate power consumption of 24410 Joules per run.16. Xeon 6780E 2P: Approximate power consumption of 25256 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 22195 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 24336 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 19301 Joules per run.20. Xeon Platinum 8592+ 2P: Approximate power consumption of 14855 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 16693 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 23440 Joules per run.

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8380EPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P714212835SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 4SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 32.362.482.502.502.532.672.793.588.278.589.259.4210.0910.1710.9211.2011.7813.1124.2524.7727.0128.241. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380EPYC 9754Xeon 6780EEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P140280420560700Min: 17.61 / Avg: 128.88 / Max: 137.57Min: 18.69 / Avg: 156.99 / Max: 167.88Min: 43.68 / Avg: 235.37 / Max: 270.07Min: 50.92 / Avg: 255.35 / Max: 288.21Min: 21.95 / Avg: 308.04 / Max: 333.19Min: 43.61 / Avg: 309.55 / Max: 356.77Min: 28.34 / Avg: 326.4 / Max: 351.05Min: 34.78 / Avg: 327.29 / Max: 381.26Min: 58.8 / Avg: 329.61 / Max: 364.22Min: 73.64 / Avg: 331.47 / Max: 377.08Min: 83.9 / Avg: 332.66 / Max: 375.98Min: 34.9 / Avg: 384.48 / Max: 410.25Min: 106.03 / Avg: 466.01 / Max: 540.12Min: 100.48 / Avg: 510.62 / Max: 581.76Min: 108.97 / Avg: 612 / Max: 711.29Min: 40.68 / Avg: 615.84 / Max: 667.35Min: 59.07 / Avg: 649.54 / Max: 702.57Min: 83.6 / Avg: 652.57 / Max: 760.35Min: 168.91 / Avg: 662.23 / Max: 753.52Min: 208.01 / Avg: 666.11 / Max: 753.96Min: 206.25 / Avg: 666.2 / Max: 754.51Min: 68.11 / Avg: 762.39 / Max: 819.681. EPYC 8534PN: Approximate power consumption of 8291 Joules per run.2. EPYC 8534P: Approximate power consumption of 10048 Joules per run.3. Xeon 6766E: Approximate power consumption of 15299 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 16427 Joules per run.5. EPYC 9754: Approximate power consumption of 19920 Joules per run.6. Xeon 6780E: Approximate power consumption of 20121 Joules per run.7. EPYC 9654: Approximate power consumption of 20999 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 21274 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 21424 Joules per run.10. Xeon Max 9468: Approximate power consumption of 21380 Joules per run.11. Xeon Max 9480: Approximate power consumption of 21401 Joules per run.12. EPYC 9684X: Approximate power consumption of 24479 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 30912 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 32680 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 40392 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 40030 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 42004 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 42634 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 43045 Joules per run.20. Xeon Max 9468 2P: Approximate power consumption of 43297 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 43081 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 49301 Joules per run.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 9754 2PXeon Max 9480EPYC 9684X 2PXeon Max 9468EPYC 9654 2PXeon Platinum 8490HEPYC 9754Xeon 6780E 2PXeon 6766E 2PEPYC 9684XXeon Platinum 8380 2PEPYC 9654Xeon 6780EEPYC 8534PXeon 6766EEPYC 8534PNXeon Platinum 838010K20K30K40K50KSE +/- 39.08, N = 3SE +/- 53.98, N = 3SE +/- 233.95, N = 3SE +/- 80.58, N = 3SE +/- 47.41, N = 3SE +/- 11.27, N = 3SE +/- 21.27, N = 3SE +/- 110.20, N = 3SE +/- 234.43, N = 4SE +/- 147.69, N = 3SE +/- 2.71, N = 3SE +/- 5.50, N = 3SE +/- 19.55, N = 3SE +/- 12.93, N = 3SE +/- 11.71, N = 3SE +/- 6.41, N = 3SE +/- 4.46, N = 3SE +/- 6.61, N = 3SE +/- 0.41, N = 3SE +/- 7.59, N = 3SE +/- 1.69, N = 3SE +/- 5.62, N = 348122.1647654.9540032.8137710.6026943.4222499.0320910.5320550.9319183.8318666.1615943.1711508.1911390.0410020.919997.899657.089356.715866.635366.795278.464830.014502.741. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8380EPYC 9684XEPYC 9654Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon 6780EEPYC 9754Xeon Max 9480 2PXeon Max 9468 2PXeon 6766EEPYC 8534PNEPYC 8534PEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon 6780E 2PXeon 6766E 2P48121620SE +/- 0.00434, N = 3SE +/- 0.02114, N = 3SE +/- 0.01428, N = 3SE +/- 0.02823, N = 3SE +/- 0.07483, N = 3SE +/- 0.01980, N = 3SE +/- 0.02436, N = 3SE +/- 0.00351, N = 3SE +/- 0.06784, N = 3SE +/- 0.03717, N = 3SE +/- 0.01181, N = 3SE +/- 0.00921, N = 3SE +/- 0.01417, N = 3SE +/- 0.08283, N = 3SE +/- 0.00515, N = 3SE +/- 0.02580, N = 3SE +/- 0.03809, N = 3SE +/- 0.03939, N = 3SE +/- 0.02885, N = 3SE +/- 0.01997, N = 3SE +/- 0.01174, N = 3SE +/- 0.11771, N = 34.016875.109485.215205.227815.290275.543796.184786.377806.507476.906197.135357.280877.308227.348487.595897.705117.745219.066079.1245210.0666016.5418017.055301. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654EPYC 9684XXeon 6766E 2PXeon 6780E 2PXeon Platinum 8380EPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380 2P60120180240300Min: 15.83 / Avg: 75.69 / Max: 81.06Min: 16.21 / Avg: 79.24 / Max: 84.5Min: 43.73 / Avg: 95.8 / Max: 101.7Min: 43.53 / Avg: 101.74 / Max: 108.09Min: 19.44 / Avg: 102.38 / Max: 109.98Min: 27.22 / Avg: 134.62 / Max: 143.75Min: 35.03 / Avg: 153.85 / Max: 164.75Min: 103.68 / Avg: 180.17 / Max: 191.33Min: 94.92 / Avg: 183.21 / Max: 193.59Min: 53.03 / Avg: 204.41 / Max: 224.2Min: 40 / Avg: 213.81 / Max: 226.08Min: 57.53 / Avg: 262.4 / Max: 276.96Min: 61.69 / Avg: 290.82 / Max: 309Min: 97.1 / Avg: 306.05 / Max: 325.941. EPYC 8534PN: Approximate power consumption of 4996 Joules per run.2. EPYC 8534P: Approximate power consumption of 5203 Joules per run.3. Xeon 6766E: Approximate power consumption of 6355 Joules per run.4. Xeon 6780E: Approximate power consumption of 6749 Joules per run.5. EPYC 9754: Approximate power consumption of 6757 Joules per run.6. EPYC 9654: Approximate power consumption of 8795 Joules per run.7. EPYC 9684X: Approximate power consumption of 10051 Joules per run.8. Xeon 6766E 2P: Approximate power consumption of 12072 Joules per run.9. Xeon 6780E 2P: Approximate power consumption of 12214 Joules per run.10. Xeon Platinum 8380: Approximate power consumption of 13423 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 14040 Joules per run.12. EPYC 9654 2P: Approximate power consumption of 17144 Joules per run.13. EPYC 9684X 2P: Approximate power consumption of 19194 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 20097 Joules per run.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8380EPYC 9684XEPYC 9654Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon 6780EEPYC 9754Xeon Max 9480 2PXeon Max 9468 2PXeon 6766EEPYC 8534PNEPYC 8534PEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon 6780E 2PXeon 6766E 2P50100150200250SE +/- 0.27, N = 3SE +/- 0.81, N = 3SE +/- 0.53, N = 3SE +/- 1.04, N = 3SE +/- 2.63, N = 3SE +/- 0.64, N = 3SE +/- 0.64, N = 3SE +/- 0.08, N = 3SE +/- 1.59, N = 3SE +/- 0.78, N = 3SE +/- 0.23, N = 3SE +/- 0.17, N = 3SE +/- 0.26, N = 3SE +/- 1.53, N = 3SE +/- 0.09, N = 3SE +/- 0.43, N = 3SE +/- 0.64, N = 3SE +/- 0.48, N = 3SE +/- 0.35, N = 3SE +/- 0.19, N = 3SE +/- 0.04, N = 3SE +/- 0.40, N = 3248.68195.45191.56191.11188.93180.23161.50156.61153.54144.64140.03137.19136.69135.98131.54129.65128.98110.17109.4699.2260.3958.581. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8380EPYC 9684XEPYC 9654Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon 6780EEPYC 9754Xeon Max 9480 2PXeon Max 9468 2PXeon 6766EEPYC 8534PNEPYC 8534PEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon 6780E 2PXeon 6766E 2P48121620SE +/- 0.00434, N = 3SE +/- 0.02114, N = 3SE +/- 0.01428, N = 3SE +/- 0.02823, N = 3SE +/- 0.07483, N = 3SE +/- 0.01980, N = 3SE +/- 0.02436, N = 3SE +/- 0.00351, N = 3SE +/- 0.06784, N = 3SE +/- 0.03717, N = 3SE +/- 0.01181, N = 3SE +/- 0.00921, N = 3SE +/- 0.01417, N = 3SE +/- 0.08283, N = 3SE +/- 0.00515, N = 3SE +/- 0.02580, N = 3SE +/- 0.03809, N = 3SE +/- 0.03939, N = 3SE +/- 0.02885, N = 3SE +/- 0.01997, N = 3SE +/- 0.01174, N = 3SE +/- 0.11771, N = 34.016875.109485.215205.227815.290275.543796.184786.377806.507476.906197.135357.280877.308227.348487.595897.705117.745219.066079.1245210.0666016.5418017.055301. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Max 9468EPYC 9684X 2PEPYC 9684XXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480EPYC 9654Xeon Platinum 8380 2PEPYC 9654 2PXeon Max 9480 2PEPYC 9754Xeon Platinum 8490HXeon Platinum 8380EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P510152025SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 35.185.195.275.345.415.555.725.775.855.935.986.026.256.436.566.606.777.6016.4116.9818.2019.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2P140280420560700Min: 16.94 / Avg: 130.25 / Max: 140.67Min: 18.15 / Avg: 159.45 / Max: 171.38Min: 43.67 / Avg: 229.66 / Max: 249.94Min: 49.75 / Avg: 255.45 / Max: 289.44Min: 43.59 / Avg: 299.29 / Max: 327.76Min: 21 / Avg: 311.43 / Max: 339.91Min: 31.29 / Avg: 316.48 / Max: 340.73Min: 35.16 / Avg: 326.91 / Max: 374.78Min: 58.3 / Avg: 329.39 / Max: 378.11Min: 72.13 / Avg: 330.52 / Max: 368.64Min: 77.72 / Avg: 331.34 / Max: 373.94Min: 30.34 / Avg: 377.27 / Max: 406.75Min: 105.68 / Avg: 456.22 / Max: 521.95Min: 100.5 / Avg: 510.02 / Max: 582.06Min: 108.98 / Avg: 585.34 / Max: 658.24Min: 39.66 / Avg: 604.27 / Max: 668.8Min: 59.24 / Avg: 612.41 / Max: 670.98Min: 83.99 / Avg: 648.24 / Max: 768.1Min: 165.34 / Avg: 658.39 / Max: 751.53Min: 203.86 / Avg: 663.32 / Max: 752.94Min: 196.21 / Avg: 665.03 / Max: 748.66Min: 65.72 / Avg: 754.92 / Max: 818.941. EPYC 8534PN: Approximate power consumption of 8466 Joules per run.2. EPYC 8534P: Approximate power consumption of 10311 Joules per run.3. Xeon 6766E: Approximate power consumption of 15081 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 16519 Joules per run.5. Xeon 6780E: Approximate power consumption of 19653 Joules per run.6. EPYC 9754: Approximate power consumption of 20347 Joules per run.7. EPYC 9654: Approximate power consumption of 20465 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 21358 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 21410 Joules per run.10. Xeon Max 9468: Approximate power consumption of 21484 Joules per run.11. Xeon Max 9480: Approximate power consumption of 21427 Joules per run.12. EPYC 9684X: Approximate power consumption of 24397 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 31175 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 33151 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 39999 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 40285 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 40215 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 42784 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 43235 Joules per run.20. Xeon Max 9480 2P: Approximate power consumption of 43337 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 43449 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 49070 Joules per run.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PXeon Max 9468 2PEPYC 9684XXeon 6780E 2PEPYC 9654Xeon 6766E 2PXeon Platinum 8380 2PXeon Platinum 8592+Xeon Max 9480EPYC 8534PXeon Max 9468Xeon Platinum 8490HXeon 6780EEPYC 8534PNXeon 6766EXeon Platinum 83808K16K24K32K40KSE +/- 10.72, N = 3SE +/- 15.46, N = 3SE +/- 46.87, N = 3SE +/- 17.69, N = 3SE +/- 12.64, N = 3SE +/- 8.57, N = 3SE +/- 3.89, N = 3SE +/- 12.64, N = 3SE +/- 7.70, N = 3SE +/- 41.98, N = 3SE +/- 2.59, N = 3SE +/- 30.29, N = 3SE +/- 16.45, N = 3SE +/- 4.30, N = 3SE +/- 7.39, N = 3SE +/- 2.45, N = 3SE +/- 18.13, N = 3SE +/- 5.45, N = 3SE +/- 0.67, N = 3SE +/- 7.49, N = 3SE +/- 2.54, N = 3SE +/- 15.90, N = 338546.6635809.5931974.8824676.8620937.5819917.5418561.9117252.2717230.3516394.0616038.9014551.1213467.2812317.949686.399256.119087.129004.238536.398279.637721.005913.041. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 9754EPYC 8534PNXeon 6780EXeon 6766EEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2PXeon 6766E 2PXeon 6780E 2P50100150200250SE +/- 0.30, N = 3SE +/- 0.05, N = 3SE +/- 0.36, N = 3SE +/- 0.01, N = 3SE +/- 0.22, N = 3SE +/- 0.46, N = 3SE +/- 0.57, N = 3SE +/- 0.74, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.20, N = 3SE +/- 0.01, N = 3SE +/- 0.20, N = 3SE +/- 0.53, N = 3SE +/- 0.52, N = 3SE +/- 0.91, N = 3SE +/- 0.61, N = 3SE +/- 0.15, N = 3SE +/- 2.38, N = 3SE +/- 2.49, N = 3SE +/- 1.41, N = 347.9055.1256.5861.0161.8370.3470.4476.4278.4079.38102.04102.19114.17115.79118.02129.94140.14157.51158.27179.99217.93219.171. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8380EPYC 9684XXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2P110220330440550Min: 18.05 / Avg: 113.49 / Max: 122.89Min: 19.76 / Avg: 124.93 / Max: 135Min: 43.74 / Avg: 152.65 / Max: 163.54Min: 43.53 / Avg: 179.64 / Max: 193.29Min: 21.66 / Avg: 192.93 / Max: 209.55Min: 29.58 / Avg: 236.8 / Max: 255.65Min: 53.1 / Avg: 243.23 / Max: 261.05Min: 33.83 / Avg: 279.27 / Max: 303.77Min: 104.75 / Avg: 350.62 / Max: 384.9Min: 108.42 / Avg: 392.56 / Max: 431.32Min: 39.89 / Avg: 406.34 / Max: 438.62Min: 103.81 / Avg: 450.11 / Max: 482.7Min: 59.75 / Avg: 482.18 / Max: 521.5Min: 67.07 / Avg: 552.04 / Max: 595.991. EPYC 8534PN: Approximate power consumption of 7377 Joules per run.2. EPYC 8534P: Approximate power consumption of 8121 Joules per run.3. Xeon 6766E: Approximate power consumption of 9973 Joules per run.4. Xeon 6780E: Approximate power consumption of 11736 Joules per run.5. EPYC 9754: Approximate power consumption of 12540 Joules per run.6. EPYC 9654: Approximate power consumption of 15313 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 15891 Joules per run.8. EPYC 9684X: Approximate power consumption of 18246 Joules per run.9. Xeon 6766E 2P: Approximate power consumption of 23258 Joules per run.10. Xeon 6780E 2P: Approximate power consumption of 26040 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 26547 Joules per run.12. Xeon Platinum 8380 2P: Approximate power consumption of 29257 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 31341 Joules per run.14. EPYC 9684X 2P: Approximate power consumption of 35699 Joules per run.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 9754EPYC 8534PNXeon 6780EXeon 6766EEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2PXeon 6766E 2PXeon 6780E 2P510152025SE +/- 0.13074, N = 3SE +/- 0.01672, N = 3SE +/- 0.11211, N = 3SE +/- 0.00279, N = 3SE +/- 0.05802, N = 3SE +/- 0.09305, N = 3SE +/- 0.11392, N = 3SE +/- 0.12795, N = 3SE +/- 0.01439, N = 3SE +/- 0.02010, N = 3SE +/- 0.00491, N = 3SE +/- 0.01934, N = 3SE +/- 0.00112, N = 3SE +/- 0.01474, N = 3SE +/- 0.03807, N = 3SE +/- 0.03075, N = 3SE +/- 0.04609, N = 3SE +/- 0.02467, N = 3SE +/- 0.00606, N = 3SE +/- 0.07368, N = 3SE +/- 0.05214, N = 3SE +/- 0.02942, N = 320.8795018.1413017.6747016.3898016.1742014.2169014.1980013.0869012.7546012.597409.800089.785168.758148.635948.472837.695837.135876.348916.318285.557674.589604.562781. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 9754EPYC 8534PNXeon 6780EXeon 6766EEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2PXeon 6766E 2PXeon 6780E 2P50100150200250SE +/- 0.30, N = 3SE +/- 0.05, N = 3SE +/- 0.36, N = 3SE +/- 0.01, N = 3SE +/- 0.22, N = 3SE +/- 0.46, N = 3SE +/- 0.57, N = 3SE +/- 0.74, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.20, N = 3SE +/- 0.01, N = 3SE +/- 0.20, N = 3SE +/- 0.53, N = 3SE +/- 0.52, N = 3SE +/- 0.91, N = 3SE +/- 0.61, N = 3SE +/- 0.15, N = 3SE +/- 2.38, N = 3SE +/- 2.49, N = 3SE +/- 1.41, N = 347.9055.1256.5861.0161.8370.3470.4476.4278.4079.38102.04102.19114.17115.79118.02129.94140.14157.51158.27179.99217.93219.171. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

GraphicsMagick

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: Noise-GaussianXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+EPYC 9684XEPYC 9754 2PXeon Max 9480 2PEPYC 9654Xeon Max 9480Xeon Platinum 8490HXeon 6780EXeon Platinum 8380 2PEPYC 9754Xeon Max 9468 2PXeon Max 9468Xeon 6766EXeon 6780E 2PEPYC 8534PXeon Platinum 8380EPYC 8534PNXeon 6766E 2P4080120160200SE +/- 0.88, N = 3SE +/- 1.15, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 3SE +/- 0.00, N = 3SE +/- 0.58, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 1.44, N = 4SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 31941821791781711651641641601581581551531511501501451261231211201181. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
OpenBenchmarking.orgIterations Per Minute Per Watt, More Is BetterGraphicsMagick 1.3.43Operation: Noise-GaussianXeon 6766EEPYC 8534PNEPYC 8534PXeon 6780EEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8592+Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8490HEPYC 9754 2PXeon Platinum 8380Xeon Max 9480EPYC 9654 2PXeon Max 9468Xeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P0.34430.68861.03291.37721.72151.5301.5071.4201.4171.2261.0410.9320.7780.7400.7290.7160.6740.6200.6140.5970.5520.5440.5400.4820.4670.3450.308
OpenBenchmarking.orgWatts, Fewer Is BetterGraphicsMagick 1.3.43CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon 6766E 2PXeon 6780E 2PEPYC 9684XXeon Platinum 8380Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9754 2PXeon Max 9480Xeon Max 9468EPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P90180270360450Min: 16.29 / Avg: 79.6 / Max: 84.69Min: 17.9 / Avg: 86.65 / Max: 95.02Min: 43.66 / Avg: 94.78 / Max: 111.52Min: 43.47 / Avg: 109.4 / Max: 130.3Min: 21.53 / Avg: 123.19 / Max: 140.7Min: 29.47 / Avg: 153.63 / Max: 171.14Min: 104.1 / Avg: 159.54 / Max: 190.88Min: 98.17 / Avg: 172.89 / Max: 203.08Min: 33.85 / Avg: 176.95 / Max: 194.06Min: 53.3 / Avg: 195.01 / Max: 207.9Min: 34.53 / Avg: 219.79 / Max: 241.79Min: 59.26 / Avg: 220.76 / Max: 250.24Min: 39.77 / Avg: 243.28 / Max: 272.18Min: 75.67 / Avg: 257.27 / Max: 283.18Min: 74.91 / Avg: 271.55 / Max: 302.98Min: 59.18 / Avg: 297.92 / Max: 323.55Min: 99.29 / Avg: 317.68 / Max: 360.97Min: 66.05 / Avg: 331.54 / Max: 359.49Min: 82.86 / Avg: 356.85 / Max: 403.74Min: 160.72 / Avg: 389.84 / Max: 423.25Min: 196.74 / Avg: 476 / Max: 507.38Min: 203.35 / Avg: 486.24 / Max: 527.711. EPYC 8534PN: Approximate power consumption of 5121 Joules per run.2. EPYC 8534P: Approximate power consumption of 5574 Joules per run.3. Xeon 6766E: Approximate power consumption of 6066 Joules per run.4. Xeon 6780E: Approximate power consumption of 7038 Joules per run.5. EPYC 9754: Approximate power consumption of 7884 Joules per run.6. EPYC 9654: Approximate power consumption of 9884 Joules per run.7. Xeon 6766E 2P: Approximate power consumption of 10210 Joules per run.8. Xeon 6780E 2P: Approximate power consumption of 11108 Joules per run.9. EPYC 9684X: Approximate power consumption of 11384 Joules per run.10. Xeon Platinum 8380: Approximate power consumption of 12481 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 14213 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 14202 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 15570 Joules per run.14. Xeon Max 9480: Approximate power consumption of 16465 Joules per run.15. Xeon Max 9468: Approximate power consumption of 17470 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 19067 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 20332 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 20997 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 23076 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 25210 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 30305 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 31119 Joules per run.

GPAW

GPAW is a density-functional theory (DFT) Python code based on the projector-augmented wave (PAW) method and the atomic simulation environment (ASE). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGPAW 23.6Input: Carbon NanotubeEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Max 9480 2PXeon Platinum 8490HXeon Platinum 8380 2PXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 838020406080100SE +/- 0.30, N = 15SE +/- 0.29, N = 15SE +/- 0.18, N = 3SE +/- 0.11, N = 3SE +/- 0.14, N = 3SE +/- 0.21, N = 3SE +/- 0.10, N = 3SE +/- 0.55, N = 3SE +/- 0.08, N = 3SE +/- 0.12, N = 3SE +/- 0.27, N = 3SE +/- 0.24, N = 3SE +/- 0.60, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.12, N = 324.1325.8427.1530.0033.1234.8738.0541.5642.8743.0543.9147.7848.4548.4954.3863.8066.7176.181. (CC) gcc options: -shared -lxc -lblas -lmpi
OpenBenchmarking.orgWatts, Fewer Is BetterGPAW 23.6CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon Platinum 8380EPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9684XXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P140280420560700Min: 18.16 / Avg: 136.93 / Max: 153.06Min: 18.71 / Avg: 154.54 / Max: 175.1Min: 53.47 / Avg: 257.77 / Max: 289.43Min: 23.61 / Avg: 293.6 / Max: 347.81Min: 28.47 / Avg: 300.58 / Max: 350.83Min: 24.08 / Avg: 314.73 / Max: 374.48Min: 59.13 / Avg: 322.66 / Max: 373.01Min: 75.93 / Avg: 324.94 / Max: 375.46Min: 72.36 / Avg: 327.19 / Max: 373.7Min: 34.27 / Avg: 353.01 / Max: 409.6Min: 103.43 / Avg: 497.52 / Max: 576.52Min: 43.78 / Avg: 513.29 / Max: 700.14Min: 57.4 / Avg: 562.66 / Max: 711.92Min: 80.11 / Avg: 568.78 / Max: 750.58Min: 153.52 / Avg: 606.84 / Max: 749.04Min: 203.73 / Avg: 621.08 / Max: 746.35Min: 213.42 / Avg: 622.05 / Max: 746.91Min: 65.21 / Avg: 641.29 / Max: 819.61. EPYC 8534PN: Approximate power consumption of 9950 Joules per run.2. EPYC 8534P: Approximate power consumption of 10766 Joules per run.3. Xeon Platinum 8380: Approximate power consumption of 21051 Joules per run.4. EPYC 9754: Approximate power consumption of 11842 Joules per run.5. EPYC 9654: Approximate power consumption of 12424 Joules per run.6. Xeon Platinum 8592+: Approximate power consumption of 15527 Joules per run.7. Xeon Platinum 8490H: Approximate power consumption of 17424 Joules per run.8. Xeon Max 9480: Approximate power consumption of 17655 Joules per run.9. Xeon Max 9468: Approximate power consumption of 19631 Joules per run.10. EPYC 9684X: Approximate power consumption of 12709 Joules per run.11. Xeon Platinum 8380 2P: Approximate power consumption of 27198 Joules per run.12. EPYC 9754 2P: Approximate power consumption of 21216 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 19806 Joules per run.14. Xeon Platinum 8592+ 2P: Approximate power consumption of 27301 Joules per run.15. Xeon Platinum 8490H 2P: Approximate power consumption of 30747 Joules per run.16. Xeon Max 9468 2P: Approximate power consumption of 31468 Joules per run.17. Xeon Max 9480 2P: Approximate power consumption of 32554 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 21505 Joules per run.

GraphicsMagick

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: SharpenXeon 6780E 2PXeon 6766E 2PEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon 6780EXeon Platinum 8490H 2PEPYC 9654 2PXeon 6766EXeon Max 9480 2PEPYC 9754EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380 2PXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 838080160240320400SE +/- 0.67, N = 3SE +/- 0.88, N = 3SE +/- 3.00, N = 3SE +/- 0.88, N = 3SE +/- 1.67, N = 3SE +/- 0.00, N = 3SE +/- 1.67, N = 3SE +/- 1.20, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 1.20, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3381336310297284281265262253227207201199173167157144130114112105791. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
OpenBenchmarking.orgIterations Per Minute Per Watt, More Is BetterGraphicsMagick 1.3.43Operation: SharpenXeon 6766EXeon 6780EXeon 6766E 2PEPYC 8534PNXeon 6780E 2PEPYC 8534PEPYC 9754EPYC 9754 2PEPYC 9654EPYC 9684XEPYC 9654 2PXeon Platinum 8592+EPYC 9684X 2PXeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Platinum 8380Xeon Max 9468 2PXeon Platinum 8380 2P0.27810.55620.83431.11241.39051.2361.0740.9650.9040.8940.8810.8380.6900.6740.5890.5440.5120.4920.4760.4530.4190.4050.3450.3430.3100.3010.285
OpenBenchmarking.orgWatts, Fewer Is BetterGraphicsMagick 1.3.43CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon Platinum 8380EPYC 9654Xeon 6780EXeon Max 9480Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468EPYC 9684XXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P120240360480600Min: 15.82 / Avg: 116.15 / Max: 127.18Min: 17.43 / Avg: 127.19 / Max: 145.11Min: 43.7 / Avg: 204.72 / Max: 219.13Min: 22 / Avg: 247.13 / Max: 273.84Min: 53.14 / Avg: 254.91 / Max: 285.61Min: 28.8 / Avg: 256.57 / Max: 278.61Min: 43.66 / Avg: 261.59 / Max: 286.06Min: 74.28 / Avg: 321.22 / Max: 366.4Min: 26.5 / Avg: 326.08 / Max: 362.61Min: 62.29 / Avg: 329.54 / Max: 363.35Min: 74.41 / Avg: 330.11 / Max: 353.01Min: 34.61 / Avg: 341.04 / Max: 370.17Min: 104.82 / Avg: 348.18 / Max: 384.37Min: 107.76 / Avg: 425.97 / Max: 469.34Min: 38.07 / Avg: 448.99 / Max: 494.64Min: 59.05 / Avg: 481.76 / Max: 531.74Min: 102.73 / Avg: 504.87 / Max: 544.93Min: 65.27 / Avg: 603.16 / Max: 655.4Min: 74.46 / Avg: 627.19 / Max: 683.79Min: 148.52 / Avg: 632.93 / Max: 684.15Min: 197.85 / Avg: 660.39 / Max: 706.79Min: 206.23 / Avg: 662.12 / Max: 708.791. EPYC 8534PN: Approximate power consumption of 7434 Joules per run.2. EPYC 8534P: Approximate power consumption of 8607 Joules per run.3. Xeon 6766E: Approximate power consumption of 13102 Joules per run.4. EPYC 9754: Approximate power consumption of 15734 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 16484 Joules per run.6. EPYC 9654: Approximate power consumption of 16335 Joules per run.7. Xeon 6780E: Approximate power consumption of 16829 Joules per run.8. Xeon Max 9480: Approximate power consumption of 21415 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 20978 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 21201 Joules per run.11. Xeon Max 9468: Approximate power consumption of 21237 Joules per run.12. EPYC 9684X: Approximate power consumption of 21827 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 22399 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 27404 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 28436 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 30672 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 32144 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 38603 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 40140 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 40929 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 42045 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 42597 Joules per run.

Timed Linux Kernel Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: defconfigXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754 2PXeon Max 9468 2PXeon 6780E 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon 6766E 2PXeon 6780EEPYC 9754Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480Xeon 6766EXeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 83801326395265SE +/- 0.23, N = 7SE +/- 0.17, N = 13SE +/- 0.33, N = 3SE +/- 0.43, N = 3SE +/- 0.31, N = 5SE +/- 0.28, N = 7SE +/- 0.40, N = 4SE +/- 0.28, N = 8SE +/- 0.46, N = 3SE +/- 0.43, N = 3SE +/- 0.39, N = 4SE +/- 0.22, N = 14SE +/- 0.37, N = 6SE +/- 0.44, N = 3SE +/- 0.42, N = 5SE +/- 0.55, N = 3SE +/- 0.57, N = 3SE +/- 0.39, N = 6SE +/- 0.59, N = 3SE +/- 0.50, N = 4SE +/- 0.54, N = 4SE +/- 0.33, N = 325.8725.8727.6829.9830.5330.6832.1432.6632.8934.5734.5935.5537.6438.5339.4139.4540.5041.1043.4244.2846.3555.74
OpenBenchmarking.orgWatts, Fewer Is BetterTimed Linux Kernel Compilation 6.8CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon 6766E 2PXeon Platinum 8380Xeon 6780E 2PEPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9754 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P140280420560700Min: 14.06 / Avg: 87.28 / Max: 138.54Min: 16.1 / Avg: 97.22 / Max: 163.42Min: 43.51 / Avg: 106.04 / Max: 250.64Min: 21.97 / Avg: 123.43 / Max: 312.29Min: 20.78 / Avg: 155.1 / Max: 328.08Min: 27.91 / Avg: 175.53 / Max: 322.12Min: 104.46 / Avg: 183.63 / Max: 516.23Min: 48.64 / Avg: 197.71 / Max: 290.64Min: 106.91 / Avg: 202.81 / Max: 628.9Min: 32.62 / Avg: 210.93 / Max: 409.9Min: 26.35 / Avg: 214.95 / Max: 377.53Min: 60.49 / Avg: 234.11 / Max: 377.45Min: 69.92 / Avg: 260.34 / Max: 376.76Min: 73.73 / Avg: 265.23 / Max: 376.52Min: 38.17 / Avg: 283.46 / Max: 659.24Min: 52.83 / Avg: 317.6 / Max: 662.66Min: 98.92 / Avg: 340.2 / Max: 582.62Min: 62.86 / Avg: 375.56 / Max: 824.56Min: 73.91 / Avg: 384.63 / Max: 756.99Min: 150.36 / Avg: 425.97 / Max: 755.88Min: 176.87 / Avg: 486.28 / Max: 754.8Min: 189.61 / Avg: 492.26 / Max: 752.951. EPYC 8534PN: Approximate power consumption of 5041 Joules per run.2. EPYC 8534P: Approximate power consumption of 5420 Joules per run.3. Xeon 6766E: Approximate power consumption of 5461 Joules per run.4. Xeon 6780E: Approximate power consumption of 5863 Joules per run.5. EPYC 9754: Approximate power consumption of 8065 Joules per run.6. EPYC 9654: Approximate power consumption of 8133 Joules per run.7. Xeon 6766E 2P: Approximate power consumption of 8224 Joules per run.8. Xeon Platinum 8380: Approximate power consumption of 13181 Joules per run.9. Xeon 6780E 2P: Approximate power consumption of 8645 Joules per run.10. EPYC 9684X: Approximate power consumption of 9422 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 9512 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 11862 Joules per run.13. Xeon Max 9480: Approximate power consumption of 13277 Joules per run.14. Xeon Max 9468: Approximate power consumption of 14234 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 11824 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 12916 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 16602 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 12885 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 13242 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 17891 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 19257 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 20552 Joules per run.

GraphicsMagick

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: EnhancedEPYC 9684X 2PEPYC 9754 2PXeon 6780E 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon 6766E 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XXeon 6780EXeon 6766EXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380 2PXeon Max 9480EPYC 8534PEPYC 8534PNXeon Max 9468Xeon Platinum 838090180270360450SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 1.53, N = 3SE +/- 1.15, N = 3SE +/- 1.20, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 1.00, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 2.60, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 1.45, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 34084033893743683503423043013002992702692642282162151811721631601231. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
OpenBenchmarking.orgIterations Per Minute Per Watt, More Is BetterGraphicsMagick 1.3.43Operation: EnhancedEPYC 8534PNXeon 6766EEPYC 8534PEPYC 9754Xeon 6780EXeon 6766E 2PEPYC 9654EPYC 9754 2PXeon 6780E 2PEPYC 9684XEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480Xeon Platinum 8380Xeon Max 9468Xeon Max 9480 2PXeon Platinum 8380 2PXeon Max 9468 2P0.33080.66160.99241.32321.6541.4701.3911.3481.3421.2111.0861.0671.0140.9990.9350.8150.7420.6960.6560.6140.5680.5490.4840.4840.4660.4350.410
OpenBenchmarking.orgWatts, Fewer Is BetterGraphicsMagick 1.3.43CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EEPYC 9654Xeon Platinum 8380EPYC 9684XXeon 6766E 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon 6780E 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2P120240360480600Min: 16.93 / Avg: 110.88 / Max: 122.16Min: 18.4 / Avg: 127.55 / Max: 140Min: 43.58 / Avg: 194.07 / Max: 209.22Min: 20.16 / Avg: 226.47 / Max: 243.63Min: 43.55 / Avg: 246.9 / Max: 265.73Min: 26.64 / Avg: 247.53 / Max: 267.87Min: 52.22 / Avg: 254.21 / Max: 282.55Min: 33.82 / Avg: 320.71 / Max: 343.53Min: 104.13 / Avg: 322.39 / Max: 344.94Min: 28.79 / Avg: 327.64 / Max: 359.97Min: 61.03 / Avg: 329.43 / Max: 359.83Min: 75.94 / Avg: 329.68 / Max: 362.6Min: 73.74 / Avg: 330.74 / Max: 355.56Min: 105.4 / Avg: 389.46 / Max: 429.53Min: 40.42 / Avg: 397.41 / Max: 433.85Min: 59.43 / Avg: 451.41 / Max: 489.55Min: 101.45 / Avg: 493.87 / Max: 534.32Min: 64.84 / Avg: 549.68 / Max: 597.34Min: 161.82 / Avg: 601.76 / Max: 650.47Min: 74.15 / Avg: 608.66 / Max: 666.76Min: 202.79 / Avg: 645.53 / Max: 683.28Min: 198.68 / Avg: 656.05 / Max: 702.161. EPYC 8534PN: Approximate power consumption of 7134 Joules per run.2. EPYC 8534P: Approximate power consumption of 8163 Joules per run.3. Xeon 6766E: Approximate power consumption of 12421 Joules per run.4. EPYC 9754: Approximate power consumption of 14570 Joules per run.5. Xeon 6780E: Approximate power consumption of 15884 Joules per run.6. EPYC 9654: Approximate power consumption of 15842 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 16354 Joules per run.8. EPYC 9684X: Approximate power consumption of 20525 Joules per run.9. Xeon 6766E 2P: Approximate power consumption of 20633 Joules per run.10. Xeon Platinum 8592+: Approximate power consumption of 21078 Joules per run.11. Xeon Platinum 8490H: Approximate power consumption of 21193 Joules per run.12. Xeon Max 9480: Approximate power consumption of 21209 Joules per run.13. Xeon Max 9468: Approximate power consumption of 21277 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 24926 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 25434 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 28739 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 31773 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 35363 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 38713 Joules per run.20. Xeon Platinum 8592+ 2P: Approximate power consumption of 39157 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 41314 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 42206 Joules per run.

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Platinum 8380Xeon Max 9468 2PXeon Max 9480 2PEPYC 9654EPYC 9684XEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P48121620SE +/- 0.03569, N = 3SE +/- 0.02988, N = 3SE +/- 0.05586, N = 3SE +/- 0.02534, N = 3SE +/- 0.01694, N = 3SE +/- 0.02062, N = 3SE +/- 0.02822, N = 3SE +/- 0.01290, N = 3SE +/- 0.03854, N = 3SE +/- 0.02155, N = 3SE +/- 0.03015, N = 3SE +/- 0.08338, N = 3SE +/- 0.05765, N = 3SE +/- 0.07856, N = 3SE +/- 0.02898, N = 3SE +/- 0.05412, N = 3SE +/- 0.06993, N = 3SE +/- 0.13507, N = 3SE +/- 0.00657, N = 3SE +/- 0.00867, N = 3SE +/- 0.02665, N = 3SE +/- 0.06373, N = 34.263524.654314.866045.109145.260755.292875.597635.671755.749215.886289.089559.1852410.3026010.3977010.5537011.4580011.5024012.8093013.1789014.4761015.2784016.582801. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorXeon 6766EEPYC 8534PNEPYC 8534PXeon 6780EEPYC 9754EPYC 9654Xeon 6766E 2PXeon 6780E 2PEPYC 9684XEPYC 9754 2PXeon Platinum 8380EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380 2P60120180240300Min: 43.65 / Avg: 75.71 / Max: 78.31Min: 16.21 / Avg: 80.29 / Max: 85.38Min: 17.58 / Avg: 85.08 / Max: 90.86Min: 43.53 / Avg: 86.18 / Max: 89.75Min: 20.2 / Avg: 107.51 / Max: 113.85Min: 29.43 / Avg: 145.22 / Max: 154.34Min: 103.7 / Avg: 151.35 / Max: 165.49Min: 84.94 / Avg: 161.97 / Max: 179.97Min: 34.49 / Avg: 165.58 / Max: 176.42Min: 40.67 / Avg: 218.35 / Max: 232.79Min: 50.48 / Avg: 227.45 / Max: 243.02Min: 58.04 / Avg: 272.09 / Max: 288.97Min: 64.69 / Avg: 300.88 / Max: 323.81Min: 102.14 / Avg: 339.94 / Max: 362.781. Xeon 6766E: Approximate power consumption of 4871 Joules per run.2. EPYC 8534PN: Approximate power consumption of 5139 Joules per run.3. EPYC 8534P: Approximate power consumption of 5445 Joules per run.4. Xeon 6780E: Approximate power consumption of 5544 Joules per run.5. EPYC 9754: Approximate power consumption of 6881 Joules per run.6. EPYC 9654: Approximate power consumption of 9294 Joules per run.7. Xeon 6766E 2P: Approximate power consumption of 9787 Joules per run.8. Xeon 6780E 2P: Approximate power consumption of 10474 Joules per run.9. EPYC 9684X: Approximate power consumption of 10597 Joules per run.10. EPYC 9754 2P: Approximate power consumption of 14047 Joules per run.11. Xeon Platinum 8380: Approximate power consumption of 14481 Joules per run.12. EPYC 9654 2P: Approximate power consumption of 17505 Joules per run.13. EPYC 9684X 2P: Approximate power consumption of 19357 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 21869 Joules per run.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Platinum 8380Xeon Max 9468 2PXeon Max 9480 2PEPYC 9654EPYC 9684XEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P50100150200250SE +/- 1.98, N = 3SE +/- 1.38, N = 3SE +/- 2.34, N = 3SE +/- 0.98, N = 3SE +/- 0.61, N = 3SE +/- 0.74, N = 3SE +/- 0.90, N = 3SE +/- 0.40, N = 3SE +/- 1.17, N = 3SE +/- 0.62, N = 3SE +/- 0.36, N = 3SE +/- 0.99, N = 3SE +/- 0.54, N = 3SE +/- 0.72, N = 3SE +/- 0.26, N = 3SE +/- 0.41, N = 3SE +/- 0.53, N = 3SE +/- 0.83, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.11, N = 3SE +/- 0.23, N = 3234.54214.81205.53195.71190.06188.89178.62176.29173.91169.85110.00108.8797.0596.1794.7487.2686.9278.0775.8769.0765.4360.291. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Platinum 8380Xeon Max 9468 2PXeon Max 9480 2PEPYC 9654EPYC 9684XEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P48121620SE +/- 0.03569, N = 3SE +/- 0.02988, N = 3SE +/- 0.05586, N = 3SE +/- 0.02534, N = 3SE +/- 0.01694, N = 3SE +/- 0.02062, N = 3SE +/- 0.02822, N = 3SE +/- 0.01290, N = 3SE +/- 0.03854, N = 3SE +/- 0.02155, N = 3SE +/- 0.03015, N = 3SE +/- 0.08338, N = 3SE +/- 0.05765, N = 3SE +/- 0.07856, N = 3SE +/- 0.02898, N = 3SE +/- 0.05412, N = 3SE +/- 0.06993, N = 3SE +/- 0.13507, N = 3SE +/- 0.00657, N = 3SE +/- 0.00867, N = 3SE +/- 0.02665, N = 3SE +/- 0.06373, N = 34.263524.654314.866045.109145.260755.292875.597635.671755.749215.886289.089559.1852410.3026010.3977010.5537011.4580011.5024012.8093013.1789014.4761015.2784016.582801. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

GraphicsMagick

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: SwirlXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684X 2PEPYC 9754 2PXeon 6780EXeon Max 9480 2PEPYC 9654 2PEPYC 9684XEPYC 9754Xeon Platinum 8592+Xeon 6780E 2PEPYC 9654Xeon Max 9468 2PXeon 6766EXeon Platinum 8490HXeon 6766E 2PXeon Max 9480Xeon Platinum 8380 2PXeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 8380150300450600750SE +/- 0.58, N = 3SE +/- 1.76, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 1.15, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.88, N = 3SE +/- 3.00, N = 3SE +/- 0.33, N = 3SE +/- 1.33, N = 3SE +/- 4.91, N = 3SE +/- 1.15, N = 3SE +/- 2.33, N = 3SE +/- 0.67, N = 3SE +/- 4.41, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.88, N = 3SE +/- 0.33, N = 36896175835675665585535465355295175115095045024744324033943793632781. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
OpenBenchmarking.orgIterations Per Minute Per Watt, More Is BetterGraphicsMagick 1.3.43Operation: SwirlEPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EEPYC 9754EPYC 9654EPYC 9684XXeon 6766E 2PXeon 6780E 2PXeon Platinum 8592+EPYC 9754 2PXeon Platinum 8490HEPYC 9654 2PXeon Max 9480Xeon Platinum 8592+ 2PEPYC 9684X 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8380Xeon Max 9480 2PXeon Platinum 8380 2PXeon Max 9468 2P0.73981.47962.21942.95923.6993.2883.2793.0932.9442.7792.2902.0361.9231.8721.7241.7101.6171.4451.3411.3071.2981.1931.1371.0970.9640.9430.851
OpenBenchmarking.orgWatts, Fewer Is BetterGraphicsMagick 1.3.43CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon 6766E 2PXeon Platinum 8380EPYC 9684XXeon 6780E 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9754 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P110220330440550Min: 17.2 / Avg: 110.39 / Max: 118.71Min: 18.54 / Avg: 122.54 / Max: 132.44Min: 43.71 / Avg: 153.73 / Max: 166.75Min: 43.48 / Avg: 192.24 / Max: 208.39Min: 21.51 / Avg: 192.51 / Max: 206.12Min: 30.38 / Avg: 223.17 / Max: 243.96Min: 104.8 / Avg: 246.46 / Max: 265.1Min: 52.31 / Avg: 253.3 / Max: 271.57Min: 34.46 / Avg: 268.23 / Max: 288.18Min: 107.08 / Avg: 276.13 / Max: 303.23Min: 25.3 / Avg: 306.84 / Max: 336.43Min: 59.04 / Avg: 310.53 / Max: 334.67Min: 70.83 / Avg: 322.19 / Max: 348.63Min: 72.86 / Avg: 330.14 / Max: 351.19Min: 40.54 / Avg: 331.64 / Max: 362.33Min: 56.5 / Avg: 382.8 / Max: 426.76Min: 104.89 / Avg: 427.21 / Max: 467.28Min: 62.97 / Avg: 449.12 / Max: 484.89Min: 80.88 / Avg: 527.29 / Max: 574.8Min: 159.26 / Avg: 542.66 / Max: 585.44Min: 192.72 / Avg: 578.67 / Max: 624.15Min: 191.82 / Avg: 598.34 / Max: 636.31. EPYC 8534PN: Approximate power consumption of 7065 Joules per run.2. EPYC 8534P: Approximate power consumption of 7802 Joules per run.3. Xeon 6766E: Approximate power consumption of 9890 Joules per run.4. Xeon 6780E: Approximate power consumption of 12367 Joules per run.5. EPYC 9754: Approximate power consumption of 12257 Joules per run.6. EPYC 9654: Approximate power consumption of 14283 Joules per run.7. Xeon 6766E 2P: Approximate power consumption of 15773 Joules per run.8. Xeon Platinum 8380: Approximate power consumption of 16211 Joules per run.9. EPYC 9684X: Approximate power consumption of 17077 Joules per run.10. Xeon 6780E 2P: Approximate power consumption of 17765 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 19638 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 19977 Joules per run.13. Xeon Max 9480: Approximate power consumption of 20620 Joules per run.14. Xeon Max 9468: Approximate power consumption of 21239 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 21336 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 25137 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 27484 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 28444 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 33747 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 34911 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 36842 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 38094 Joules per run.

RocksDB

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Random ReadXeon 6780E 2PEPYC 9754 2PXeon 6766E 2PEPYC 9684X 2PEPYC 9654 2PXeon 6780EXeon Platinum 8592+ 2PXeon 6766EEPYC 9754Xeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HXeon Platinum 8380 2PEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon Platinum 8380300M600M900M1200M1500MSE +/- 1897433.73, N = 3SE +/- 1154820.73, N = 3SE +/- 4448269.22, N = 3SE +/- 2927744.32, N = 3SE +/- 599126.55, N = 3SE +/- 2130676.22, N = 3SE +/- 82996.27, N = 3SE +/- 1336933.52, N = 3SE +/- 153963.59, N = 3SE +/- 1411218.60, N = 3SE +/- 326038.01, N = 3SE +/- 785893.13, N = 3SE +/- 610621.13, N = 3SE +/- 1120857.00, N = 3SE +/- 1119855.47, N = 3SE +/- 206014.27, N = 3SE +/- 3338569.32, N = 3SE +/- 704022.38, N = 3SE +/- 211259.57, N = 3SE +/- 86315.43, N = 3SE +/- 81327.78, N = 3SE +/- 744772.41, N = 312729075611135206564111572074210312091518151451106453094835783928005747495525732354525250499985233100914737559464092729494055331732975179462661865372653661702512341032349926362344699392053461541255849531. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s Per Watt, More Is BetterRocksDB 9.0Test: Random ReadXeon 6766EXeon 6766E 2PXeon 6780EXeon 6780E 2PEPYC 8534PNEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 9654EPYC 9654 2PEPYC 9684XEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468Xeon Max 9468 2PXeon Platinum 8380Xeon Platinum 8380 2P500K1000K1500K2000K2500K2436056.022359232.602069916.272038972.601972313.571957165.941907427.821780768.801523041.951477897.341362651.041341710.00904750.01878232.54802721.25791368.94709419.37704496.50663946.02608125.97490897.23489869.48
OpenBenchmarking.orgWatts, Fewer Is BetterRocksDB 9.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380EPYC 9654EPYC 9754Xeon Max 9468Xeon 6780EXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9754 2PXeon 6780E 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P140280420560700Min: 18.15 / Avg: 119.15 / Max: 127.37Min: 19.07 / Avg: 149.48 / Max: 159.86Min: 43.66 / Avg: 235.93 / Max: 270.68Min: 53.91 / Avg: 255.83 / Max: 291.63Min: 24.72 / Avg: 268.72 / Max: 291.05Min: 21.45 / Avg: 292.89 / Max: 315.65Min: 73.12 / Avg: 309.28 / Max: 327.48Min: 43.52 / Avg: 311.76 / Max: 357.69Min: 25.38 / Avg: 328.84 / Max: 377.98Min: 54.21 / Avg: 330.58 / Max: 378.42Min: 77.85 / Avg: 332.82 / Max: 365.47Min: 33.04 / Avg: 384.04 / Max: 411.06Min: 104.97 / Avg: 472.92 / Max: 541.33Min: 100.64 / Avg: 512.86 / Max: 581.28Min: 53.06 / Avg: 551.56 / Max: 593.87Min: 40.42 / Avg: 595.15 / Max: 641.39Min: 107.45 / Avg: 624.29 / Max: 712.89Min: 63.13 / Avg: 658.59 / Max: 754.12Min: 145.71 / Avg: 663.47 / Max: 754.3Min: 186.94 / Avg: 666.86 / Max: 752.6Min: 195.53 / Avg: 667.81 / Max: 755.48Min: 61.31 / Avg: 768.58 / Max: 822.921. EPYC 8534PN: Approximate power consumption of 7625 Joules per run.2. EPYC 8534P: Approximate power consumption of 9567 Joules per run.3. Xeon 6766E: Approximate power consumption of 15178 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 16288 Joules per run.5. EPYC 9654: Approximate power consumption of 17109 Joules per run.6. EPYC 9754: Approximate power consumption of 18745 Joules per run.7. Xeon Max 9468: Approximate power consumption of 19897 Joules per run.8. Xeon 6780E: Approximate power consumption of 20056 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 21155 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 21268 Joules per run.11. Xeon Max 9480: Approximate power consumption of 21300 Joules per run.12. EPYC 9684X: Approximate power consumption of 24578 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 30582 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 32823 Joules per run.15. EPYC 9654 2P: Approximate power consumption of 35116 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 37891 Joules per run.17. Xeon 6780E 2P: Approximate power consumption of 40163 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 42369 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 42904 Joules per run.20. Xeon Max 9468 2P: Approximate power consumption of 42679 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 42740 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 48933 Joules per run.

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon Platinum 8380 2PXeon Platinum 8490HXeon 6780E 2PXeon 6766E 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8380Xeon 6780EXeon 6766E70140210280350SE +/- 2.28, N = 3SE +/- 0.08, N = 3SE +/- 3.85, N = 3SE +/- 0.01, N = 3SE +/- 1.93, N = 15SE +/- 1.71, N = 3SE +/- 0.93, N = 3SE +/- 0.99, N = 3SE +/- 0.93, N = 3SE +/- 1.48, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.75, N = 3SE +/- 0.31, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.96, N = 4SE +/- 0.31, N = 3SE +/- 0.11, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3309.22291.28288.54232.75191.82187.68171.77140.83133.99127.85108.12107.7297.9897.0886.9786.8878.2478.1170.2149.2043.7339.351. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
OpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2EPYC 9754EPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9654EPYC 9654 2PEPYC 9684XEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8490H 2PXeon 6766EXeon 6766E 2PXeon Max 9480 2PXeon Max 9468 2PXeon 6780EXeon Platinum 8380 2PXeon 6780E 2PXeon Platinum 83800.19060.38120.57180.76240.9530.8470.7890.7460.6690.6050.5880.5510.5320.3340.3190.2750.2480.2450.2440.2250.2160.2150.2110.1960.1960.1950.191
OpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Platinum 8380EPYC 9754EPYC 9654Xeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+EPYC 9684XXeon 6766E 2PEPYC 9754 2PXeon 6780E 2PXeon Platinum 8380 2PEPYC 9654 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2P140280420560700Min: 16.52 / Avg: 124.23 / Max: 135.64Min: 18.74 / Avg: 144.45 / Max: 156.43Min: 43.66 / Avg: 174.56 / Max: 194.55Min: 43.56 / Avg: 223.09 / Max: 250.29Min: 52.78 / Avg: 257.94 / Max: 287.95Min: 20.19 / Avg: 274.94 / Max: 327Min: 28.02 / Avg: 283.82 / Max: 328.33Min: 72.43 / Avg: 286.83 / Max: 306.63Min: 75.23 / Avg: 314.81 / Max: 352.37Min: 62.05 / Avg: 316.19 / Max: 372.81Min: 23.61 / Avg: 323.61 / Max: 376.85Min: 33.63 / Avg: 340.93 / Max: 409.44Min: 105.16 / Avg: 361.96 / Max: 383.12Min: 42.31 / Avg: 431.39 / Max: 620.63Min: 107.71 / Avg: 444.54 / Max: 472.65Min: 104.71 / Avg: 494.9 / Max: 576.68Min: 59.15 / Avg: 495.6 / Max: 654.49Min: 173.4 / Avg: 578.13 / Max: 755.42Min: 68.45 / Avg: 581.3 / Max: 795.09Min: 63.99 / Avg: 600.52 / Max: 754.84Min: 193.86 / Avg: 605.49 / Max: 719.24Min: 203.67 / Avg: 621.91 / Max: 746.151. EPYC 8534PN: Approximate power consumption of 6998 Joules per run.2. EPYC 8534P: Approximate power consumption of 7512 Joules per run.3. Xeon 6766E: Approximate power consumption of 23507 Joules per run.4. Xeon 6780E: Approximate power consumption of 27068 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 27944 Joules per run.6. EPYC 9754: Approximate power consumption of 7148 Joules per run.7. EPYC 9654: Approximate power consumption of 9650 Joules per run.8. Xeon Max 9468: Approximate power consumption of 22181 Joules per run.9. Xeon Max 9480: Approximate power consumption of 22036 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 20131 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 16828 Joules per run.12. EPYC 9684X: Approximate power consumption of 10796 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 25217 Joules per run.14. EPYC 9754 2P: Approximate power consumption of 9634 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 28154 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 28209 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 11068 Joules per run.18. Xeon Platinum 8490H 2P: Approximate power consumption of 24282 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 12401 Joules per run.20. Xeon Platinum 8592+ 2P: Approximate power consumption of 18576 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 27045 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 26535 Joules per run.

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon Platinum 8380 2PXeon Platinum 8490HXeon 6780E 2PXeon 6766E 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8380Xeon 6780EXeon 6766E17003400510068008500SE +/- 57.10, N = 3SE +/- 2.03, N = 3SE +/- 96.25, N = 3SE +/- 0.20, N = 3SE +/- 48.20, N = 15SE +/- 42.85, N = 3SE +/- 23.15, N = 3SE +/- 24.63, N = 3SE +/- 23.14, N = 3SE +/- 36.96, N = 3SE +/- 0.70, N = 3SE +/- 0.13, N = 3SE +/- 0.10, N = 3SE +/- 18.66, N = 3SE +/- 7.77, N = 3SE +/- 1.96, N = 3SE +/- 0.82, N = 3SE +/- 23.93, N = 4SE +/- 7.81, N = 3SE +/- 2.69, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 37730.477281.967213.435818.744795.464692.114294.283520.713349.763196.122703.092692.872449.452426.882174.192172.101955.881952.611755.331230.081093.21983.711. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Coremark

This is a test of EEMBC CoreMark processor benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations/Sec, More Is BetterCoremark 1.0CoreMark Size 666 - Iterations Per SecondEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon 6780E 2PXeon 6766E 2PXeon Platinum 8592+ 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon 6780EXeon Max 9480 2PXeon Max 9468 2PXeon 6766EXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Platinum 8380 2PXeon Max 9468Xeon Platinum 83802M4M6M8M10MSE +/- 76743.24, N = 3SE +/- 54771.53, N = 3SE +/- 2306.54, N = 3SE +/- 7619.10, N = 3SE +/- 9906.84, N = 3SE +/- 9700.21, N = 3SE +/- 4775.53, N = 3SE +/- 54326.71, N = 3SE +/- 10132.66, N = 3SE +/- 12743.41, N = 3SE +/- 40214.40, N = 15SE +/- 20649.43, N = 3SE +/- 7219.73, N = 3SE +/- 10294.77, N = 3SE +/- 4635.95, N = 3SE +/- 1374.66, N = 3SE +/- 9256.47, N = 3SE +/- 11678.22, N = 3SE +/- 5202.86, N = 3SE +/- 30163.42, N = 15SE +/- 1747.99, N = 3SE +/- 927.64, N = 38448083.738171241.717975907.457302247.146575205.544966250.784525288.004152864.883926265.283902076.243340274.033279262.532993136.602915609.752369998.362274636.132194630.602069432.531855135.331839444.401614763.701218453.341. (CC) gcc options: -O2 -lrt" -lrt
OpenBenchmarking.orgIterations/Sec Per Watt, More Is BetterCoremark 1.0CoreMark Size 666 - Iterations Per SecondXeon 6766E 2PXeon 6780E 2PXeon 6766EEPYC 8534PNEPYC 9754EPYC 9754 2PEPYC 8534PXeon 6780EEPYC 9654 2PEPYC 9684X 2PEPYC 9654EPYC 9684XXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380Xeon Platinum 8380 2P5K10K15K20K25K21799.9518406.9218400.4916836.6916764.4716699.8815712.0915612.9014883.3613681.1813254.1412144.318414.467555.567477.777118.476571.626163.405880.625763.205016.564373.42
OpenBenchmarking.orgWatts, Fewer Is BetterCoremark 1.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Platinum 8380Xeon Max 9468EPYC 9754Xeon Max 9480Xeon Platinum 8490HEPYC 9654Xeon 6766E 2PXeon Platinum 8592+EPYC 9684XXeon 6780E 2PXeon Platinum 8380 2PEPYC 9754 2PXeon Max 9468 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Platinum 8592+ 2PEPYC 9684X 2P140280420560700Min: 14.91 / Avg: 122.91 / Max: 138.78Min: 16.44 / Avg: 144.77 / Max: 164.64Min: 43.57 / Avg: 158.45 / Max: 217.13Min: 21.83 / Avg: 213.94 / Max: 282.7Min: 50.82 / Avg: 242.89 / Max: 290.97Min: 76.41 / Avg: 261.99 / Max: 288.93Min: 21.14 / Avg: 269.93 / Max: 353.42Min: 77.43 / Avg: 282.3 / Max: 314.07Min: 54.25 / Avg: 293.49 / Max: 341.26Min: 26.88 / Avg: 296.23 / Max: 351.89Min: 104.32 / Avg: 301.62 / Max: 446.07Min: 34.34 / Avg: 313.68 / Max: 378.24Min: 32.2 / Avg: 341.96 / Max: 411.86Min: 106.84 / Avg: 396.71 / Max: 563.32Min: 100.85 / Avg: 420.6 / Max: 582.07Min: 42.53 / Avg: 489.3 / Max: 675.15Min: 188.96 / Avg: 519.35 / Max: 613.18Min: 57.24 / Avg: 535.89 / Max: 711.09Min: 163.01 / Avg: 548.16 / Max: 709.21Min: 206.68 / Avg: 557.64 / Max: 672.47Min: 73.47 / Avg: 590.2 / Max: 753.92Min: 68.03 / Avg: 617.5 / Max: 820.531. EPYC 8534PN: Approximate power consumption of 10120 Joules per run.2. EPYC 8534P: Approximate power consumption of 10906 Joules per run.3. Xeon 6766E: Approximate power consumption of 6127 Joules per run.4. Xeon 6780E: Approximate power consumption of 9185 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 14735 Joules per run.6. Xeon Max 9468: Approximate power consumption of 18601 Joules per run.7. EPYC 9754: Approximate power consumption of 11247 Joules per run.8. Xeon Max 9480: Approximate power consumption of 17690 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 15946 Joules per run.10. EPYC 9654: Approximate power consumption of 13824 Joules per run.11. Xeon 6766E 2P: Approximate power consumption of 6736 Joules per run.12. Xeon Platinum 8592+: Approximate power consumption of 22689 Joules per run.13. EPYC 9684X: Approximate power consumption of 15160 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 9521 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 18114 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 13048 Joules per run.17. Xeon Max 9468 2P: Approximate power consumption of 21640 Joules per run.18. EPYC 9654 2P: Approximate power consumption of 14112 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 18820 Joules per run.20. Xeon Max 9480 2P: Approximate power consumption of 21748 Joules per run.21. Xeon Platinum 8592+ 2P: Approximate power consumption of 22821 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 15849 Joules per run.

srsRAN Project

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PDSCH Processor Benchmark, Throughput TotalXeon 6780E 2PXeon 6766E 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9754 2PXeon 6780EEPYC 9684XEPYC 9654Xeon 6766EXeon Platinum 8592+EPYC 9684X 2PEPYC 9754Xeon Platinum 8490HEPYC 9654 2PXeon Max 9468EPYC 8534PNEPYC 8534PXeon Platinum 8380 2PXeon Max 9480Xeon Platinum 8380Xeon Max 9480 2P7K14K21K28K35KSE +/- 242.64, N = 3SE +/- 319.61, N = 3SE +/- 356.81, N = 15SE +/- 175.78, N = 4SE +/- 312.17, N = 3SE +/- 2115.57, N = 15SE +/- 134.28, N = 4SE +/- 348.28, N = 4SE +/- 357.13, N = 12SE +/- 150.02, N = 4SE +/- 298.34, N = 15SE +/- 343.97, N = 3SE +/- 237.63, N = 3SE +/- 236.27, N = 4SE +/- 526.01, N = 15SE +/- 938.95, N = 15SE +/- 58.21, N = 3SE +/- 207.19, N = 5SE +/- 308.01, N = 15SE +/- 281.72, N = 15SE +/- 44.42, N = 3SE +/- 490.54, N = 1533010.531677.230547.630236.030108.729877.129804.429384.927695.227281.926378.125977.425194.624688.522931.821286.619485.819375.918943.615081.013537.711866.71. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -fno-trapping-math -fno-math-errno -ldl
OpenBenchmarking.orgMbps Per Watt, More Is BettersrsRAN Project 23.10.1-20240325Test: PDSCH Processor Benchmark, Throughput TotalEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9654Xeon Platinum 8592+EPYC 9754EPYC 9684XXeon Platinum 8490HXeon Max 9468Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8380EPYC 9754 2PXeon Platinum 8592+ 2PXeon Max 9480Xeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8380 2PXeon Max 9480 2P4080120160200165.23141.87133.01121.16100.2698.8396.5291.4287.2175.6874.2264.7358.8758.0456.8852.1651.1249.9841.0740.9840.3119.21
OpenBenchmarking.orgWatts, Fewer Is BettersrsRAN Project 23.10.1-20240325CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon 6780EEPYC 9754Xeon Platinum 8592+EPYC 9654Xeon Max 9468Xeon Platinum 8490HXeon Max 9480EPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P130260390520650Min: 16.71 / Avg: 117.93 / Max: 142.26Min: 17.85 / Avg: 136.58 / Max: 166.81Min: 43.55 / Avg: 205.11 / Max: 263.97Min: 51.25 / Avg: 229.96 / Max: 288.72Min: 43.52 / Avg: 245.99 / Max: 312.37Min: 21.57 / Avg: 261.04 / Max: 306.84Min: 25.9 / Avg: 266.9 / Max: 379.06Min: 28.12 / Avg: 276.24 / Max: 341.73Min: 74.5 / Avg: 281.29 / Max: 379.76Min: 60.24 / Avg: 283.1 / Max: 369.61Min: 74.87 / Avg: 289.12 / Max: 373.87Min: 32.26 / Avg: 321.41 / Max: 408.75Min: 103.72 / Avg: 426.81 / Max: 506.19Min: 100.98 / Avg: 470 / Max: 560.27Min: 104.56 / Avg: 509.97 / Max: 630.46Min: 41.23 / Avg: 514.74 / Max: 612.62Min: 68.27 / Avg: 537.03 / Max: 710Min: 55.25 / Avg: 559.64 / Max: 633.66Min: 148.45 / Avg: 589.02 / Max: 721.35Min: 195.95 / Avg: 604.92 / Max: 745.23Min: 189.97 / Avg: 617.8 / Max: 721.97Min: 65.52 / Avg: 632.5 / Max: 723.621. EPYC 8534PN: Approximate power consumption of 2752 Joules per run.2. EPYC 8534P: Approximate power consumption of 3169 Joules per run.3. Xeon 6766E: Approximate power consumption of 3948 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 4906 Joules per run.5. Xeon 6780E: Approximate power consumption of 4489 Joules per run.6. EPYC 9754: Approximate power consumption of 8005 Joules per run.7. Xeon Platinum 8592+: Approximate power consumption of 4075 Joules per run.8. EPYC 9654: Approximate power consumption of 5939 Joules per run.9. Xeon Max 9468: Approximate power consumption of 4351 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 4883 Joules per run.11. Xeon Max 9480: Approximate power consumption of 5069 Joules per run.12. EPYC 9684X: Approximate power consumption of 5946 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 11524 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 11719 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 12919 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 18977 Joules per run.17. Xeon Platinum 8592+ 2P: Approximate power consumption of 10311 Joules per run.18. EPYC 9654 2P: Approximate power consumption of 23020 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 12762 Joules per run.20. Xeon Max 9468 2P: Approximate power consumption of 11947 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 15363 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 24878 Joules per run.

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Classroom - Compute: CPU-OnlyEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon 6780E 2PXeon 6766E 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon 6780EXeon 6766EXeon Platinum 8380 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon Platinum 8380306090120150SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.22, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 3SE +/- 0.25, N = 3SE +/- 0.38, N = 3SE +/- 0.67, N = 3SE +/- 0.05, N = 3SE +/- 0.16, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.18, N = 3SE +/- 0.40, N = 3SE +/- 0.20, N = 3SE +/- 0.38, N = 316.8218.6721.1224.6127.4131.6533.6135.6635.9140.2640.3844.7148.0752.4762.5463.6167.6768.6175.2676.8786.67124.63
OpenBenchmarking.orgWatts, Fewer Is BetterBlender 4.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9684XXeon 6766E 2PXeon 6780E 2PXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2P140280420560700Min: 17.21 / Avg: 130.93 / Max: 139.49Min: 16.44 / Avg: 159.04 / Max: 169.83Min: 43.66 / Avg: 214.19 / Max: 233.43Min: 52.8 / Avg: 262.14 / Max: 290.33Min: 43.65 / Avg: 273.8 / Max: 305.54Min: 21.92 / Avg: 295.34 / Max: 341.6Min: 31.02 / Avg: 300.94 / Max: 333.76Min: 24.56 / Avg: 326.8 / Max: 368.75Min: 60.22 / Avg: 330.03 / Max: 377.07Min: 77.25 / Avg: 334.43 / Max: 376.17Min: 77.77 / Avg: 335.02 / Max: 376.96Min: 32.63 / Avg: 365.01 / Max: 410.63Min: 105.51 / Avg: 410.34 / Max: 487.07Min: 108.2 / Avg: 509.44 / Max: 619.2Min: 101.27 / Avg: 509.54 / Max: 580.93Min: 41.08 / Avg: 534.08 / Max: 683.35Min: 59.51 / Avg: 570.92 / Max: 684.42Min: 80.44 / Avg: 621.31 / Max: 724.97Min: 168.91 / Avg: 636.73 / Max: 754.11Min: 210.08 / Avg: 648.81 / Max: 752.1Min: 203.45 / Avg: 652.82 / Max: 753.03Min: 62.19 / Avg: 671.43 / Max: 821.271. EPYC 8534PN: Approximate power consumption of 10430 Joules per run.2. EPYC 8534P: Approximate power consumption of 11451 Joules per run.3. Xeon 6766E: Approximate power consumption of 12209 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 33728 Joules per run.5. Xeon 6780E: Approximate power consumption of 14420 Joules per run.6. EPYC 9754: Approximate power consumption of 10632 Joules per run.7. EPYC 9654: Approximate power consumption of 13342 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 22331 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 24312 Joules per run.10. Xeon Max 9468: Approximate power consumption of 30544 Joules per run.11. Xeon Max 9480: Approximate power consumption of 27249 Joules per run.12. EPYC 9684X: Approximate power consumption of 14722 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 13268 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 14943 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 34139 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 11572 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 14653 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 23817 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 26106 Joules per run.20. Xeon Max 9480 2P: Approximate power consumption of 29197 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 32206 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 15219 Joules per run.

Aircrack-ng

Aircrack-ng is a tool for assessing WiFi/WLAN network security. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgk/s, More Is BetterAircrack-ng 1.7EPYC 9684XEPYC 9654EPYC 9754Xeon Platinum 8380 2PEPYC 8534PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon 6780EXeon 6766EXeon Platinum 8380Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2P40K80K120K160K200KSE +/- 1622.56, N = 3SE +/- 207.11, N = 3SE +/- 714.86, N = 3SE +/- 1234.47, N = 15SE +/- 338.71, N = 3SE +/- 840.59, N = 3SE +/- 1953.08, N = 3SE +/- 319.60, N = 3SE +/- 122.31, N = 3SE +/- 36.42, N = 3SE +/- 888.98, N = 3SE +/- 1379.58, N = 4SE +/- 728.55, N = 3SE +/- 1027.07, N = 15SE +/- 1131.21, N = 15SE +/- 773.70, N = 3SE +/- 1197.41, N = 15206619.29186675.43177989.89159709.75153818.03153584.20147469.33141831.78134048.96117588.99116716.40114715.79101665.4783665.7665663.8264181.2953914.931. (CXX) g++ options: -std=gnu++17 -O3 -fvisibility=hidden -fcommon -rdynamic -lnl-3 -lnl-genl-3 -lpcre -lsqlite3 -lpthread -lz -lssl -lcrypto -lhwloc -ldl -lm -pthread
OpenBenchmarking.orgk/s Per Watt, More Is BetterAircrack-ng 1.7EPYC 8534PNEPYC 8534PEPYC 9754Xeon 6766EEPYC 9654Xeon 6780EEPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Platinum 8380Xeon Max 9468Xeon Platinum 8380 2PXeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8490H 2P300600900120015001173.571057.15763.99725.96702.97609.64585.84507.73479.36433.27424.59377.96333.67142.86128.68112.1397.52
OpenBenchmarking.orgWatts, Fewer Is BetterAircrack-ng 1.7CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754Xeon Platinum 8380EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9684XXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P120240360480600Min: 15.46 / Avg: 120.86 / Max: 145.49Min: 17.23 / Avg: 145.5 / Max: 168.72Min: 43.62 / Avg: 158.02 / Max: 182.75Min: 43.53 / Avg: 191.45 / Max: 221.34Min: 10.09 / Avg: 232.97 / Max: 273.01Min: 53.68 / Avg: 239.45 / Max: 291.67Min: 29.99 / Avg: 265.55 / Max: 307.89Min: 25.19 / Avg: 302.49 / Max: 376.59Min: 55.34 / Avg: 307.64 / Max: 375.71Min: 77.17 / Avg: 309.39 / Max: 375.45Min: 73.18 / Avg: 311.12 / Max: 377.22Min: 34.08 / Avg: 352.69 / Max: 410.53Min: 97.38 / Avg: 478.65 / Max: 580.33Min: 78.32 / Avg: 498.75 / Max: 586.29Min: 160.46 / Avg: 552.88 / Max: 630.35Min: 193.67 / Avg: 585.6 / Max: 670.08Min: 195.2 / Avg: 585.65 / Max: 659.011. EPYC 8534PN: Approximate power consumption of 4270 Joules per run.2. EPYC 8534P: Approximate power consumption of 5141 Joules per run.3. Xeon 6766E: Approximate power consumption of 5610 Joules per run.4. Xeon 6780E: Approximate power consumption of 6765 Joules per run.5. EPYC 9754: Approximate power consumption of 8232 Joules per run.6. Xeon Platinum 8380: Approximate power consumption of 11254 Joules per run.7. EPYC 9654: Approximate power consumption of 12481 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 10688 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 10870 Joules per run.10. Xeon Max 9480: Approximate power consumption of 11035 Joules per run.11. Xeon Max 9468: Approximate power consumption of 10993 Joules per run.12. EPYC 9684X: Approximate power consumption of 12462 Joules per run.13. Xeon Platinum 8380 2P: Approximate power consumption of 16817 Joules per run.14. Xeon Platinum 8592+ 2P: Approximate power consumption of 17789 Joules per run.15. Xeon Platinum 8490H 2P: Approximate power consumption of 20715 Joules per run.16. Xeon Max 9480 2P: Approximate power consumption of 21940 Joules per run.17. Xeon Max 9468 2P: Approximate power consumption of 21903 Joules per run.

EPYC 9684X 2P: The test run did not produce a result.

EPYC 9654 2P: The test run did not produce a result.

EPYC 9754 2P: The test run did not produce a result.

Xeon 6766E 2P: The test run did not produce a result.

Xeon 6780E 2P: The test run did not produce a result.

WebP Image Encode

This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Lossless, Highest CompressionXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8380Xeon Platinum 8380 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754Xeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P0.1350.270.4050.540.675SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.600.590.570.570.570.560.550.550.540.540.520.510.500.490.480.480.480.480.390.380.350.351. (CC) gcc options: -fvisibility=hidden -O2 -lm
OpenBenchmarking.orgMP/s Per Watt, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Lossless, Highest CompressionEPYC 8534PNEPYC 8534PXeon 6780EXeon 6766EEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8380Xeon Platinum 8592+Xeon Platinum 8490HXeon 6780E 2PXeon 6766E 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8380 2PXeon Max 9480Xeon Max 9468EPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P0.0020.0040.0060.0080.010.0090.0090.0080.0070.0060.0060.0050.0050.0050.0040.0030.0030.0030.0030.0030.0030.0030.0020.0020.0020.0010.001
OpenBenchmarking.orgWatts, Fewer Is BetterWebP Image Encode 1.2.4CPU Power Consumption MonitorXeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8380EPYC 9684XXeon 6766E 2PXeon 6780E 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468EPYC 9754 2PXeon Max 9480Xeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P80160240320400Min: 43.65 / Avg: 50.5 / Max: 67.21Min: 43.35 / Avg: 51.07 / Max: 67.23Min: 15.76 / Avg: 52.31 / Max: 56.63Min: 15.79 / Avg: 53.42 / Max: 58.48Min: 20.24 / Avg: 77.06 / Max: 83.97Min: 27.22 / Avg: 96.75 / Max: 105.57Min: 50.06 / Avg: 101.4 / Max: 108.28Min: 30.35 / Avg: 109.81 / Max: 119.47Min: 104.05 / Avg: 111.28 / Max: 129.11Min: 105.36 / Avg: 121.62 / Max: 143.58Min: 34.5 / Avg: 128.71 / Max: 144.36Min: 60.77 / Avg: 148.44 / Max: 161.11Min: 80.95 / Avg: 184.91 / Max: 202.94Min: 39.58 / Avg: 186.91 / Max: 199.67Min: 83.4 / Avg: 190.72 / Max: 207.25Min: 97.01 / Avg: 192.53 / Max: 212.04Min: 57.93 / Avg: 225.88 / Max: 245.29Min: 61.65 / Avg: 249.88 / Max: 268.66Min: 79.69 / Avg: 274 / Max: 299.87Min: 150.62 / Avg: 324.76 / Max: 344.8Min: 205.98 / Avg: 397.44 / Max: 422.1Min: 205.48 / Avg: 407.7 / Max: 432.161. Xeon 6766E: Approximate power consumption of 3653 Joules per run.2. Xeon 6780E: Approximate power consumption of 3387 Joules per run.3. EPYC 8534PN: Approximate power consumption of 2842 Joules per run.4. EPYC 8534P: Approximate power consumption of 2885 Joules per run.5. EPYC 9754: Approximate power consumption of 4213 Joules per run.6. EPYC 9654: Approximate power consumption of 4483 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 5307 Joules per run.8. EPYC 9684X: Approximate power consumption of 5124 Joules per run.9. Xeon 6766E 2P: Approximate power consumption of 8086 Joules per run.10. Xeon 6780E 2P: Approximate power consumption of 8189 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 5749 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 7521 Joules per run.13. Xeon Max 9468: Approximate power consumption of 8937 Joules per run.14. EPYC 9754 2P: Approximate power consumption of 10218 Joules per run.15. Xeon Max 9480: Approximate power consumption of 9091 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 10332 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 10541 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 11661 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 12330 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 16671 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 19342 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 19841 Joules per run.

libavif avifenc

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 2Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+EPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480 2PXeon Max 9468 2PXeon Max 9480EPYC 9754Xeon Max 9468EPYC 8534PEPYC 9754 2PEPYC 8534PNXeon Platinum 8380 2PXeon Platinum 8380Xeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P20406080100SE +/- 0.09, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.43, N = 3SE +/- 0.16, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.22, N = 3SE +/- 0.31, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 3SE +/- 0.03, N = 3SE +/- 0.13, N = 3SE +/- 0.10, N = 3SE +/- 0.25, N = 3SE +/- 0.04, N = 3SE +/- 0.41, N = 3SE +/- 0.09, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 333.6534.0434.1534.7935.3235.4037.3137.7538.1438.6539.8840.3541.1341.6641.9242.6147.5152.2369.3471.9776.4779.201. (CXX) g++ options: -O3 -fPIC -lm
OpenBenchmarking.orgWatts, Fewer Is Betterlibavif avifenc 1.0CPU Power Consumption MonitorXeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9754Xeon 6766E 2PXeon 6780E 2PEPYC 9654Xeon Platinum 8380EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HEPYC 9754 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P130260390520650Min: 43.58 / Avg: 59.56 / Max: 150.24Min: 43.42 / Avg: 65.19 / Max: 183.13Min: 14.11 / Avg: 69.45 / Max: 130.44Min: 16.88 / Avg: 75.22 / Max: 155.11Min: 20.27 / Avg: 107.23 / Max: 247.8Min: 103.94 / Avg: 125.3 / Max: 229.12Min: 105.72 / Avg: 131.77 / Max: 264.67Min: 28.7 / Avg: 137.31 / Max: 316.42Min: 50.37 / Avg: 150.68 / Max: 290.84Min: 32.31 / Avg: 157.68 / Max: 383.9Min: 34.19 / Avg: 161.32 / Max: 375.73Min: 58.97 / Avg: 196.29 / Max: 374.92Min: 39.83 / Avg: 217.6 / Max: 369.6Min: 71.37 / Avg: 235.53 / Max: 369.9Min: 80.19 / Avg: 235.72 / Max: 375.98Min: 97.78 / Avg: 258.88 / Max: 544.31Min: 57.84 / Avg: 267.46 / Max: 494.12Min: 63.92 / Avg: 296.47 / Max: 540.97Min: 77.42 / Avg: 350.42 / Max: 724.52Min: 149.52 / Avg: 390.93 / Max: 714.36Min: 195.24 / Avg: 458.52 / Max: 733.31Min: 207.34 / Avg: 461.85 / Max: 707.441. Xeon 6766E: Approximate power consumption of 4785 Joules per run.2. Xeon 6780E: Approximate power consumption of 4781 Joules per run.3. EPYC 8534PN: Approximate power consumption of 3241 Joules per run.4. EPYC 8534P: Approximate power consumption of 3460 Joules per run.5. EPYC 9754: Approximate power consumption of 4754 Joules per run.6. Xeon 6766E 2P: Approximate power consumption of 10442 Joules per run.7. Xeon 6780E 2P: Approximate power consumption of 10014 Joules per run.8. EPYC 9654: Approximate power consumption of 5218 Joules per run.9. Xeon Platinum 8380: Approximate power consumption of 8488 Joules per run.10. EPYC 9684X: Approximate power consumption of 6045 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 6291 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 8244 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 9937 Joules per run.14. Xeon Max 9468: Approximate power consumption of 10678 Joules per run.15. Xeon Max 9480: Approximate power consumption of 10371 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 13289 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 10520 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 11661 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 13316 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 16158 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 19410 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 19706 Joules per run.

srsRAN Project

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PUSCH Processor Benchmark, Throughput TotalEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9684XXeon Platinum 8592+ 2PEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon 6780E 2PXeon Platinum 8380 2PEPYC 8534PXeon Platinum 8592+Xeon 6766E 2PEPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon 6780EXeon 6766EXeon Platinum 83802K4K6K8K10KSE +/- 76.45, N = 3SE +/- 2.29, N = 3SE +/- 74.95, N = 4SE +/- 63.64, N = 5SE +/- 55.17, N = 3SE +/- 0.12, N = 3SE +/- 0.20, N = 3SE +/- 47.68, N = 6SE +/- 0.15, N = 3SE +/- 26.47, N = 3SE +/- 14.40, N = 3SE +/- 0.17, N = 3SE +/- 25.25, N = 3SE +/- 18.09, N = 3SE +/- 36.60, N = 3SE +/- 19.02, N = 13SE +/- 18.43, N = 3SE +/- 18.30, N = 3SE +/- 0.09, N = 3SE +/- 0.00, N = 3SE +/- 8.17, N = 3SE +/- 0.07, N = 38396.76999.76835.75973.85656.95493.45239.64853.64386.63787.03414.23288.43193.03088.73067.02818.52616.92514.02170.72118.61953.11770.01. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -fno-trapping-math -fno-math-errno -ldl
OpenBenchmarking.orgMbps Per Watt, More Is BettersrsRAN Project 23.10.1-20240325Test: PUSCH Processor Benchmark, Throughput TotalEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654EPYC 9684XEPYC 9754 2PXeon 6766EXeon 6780EXeon Platinum 8592+EPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490HXeon 6766E 2PXeon 6780E 2PXeon Max 9480Xeon Platinum 8490H 2PXeon Platinum 8380Xeon Max 9468Xeon Max 9480 2PXeon Platinum 8380 2PXeon Max 9468 2P61218243026.84624.99623.40620.66618.05216.19715.53314.18013.24712.70210.97610.72510.2999.9569.7568.8548.8087.9897.9717.5527.5356.643
OpenBenchmarking.orgWatts, Fewer Is BettersrsRAN Project 23.10.1-20240325CPU Power Consumption MonitorEPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EXeon Platinum 8380Xeon Platinum 8592+EPYC 9654Xeon Platinum 8490HEPYC 9754Xeon Max 9468Xeon Max 9480Xeon 6766E 2PEPYC 9684XXeon 6780E 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P140280420560700Min: 14.51 / Avg: 104.99 / Max: 125.17Min: 43.71 / Avg: 125.74 / Max: 140.92Min: 18.17 / Avg: 127.74 / Max: 148.29Min: 43.57 / Avg: 149.41 / Max: 169.56Min: 53.15 / Avg: 221.57 / Max: 249.62Min: 25.89 / Avg: 233.17 / Max: 276.77Min: 27.31 / Avg: 253.54 / Max: 296.82Min: 62.91 / Avg: 254.1 / Max: 294.51Min: 21.5 / Avg: 255.23 / Max: 297.3Min: 74.32 / Avg: 272.33 / Max: 304.79Min: 73.76 / Avg: 283.68 / Max: 318.07Min: 106.26 / Avg: 308.05 / Max: 384.76Min: 31.36 / Avg: 313.37 / Max: 378.12Min: 108.83 / Avg: 349.96 / Max: 395.95Min: 104.84 / Avg: 436.41 / Max: 487.66Min: 82.2 / Avg: 500.5 / Max: 584.22Min: 37.54 / Avg: 518.41 / Max: 623.41Min: 60.3 / Avg: 538.17 / Max: 621.29Min: 156.44 / Avg: 551.02 / Max: 636.6Min: 206.4 / Avg: 570.06 / Max: 634.71Min: 196.65 / Avg: 580.82 / Max: 660.22Min: 67.45 / Avg: 652.65 / Max: 788.021. EPYC 8534PN: Approximate power consumption of 3885 Joules per run.2. Xeon 6766E: Approximate power consumption of 7293 Joules per run.3. EPYC 8534P: Approximate power consumption of 4301 Joules per run.4. Xeon 6780E: Approximate power consumption of 8068 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 8050 Joules per run.6. Xeon Platinum 8592+: Approximate power consumption of 8161 Joules per run.7. EPYC 9654: Approximate power consumption of 7606 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 9486 Joules per run.9. EPYC 9754: Approximate power consumption of 8627 Joules per run.10. Xeon Max 9468: Approximate power consumption of 9804 Joules per run.11. Xeon Max 9480: Approximate power consumption of 10402 Joules per run.12. Xeon 6766E 2P: Approximate power consumption of 22488 Joules per run.13. EPYC 9684X: Approximate power consumption of 8983 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 22864 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 16583 Joules per run.16. Xeon Platinum 8592+ 2P: Approximate power consumption of 18519 Joules per run.17. EPYC 9754 2P: Approximate power consumption of 22810 Joules per run.18. EPYC 9654 2P: Approximate power consumption of 22065 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 21673 Joules per run.20. Xeon Max 9468 2P: Approximate power consumption of 22232 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 23233 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 25888 Joules per run.

Llamafile

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.7Test: llava-v1.5-7b-q4 - Acceleration: CPUEPYC 9654EPYC 9684XEPYC 8534PXeon Platinum 8490HEPYC 8534PNEPYC 9754Xeon Platinum 8380Xeon Platinum 8592+EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380 2PEPYC 9754 2PXeon Platinum 8490H 2PXeon 6780EXeon 6766EXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8592+ 2PXeon Max 9480 2PXeon 6780E 2PXeon 6766E 2P612182430SE +/- 0.02, N = 5SE +/- 0.10, N = 5SE +/- 0.11, N = 4SE +/- 0.15, N = 4SE +/- 0.07, N = 4SE +/- 0.05, N = 4SE +/- 0.11, N = 3SE +/- 0.17, N = 4SE +/- 0.07, N = 4SE +/- 0.02, N = 4SE +/- 0.10, N = 15SE +/- 0.08, N = 4SE +/- 0.09, N = 15SE +/- 0.30, N = 15SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 1.08, N = 12SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 325.7525.3821.0020.9520.6520.6419.1116.6114.4714.2912.2910.9410.449.608.568.137.777.677.497.262.992.83
OpenBenchmarking.orgTokens Per Second Per Watt, More Is BetterLlamafile 0.7Test: llava-v1.5-7b-q4 - Acceleration: CPUEPYC 8534PNEPYC 8534PEPYC 9654EPYC 9754EPYC 9684XXeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8592+Xeon 6766EXeon 6780EEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8380 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2PXeon 6780E 2PXeon 6766E 2P0.05020.10040.15060.20080.2510.2230.2020.1380.1260.1100.0890.0800.0680.0610.0560.0370.0320.0310.0300.0280.0270.0190.0150.0140.0130.0070.007
OpenBenchmarking.orgWatts, Fewer Is BetterLlamafile 0.7CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EEPYC 9654Xeon Platinum 8380EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9754 2PXeon 6766E 2PEPYC 9654 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P140280420560700Min: 14.6 / Avg: 92.71 / Max: 131.37Min: 17.78 / Avg: 104.22 / Max: 157.47Min: 43.72 / Avg: 139.67 / Max: 256.22Min: 20.15 / Avg: 163.65 / Max: 315.47Min: 43.49 / Avg: 172.82 / Max: 332.78Min: 28.61 / Avg: 186.7 / Max: 318.2Min: 51.28 / Avg: 215.58 / Max: 284.94Min: 32.28 / Avg: 231.13 / Max: 402.04Min: 34.18 / Avg: 244.07 / Max: 354.9Min: 56.03 / Avg: 262.55 / Max: 376.09Min: 72.53 / Avg: 283.07 / Max: 370.83Min: 72.54 / Avg: 288.22 / Max: 376.39Min: 40.53 / Avg: 343.52 / Max: 619.26Min: 103.86 / Avg: 385.26 / Max: 509.52Min: 57.8 / Avg: 388.15 / Max: 621.67Min: 95.32 / Avg: 409.62 / Max: 565.75Min: 106.56 / Avg: 429.62 / Max: 646.38Min: 62.86 / Avg: 462.55 / Max: 790.45Min: 81.53 / Avg: 512.88 / Max: 707.9Min: 152.91 / Avg: 537.58 / Max: 745.57Min: 205.99 / Avg: 559.87 / Max: 716.53Min: 191.45 / Avg: 566.01 / Max: 704.671. EPYC 8534PN: Approximate power consumption of 1808 Joules per run.2. EPYC 8534P: Approximate power consumption of 1876 Joules per run.3. Xeon 6766E: Approximate power consumption of 4143 Joules per run.4. EPYC 9754: Approximate power consumption of 2618 Joules per run.5. Xeon 6780E: Approximate power consumption of 4632 Joules per run.6. EPYC 9654: Approximate power consumption of 2688 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 4599 Joules per run.8. EPYC 9684X: Approximate power consumption of 3513 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 5064 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 4792 Joules per run.11. Xeon Max 9468: Approximate power consumption of 9341 Joules per run.12. Xeon Max 9480: Approximate power consumption of 8551 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 7214 Joules per run.14. Xeon 6766E 2P: Approximate power consumption of 38526 Joules per run.15. EPYC 9654 2P: Approximate power consumption of 7375 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 9612 Joules per run.17. Xeon 6780E 2P: Approximate power consumption of 31792 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 9482 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 23592 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 13117 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 17169 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 18301 Joules per run.

LULESH

LULESH is the Livermore Unstructured Lagrangian Explicit Shock Hydrodynamics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgz/s, More Is BetterLULESH 2.0.3Xeon Platinum 8592+ 2PEPYC 9684X 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9654 2PEPYC 9754 2PXeon 6780E 2PXeon Platinum 8490H 2PXeon 6766E 2PXeon Platinum 8592+EPYC 9684XXeon 6780EEPYC 9654Xeon 6766EXeon Max 9480EPYC 9754Xeon Max 9468Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8380EPYC 8534PEPYC 8534PN15K30K45K60K75KSE +/- 359.29, N = 3SE +/- 675.87, N = 3SE +/- 207.54, N = 5SE +/- 206.20, N = 5SE +/- 349.39, N = 15SE +/- 427.75, N = 3SE +/- 91.45, N = 3SE +/- 272.44, N = 4SE +/- 55.60, N = 3SE +/- 437.51, N = 4SE +/- 194.65, N = 15SE +/- 314.85, N = 4SE +/- 372.12, N = 3SE +/- 254.25, N = 6SE +/- 217.67, N = 6SE +/- 244.17, N = 3SE +/- 211.12, N = 6SE +/- 182.38, N = 15SE +/- 188.07, N = 8SE +/- 53.94, N = 5SE +/- 372.63, N = 12SE +/- 373.78, N = 1270826.7354678.4953269.4752102.6748760.8246126.0844136.5343724.0642946.2638433.9727287.2626864.1126082.7126024.6025831.8424218.8323848.5423072.3021389.8217348.4316949.5916855.891. (CXX) g++ options: -O3 -fopenmp -lm -lmpi_cxx -lmpi
OpenBenchmarking.orgz/s Per Watt, More Is BetterLULESH 2.0.3Xeon 6766EEPYC 8534PNXeon Platinum 8592+Xeon 6780EEPYC 8534PXeon 6766E 2PXeon Platinum 8592+ 2PEPYC 9654Xeon 6780E 2PEPYC 9754EPYC 9684XEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8380Xeon Platinum 8380 2P4080120160200167.31162.52155.84153.17149.38144.08143.95143.77134.87134.50130.21123.49122.60122.54105.60103.89100.41100.2097.7288.3884.8350.91
OpenBenchmarking.orgWatts, Fewer Is BetterLULESH 2.0.3CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8380EPYC 9684XXeon Platinum 8490HXeon Max 9468Xeon Platinum 8592+Xeon Max 9480Xeon 6766E 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P130260390520650Min: 17.36 / Avg: 103.72 / Max: 135.92Min: 19.22 / Avg: 113.47 / Max: 157.81Min: 43.63 / Avg: 155.54 / Max: 229.09Min: 43.51 / Avg: 175.39 / Max: 270.27Min: 21.79 / Avg: 180.07 / Max: 311.6Min: 27.74 / Avg: 181.42 / Max: 285.77Min: 53.1 / Avg: 204.51 / Max: 281.83Min: 31.6 / Avg: 209.57 / Max: 345.61Min: 50.79 / Avg: 218.49 / Max: 329.56Min: 73.71 / Avg: 237.51 / Max: 333.91Min: 22.84 / Avg: 246.63 / Max: 365.09Min: 73.96 / Avg: 248.64 / Max: 365.61Min: 105.26 / Avg: 298.06 / Max: 439.37Min: 107.92 / Avg: 327.25 / Max: 513.74Min: 41.83 / Avg: 376.23 / Max: 647.63Min: 55.4 / Avg: 394.86 / Max: 598.6Min: 100.66 / Avg: 420.13 / Max: 555.76Min: 68.15 / Avg: 446.2 / Max: 721.49Min: 69.2 / Avg: 492.01 / Max: 729.97Min: 165.01 / Avg: 494.73 / Max: 717.17Min: 194.87 / Avg: 531.65 / Max: 728.1Min: 198.01 / Avg: 533.2 / Max: 722.211. EPYC 8534PN: Approximate power consumption of 3310 Joules per run.2. EPYC 8534P: Approximate power consumption of 3612 Joules per run.3. Xeon 6766E: Approximate power consumption of 6196 Joules per run.4. Xeon 6780E: Approximate power consumption of 6753 Joules per run.5. EPYC 9754: Approximate power consumption of 7863 Joules per run.6. EPYC 9654: Approximate power consumption of 4112 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 3108 Joules per run.8. EPYC 9684X: Approximate power consumption of 4652 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 2840 Joules per run.10. Xeon Max 9468: Approximate power consumption of 2929 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 4254 Joules per run.12. Xeon Max 9480: Approximate power consumption of 2901 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 14208 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 15053 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 16930 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 10161 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 10661 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 10709 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 10496 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 8410 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 7656 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 7678 Joules per run.

7-Zip Compression

This is a test of 7-Zip compression/decompression with its integrated benchmark feature. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon 6780E 2PEPYC 9754Xeon 6766E 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon 6780EXeon 6766EXeon Max 9468 2PEPYC 8534PXeon Platinum 8380 2PEPYC 8534PNXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8380300K600K900K1200K1500KSE +/- 14188.09, N = 3SE +/- 38431.24, N = 3SE +/- 15794.26, N = 3SE +/- 903.01, N = 3SE +/- 291.68, N = 3SE +/- 2333.15, N = 3SE +/- 1085.99, N = 3SE +/- 111.53, N = 3SE +/- 28320.74, N = 3SE +/- 185.14, N = 3SE +/- 6276.88, N = 3SE +/- 258.19, N = 3SE +/- 343.82, N = 3SE +/- 2598.93, N = 3SE +/- 120.28, N = 3SE +/- 559.82, N = 3SE +/- 81.21, N = 3SE +/- 119.21, N = 3SE +/- 61.74, N = 3SE +/- 374.59, N = 3SE +/- 916.22, N = 3SE +/- 309.57, N = 31340226111646510332778463357808717673137160656426265734105570544691314637684210634017073679893665343383553381462878622433472077381883451. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
OpenBenchmarking.orgMIPS Per Watt, More Is Better7-Zip Compression 22.01Test: Decompression RatingEPYC 9754EPYC 9754 2PEPYC 8534PNEPYC 8534PEPYC 9654EPYC 9684XXeon 6766EXeon 6780EEPYC 9654 2PXeon 6766E 2PEPYC 9684X 2PXeon 6780E 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Platinum 8380Xeon Max 9480Xeon Max 9480 2PXeon Max 9468Xeon Max 9468 2P70014002100280035003140.682852.082828.902768.542434.842281.232265.092052.502011.141954.731928.991861.551119.86986.76934.34908.47777.16775.27773.01746.10663.36637.01
OpenBenchmarking.orgWatts, Fewer Is Better7-Zip Compression 22.01CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Platinum 8380EPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468EPYC 9684XXeon Max 9480Xeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P140280420560700Min: 18.26 / Avg: 119.61 / Max: 153.19Min: 19.72 / Avg: 132.92 / Max: 171.37Min: 43.69 / Avg: 185.89 / Max: 235.27Min: 43.58 / Avg: 225.95 / Max: 302.95Min: 52.56 / Avg: 242.94 / Max: 291.38Min: 22.44 / Avg: 248.63 / Max: 349.11Min: 27.34 / Avg: 263.93 / Max: 352.58Min: 34.7 / Avg: 301.96 / Max: 375.99Min: 60.14 / Avg: 308.09 / Max: 375.76Min: 70.41 / Avg: 313.16 / Max: 376.07Min: 33.61 / Avg: 313.89 / Max: 411.35Min: 74.78 / Avg: 314.81 / Max: 375.55Min: 105.13 / Avg: 392.54 / Max: 530.11Min: 108.05 / Avg: 454.64 / Max: 642.86Min: 42.06 / Avg: 469.91 / Max: 704.89Min: 101.47 / Avg: 471.63 / Max: 582.19Min: 60.89 / Avg: 513.78 / Max: 716.51Min: 68.73 / Avg: 578.78 / Max: 823.64Min: 77.81 / Avg: 581.11 / Max: 756.45Min: 170.4 / Avg: 613.18 / Max: 756.05Min: 198.7 / Avg: 628.77 / Max: 756.25Min: 205.27 / Avg: 630.61 / Max: 754.381. EPYC 8534PN: Approximate power consumption of 5582 Joules per run.2. EPYC 8534P: Approximate power consumption of 5981 Joules per run.3. Xeon 6766E: Approximate power consumption of 8055 Joules per run.4. Xeon 6780E: Approximate power consumption of 8963 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 11337 Joules per run.6. EPYC 9754: Approximate power consumption of 11520 Joules per run.7. EPYC 9654: Approximate power consumption of 10469 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 12783 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 14172 Joules per run.10. Xeon Max 9468: Approximate power consumption of 15240 Joules per run.11. EPYC 9684X: Approximate power consumption of 11614 Joules per run.12. Xeon Max 9480: Approximate power consumption of 15530 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 20281 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 22126 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 27881 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 24210 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 26203 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 29132 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 30217 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 31885 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 34583 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 34053 Joules per run.

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon 6780E 2PXeon Platinum 8490H 2PXeon 6766E 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+Xeon 6780EXeon 6766EXeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480EPYC 8534PEPYC 8534PNXeon Max 9468Xeon Platinum 8380170K340K510K680K850KSE +/- 2500.52, N = 3SE +/- 6869.20, N = 3SE +/- 3075.95, N = 3SE +/- 709.87, N = 3SE +/- 1102.28, N = 3SE +/- 4200.62, N = 3SE +/- 7384.79, N = 3SE +/- 1520.59, N = 3SE +/- 1188.96, N = 3SE +/- 719.89, N = 3SE +/- 3924.87, N = 3SE +/- 5127.15, N = 3SE +/- 1982.97, N = 3SE +/- 933.46, N = 3SE +/- 610.46, N = 3SE +/- 1785.84, N = 3SE +/- 1535.53, N = 3SE +/- 2258.81, N = 3SE +/- 268.94, N = 3SE +/- 206.69, N = 3SE +/- 1836.55, N = 3SE +/- 248.73, N = 37769687617347413666742396112005927295918355791125754405495005255144917294416364380484138513917193881903423633313573190943147162437321. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Algebraic Multi-Grid Benchmark

AMG is a parallel algebraic multigrid solver for linear systems arising from problems on unstructured grids. The driver provided with AMG builds linear systems for various 3-dimensional problems. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFigure Of Merit, More Is BetterAlgebraic Multi-Grid Benchmark 1.2EPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9684XEPYC 9654EPYC 9754Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 8380Xeon Platinum 8380 2P1000M2000M3000M4000M5000MSE +/- 6340323.98, N = 3SE +/- 8808919.44, N = 3SE +/- 9014927.20, N = 3SE +/- 9164253.67, N = 3SE +/- 7233468.75, N = 3SE +/- 2438223.49, N = 3SE +/- 235140242.43, N = 12SE +/- 4963892.66, N = 3SE +/- 1066998.75, N = 3SE +/- 433397.56, N = 3SE +/- 4000850.45, N = 3SE +/- 468935.32, N = 3SE +/- 1778769.08, N = 3SE +/- 3359086.30, N = 3SE +/- 2902028.33, N = 3SE +/- 291866.98, N = 3SE +/- 971797.70, N = 3SE +/- 467864.03, N = 3446728133343249303333609646333320516100031562616673124402667278303908323761490002282802000227535266718147600001605097000159799333315884966671150052667114710800010736276677231535331. (CC) gcc options: -lparcsr_ls -lparcsr_mv -lseq_mv -lIJ_mv -lkrylov -lHYPRE_utilities -lm -fopenmp -lmpi
OpenBenchmarking.orgFigure Of Merit Per Watt, More Is BetterAlgebraic Multi-Grid Benchmark 1.2EPYC 9754EPYC 8534PNEPYC 9654EPYC 8534PEPYC 9654 2PEPYC 9684XEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9754 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8380Xeon Platinum 8380 2P2M4M6M8M10M10610537.8210387087.229442032.079344903.388578578.708293777.787422966.056520382.606349445.215533330.985415151.065380716.035363427.415337195.715320019.085278683.304622831.261552824.49
OpenBenchmarking.orgWatts, Fewer Is BetterAlgebraic Multi-Grid Benchmark 1.2CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PEPYC 9754Xeon Platinum 8380EPYC 9654Xeon Platinum 8592+EPYC 9684XXeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P140280420560700Min: 16.12 / Avg: 110.44 / Max: 131.86Min: 17.02 / Avg: 123.07 / Max: 150.22Min: 20 / Avg: 214.44 / Max: 294.78Min: 51.21 / Avg: 232.24 / Max: 283.34Min: 23.58 / Avg: 241.77 / Max: 304.95Min: 25.82 / Avg: 285.81 / Max: 370.88Min: 27.09 / Avg: 286.5 / Max: 375.22Min: 75.43 / Avg: 295.22 / Max: 373.47Min: 58.01 / Avg: 296.41 / Max: 368.28Min: 59.54 / Avg: 297.94 / Max: 371.37Min: 98.75 / Avg: 465.7 / Max: 552.2Min: 42.41 / Avg: 502.96 / Max: 635.91Min: 58.67 / Avg: 504.15 / Max: 640.85Min: 67.59 / Avg: 553.59 / Max: 733.88Min: 164.81 / Avg: 591.89 / Max: 729.05Min: 189.38 / Avg: 593.28 / Max: 741.95Min: 186.85 / Avg: 600.53 / Max: 731.72Min: 63.8 / Avg: 601.82 / Max: 781.061. EPYC 8534PN: Approximate power consumption of 4197 Joules per run.2. EPYC 8534P: Approximate power consumption of 4677 Joules per run.3. EPYC 9754: Approximate power consumption of 9435 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 6038 Joules per run.5. EPYC 9654: Approximate power consumption of 7978 Joules per run.6. Xeon Platinum 8592+: Approximate power consumption of 7241 Joules per run.7. EPYC 9684X: Approximate power consumption of 9072 Joules per run.8. Xeon Max 9468: Approximate power consumption of 6298 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 8102 Joules per run.10. Xeon Max 9480: Approximate power consumption of 7349 Joules per run.11. Xeon Platinum 8380 2P: Approximate power consumption of 31202 Joules per run.12. EPYC 9754 2P: Approximate power consumption of 35249 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 19158 Joules per run.14. Xeon Platinum 8592+ 2P: Approximate power consumption of 16054 Joules per run.15. Xeon Platinum 8490H 2P: Approximate power consumption of 18546 Joules per run.16. Xeon Max 9468 2P: Approximate power consumption of 14041 Joules per run.17. Xeon Max 9480 2P: Approximate power consumption of 15814 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 22067 Joules per run.

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 512Xeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8380Xeon Platinum 8380 2PEPYC 9654EPYC 9654 2PEPYC 9684XEPYC 9684X 2PEPYC 8534PEPYC 9754 2PEPYC 8534PNEPYC 9754Xeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P4M8M12M16M20MSE +/- 9492.69, N = 3SE +/- 162096.41, N = 15SE +/- 5238.74, N = 3SE +/- 17457.89, N = 3SE +/- 30179.10, N = 3SE +/- 7571.88, N = 3SE +/- 8685.88, N = 3SE +/- 38670.98, N = 3SE +/- 18478.22, N = 3SE +/- 11150.49, N = 3SE +/- 121304.48, N = 3SE +/- 124115.99, N = 3SE +/- 134727.30, N = 3SE +/- 234395.65, N = 15SE +/- 3464.10, N = 3SE +/- 11050.39, N = 3SE +/- 31571.79, N = 3SE +/- 120841.84, N = 4SE +/- 88.19, N = 3SE +/- 133.33, N = 3SE +/- 115.47, N = 3SE +/- 33.33, N = 318774333182005331690633316904667168853331688400016882333168433331360833313599000133946671339066713387333130831331129000011273667112363331117450069839336969967628430062807671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s Per Watt, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 512Xeon Platinum 8592+EPYC 8534PNEPYC 8534PXeon Platinum 8490HXeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8380Xeon Max 9468Xeon 6766EXeon Max 9480EPYC 9684XXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon 6780E 2PEPYC 9754 2PXeon Max 9468 2PEPYC 9654 2PXeon Max 9480 2PXeon 6766E 2PEPYC 9684X 2P50K100K150K200K250K234762.36232185.74229953.45186991.46158555.72155096.20146784.94145590.23144779.82143435.84136523.06129024.5192062.0875252.1172744.4864666.3163241.2761488.8361154.4560089.5659249.3254322.93
OpenBenchmarking.orgWatts, Fewer Is BetterLiquid-DSP 1.6CPU Power Consumption MonitorXeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9754Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9654Xeon Platinum 8380EPYC 9684XXeon 6766E 2PXeon 6780E 2PXeon Max 9468Xeon Max 9480EPYC 9754 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Max 9468 2PXeon Max 9480 2P60120180240300Min: 43.55 / Avg: 43.81 / Max: 45.6Min: 43.37 / Avg: 44.05 / Max: 45.52Min: 15.14 / Avg: 48.39 / Max: 52.91Min: 16.02 / Avg: 49.1 / Max: 53.74Min: 20.45 / Avg: 72.05 / Max: 78.73Min: 34.71 / Avg: 79.97 / Max: 86.36Min: 64.97 / Avg: 90.28 / Max: 123.68Min: 27.87 / Avg: 91.25 / Max: 99.85Min: 48.5 / Avg: 93.47 / Max: 100.4Min: 33.62 / Avg: 103.76 / Max: 113.64Min: 103.81 / Avg: 106.01 / Max: 108.94Min: 105.16 / Avg: 107.78 / Max: 109.29Min: 76.32 / Avg: 116.77 / Max: 126.02Min: 87.22 / Avg: 123.68 / Max: 135.23Min: 39.35 / Avg: 178.26 / Max: 197.4Min: 100.48 / Avg: 180.71 / Max: 198.88Min: 80.57 / Avg: 197.7 / Max: 288.51Min: 58.4 / Avg: 218.96 / Max: 238.65Min: 161.66 / Avg: 231.54 / Max: 318.27Min: 58.81 / Avg: 240.84 / Max: 263.72Min: 202.94 / Avg: 274.92 / Max: 318.53Min: 214.89 / Avg: 280.98 / Max: 313.661. Xeon 6766E: Approximate power consumption of 1504 Joules per run.2. Xeon 6780E: Approximate power consumption of 1512 Joules per run.3. EPYC 8534PN: Approximate power consumption of 1645 Joules per run.4. EPYC 8534P: Approximate power consumption of 1686 Joules per run.5. EPYC 9754: Approximate power consumption of 2468 Joules per run.6. Xeon Platinum 8592+: Approximate power consumption of 2746 Joules per run.7. Xeon Platinum 8490H: Approximate power consumption of 3100 Joules per run.8. EPYC 9654: Approximate power consumption of 3133 Joules per run.9. Xeon Platinum 8380: Approximate power consumption of 3209 Joules per run.10. EPYC 9684X: Approximate power consumption of 3562 Joules per run.11. Xeon 6766E 2P: Approximate power consumption of 3640 Joules per run.12. Xeon 6780E 2P: Approximate power consumption of 3701 Joules per run.13. Xeon Max 9468: Approximate power consumption of 4009 Joules per run.14. Xeon Max 9480: Approximate power consumption of 4205 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 6061 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 6144 Joules per run.17. Xeon Platinum 8592+ 2P: Approximate power consumption of 6735 Joules per run.18. EPYC 9654 2P: Approximate power consumption of 7445 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 8027 Joules per run.20. EPYC 9684X 2P: Approximate power consumption of 8173 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 9347 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 9553 Joules per run.

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: EP.DEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8380 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 8534PEPYC 8534PNXeon Max 9468Xeon Platinum 83805K10K15K20K25KSE +/- 602.37, N = 15SE +/- 1274.85, N = 12SE +/- 530.31, N = 15SE +/- 30.19, N = 4SE +/- 100.23, N = 4SE +/- 10.93, N = 4SE +/- 367.88, N = 12SE +/- 309.03, N = 15SE +/- 4.83, N = 4SE +/- 122.47, N = 15SE +/- 17.53, N = 3SE +/- 22.33, N = 3SE +/- 6.77, N = 3SE +/- 6.53, N = 3SE +/- 14.68, N = 3SE +/- 50.01, N = 8SE +/- 155.10, N = 12SE +/- 13.82, N = 322166.6022017.7519414.9416004.0714946.7612793.0112575.3011424.0510970.4510652.038880.828089.147562.806445.096416.345745.045366.694479.281. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
OpenBenchmarking.orgTotal Mop/s Per Watt, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: EP.DEPYC 9754 2PEPYC 9754EPYC 8534PNEPYC 8534PEPYC 9654 2PEPYC 9684X 2PEPYC 9654EPYC 9684XXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9480 2PXeon Max 9468Xeon Max 9468 2PXeon Platinum 8380 2PXeon Platinum 8380132639526558.0953.7450.7249.7146.5644.7243.8637.1233.9329.2428.7225.9623.8622.7721.0720.3920.1718.48
OpenBenchmarking.orgWatts, Fewer Is BetterNAS Parallel Benchmarks 3.4CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PEPYC 9754Xeon Platinum 8380EPYC 9654Xeon Max 9468Xeon Max 9480Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9684XEPYC 9754 2PEPYC 9654 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P140280420560700Min: 17.1 / Avg: 113.27 / Max: 135.62Min: 18.8 / Avg: 129.08 / Max: 158.73Min: 21.19 / Avg: 234.01 / Max: 336.9Min: 51.37 / Avg: 242.36 / Max: 290.59Min: 26.47 / Avg: 242.89 / Max: 334.43Min: 73.35 / Avg: 254.67 / Max: 351.04Min: 76.21 / Avg: 270.13 / Max: 345.76Min: 26.35 / Avg: 276.68 / Max: 375.06Min: 57.58 / Avg: 291.31 / Max: 376.98Min: 31.93 / Avg: 307.77 / Max: 409.54Min: 40.5 / Avg: 379.03 / Max: 677.9Min: 56.44 / Avg: 416.97 / Max: 683.16Min: 100.12 / Avg: 440.29 / Max: 581.61Min: 68.69 / Avg: 471.7 / Max: 753.27Min: 65.8 / Avg: 495.73 / Max: 819.01Min: 155.56 / Avg: 520.43 / Max: 752.57Min: 200.97 / Avg: 537.97 / Max: 722.6Min: 196.31 / Avg: 561.84 / Max: 754.161. EPYC 8534PN: Approximate power consumption of 3271 Joules per run.2. EPYC 8534P: Approximate power consumption of 3399 Joules per run.3. EPYC 9754: Approximate power consumption of 3998 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 8644 Joules per run.5. EPYC 9654: Approximate power consumption of 4388 Joules per run.6. Xeon Max 9468: Approximate power consumption of 7895 Joules per run.7. Xeon Max 9480: Approximate power consumption of 7203 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 6364 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 6894 Joules per run.10. EPYC 9684X: Approximate power consumption of 5335 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 7296 Joules per run.12. EPYC 9654 2P: Approximate power consumption of 6560 Joules per run.13. Xeon Platinum 8380 2P: Approximate power consumption of 9393 Joules per run.14. Xeon Platinum 8592+ 2P: Approximate power consumption of 8373 Joules per run.15. EPYC 9684X 2P: Approximate power consumption of 7403 Joules per run.16. Xeon Platinum 8490H 2P: Approximate power consumption of 8977 Joules per run.17. Xeon Max 9468 2P: Approximate power consumption of 10491 Joules per run.18. Xeon Max 9480 2P: Approximate power consumption of 10113 Joules per run.

ASTC Encoder

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: Very ThoroughEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon 6780E 2PEPYC 9754Xeon Max 9480 2PXeon 6766E 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon 6780EXeon Max 9480Xeon 6766EEPYC 8534PEPYC 8534PNXeon Max 9468Xeon Platinum 8380 2PXeon Platinum 8380510152025SE +/- 0.1961, N = 15SE +/- 0.1284, N = 3SE +/- 0.1965, N = 3SE +/- 0.0007, N = 3SE +/- 0.0379, N = 3SE +/- 0.0314, N = 3SE +/- 0.0006, N = 3SE +/- 0.0022, N = 3SE +/- 0.0386, N = 3SE +/- 0.0254, N = 3SE +/- 0.0055, N = 3SE +/- 0.0006, N = 3SE +/- 0.0294, N = 3SE +/- 0.0054, N = 3SE +/- 0.0005, N = 3SE +/- 0.0016, N = 3SE +/- 0.0005, N = 3SE +/- 0.0007, N = 3SE +/- 0.0012, N = 3SE +/- 0.0016, N = 3SE +/- 0.0026, N = 3SE +/- 0.0075, N = 322.002319.405217.009814.633413.751812.622012.318711.887511.357310.322410.20519.18447.62407.08856.51665.97025.86325.74205.24065.13424.29352.15961. (CXX) g++ options: -O3 -flto -pthread
OpenBenchmarking.orgMT/s Per Watt, More Is BetterASTC Encoder 4.7Preset: Very ThoroughEPYC 9754 2PEPYC 9754EPYC 8534PNEPYC 8534PEPYC 9654 2PEPYC 9684X 2PEPYC 9654Xeon 6766E 2PEPYC 9684XXeon 6780E 2PXeon 6766EXeon Platinum 8592+ 2PXeon 6780EXeon Platinum 8592+Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8380 2PXeon Platinum 83800.01170.02340.03510.04680.05850.0520.0470.0410.0380.0360.0360.0340.0330.0320.0300.0300.0280.0260.0260.0250.0230.0200.0190.0170.0160.0090.008
OpenBenchmarking.orgWatts, Fewer Is BetterASTC Encoder 4.7CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Platinum 8380EPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9684XXeon 6766E 2PEPYC 9754 2PXeon 6780E 2PEPYC 9654 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P140280420560700Min: 15.84 / Avg: 128.4 / Max: 151.19Min: 18.13 / Avg: 151.45 / Max: 177.27Min: 43.59 / Avg: 194.13 / Max: 235.38Min: 43.52 / Avg: 249.37 / Max: 311.61Min: 53.27 / Avg: 255.32 / Max: 291.21Min: 21.13 / Avg: 262.17 / Max: 365.71Min: 25.96 / Avg: 270.94 / Max: 337.98Min: 35.19 / Avg: 294.16 / Max: 378.5Min: 61.31 / Avg: 301.81 / Max: 376.57Min: 87.45 / Avg: 313.77 / Max: 375.54Min: 74.02 / Avg: 315.87 / Max: 377.36Min: 33 / Avg: 322.42 / Max: 410.63Min: 104.49 / Avg: 346.65 / Max: 485.81Min: 39.19 / Avg: 421.17 / Max: 704.37Min: 106.83 / Avg: 422.58 / Max: 617.03Min: 58.13 / Avg: 474.96 / Max: 673.2Min: 97.89 / Avg: 488.29 / Max: 581.33Min: 71.14 / Avg: 526.63 / Max: 753.88Min: 64.98 / Avg: 538.44 / Max: 820.03Min: 154.33 / Avg: 550 / Max: 755.26Min: 200.66 / Avg: 582.09 / Max: 758.49Min: 205.14 / Avg: 590.21 / Max: 754.131. EPYC 8534PN: Approximate power consumption of 7019 Joules per run.2. EPYC 8534P: Approximate power consumption of 7623 Joules per run.3. Xeon 6766E: Approximate power consumption of 10030 Joules per run.4. Xeon 6780E: Approximate power consumption of 11554 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 30894 Joules per run.6. EPYC 9754: Approximate power consumption of 7428 Joules per run.7. EPYC 9654: Approximate power consumption of 9212 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 11864 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 12978 Joules per run.10. Xeon Max 9480: Approximate power consumption of 15375 Joules per run.11. Xeon Max 9468: Approximate power consumption of 17478 Joules per run.12. EPYC 9684X: Approximate power consumption of 10210 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 11208 Joules per run.14. EPYC 9754 2P: Approximate power consumption of 9490 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 12536 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 11399 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 31902 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 14570 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 12384 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 15217 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 17463 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 19477 Joules per run.

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: AlexNetXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Max 9480 2PEPYC 9654 2PXeon Max 9468 2PEPYC 9754EPYC 9754 2PXeon Platinum 8380 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon 6780E 2PXeon Max 9468Xeon 6766E 2PXeon Platinum 8380EPYC 8534PEPYC 8534PNXeon 6780EXeon 6766E400800120016002000SE +/- 5.06, N = 3SE +/- 1.86, N = 3SE +/- 15.82, N = 3SE +/- 5.81, N = 3SE +/- 6.01, N = 3SE +/- 1.15, N = 3SE +/- 4.01, N = 3SE +/- 10.23, N = 15SE +/- 3.03, N = 3SE +/- 1.54, N = 3SE +/- 2.58, N = 3SE +/- 4.27, N = 3SE +/- 0.54, N = 3SE +/- 6.82, N = 3SE +/- 10.51, N = 4SE +/- 1.21, N = 3SE +/- 19.06, N = 15SE +/- 1.28, N = 3SE +/- 0.99, N = 3SE +/- 0.41, N = 3SE +/- 2.12, N = 3SE +/- 1.03, N = 31730.251681.441560.561528.411524.741479.531454.711403.461340.341301.261278.581277.461205.301058.991010.93986.04857.20852.14843.63771.47668.33609.67
OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: AlexNetEPYC 8534PNEPYC 9754EPYC 8534PEPYC 9654EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HEPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8380EPYC 9654 2PXeon 6766EXeon Max 9480EPYC 9684X 2PXeon Max 9468Xeon Platinum 8380 2PXeon 6780EXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon 6780E 2PXeon 6766E 2P2468107.1446.9766.6845.4194.8084.7494.1463.8293.6353.5913.5353.5243.4443.2483.2053.1273.1263.1222.5932.5152.4562.368
OpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.16.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EEPYC 9654Xeon Platinum 8380Xeon Platinum 8592+EPYC 9684XXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon 6766E 2PEPYC 9754 2PXeon 6780E 2PEPYC 9654 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P120240360480600Min: 18.12 / Avg: 108 / Max: 132.76Min: 17.24 / Avg: 126.21 / Max: 154.11Min: 43.66 / Avg: 173.02 / Max: 210.79Min: 22.22 / Avg: 206.77 / Max: 269.72Min: 43.57 / Avg: 213.83 / Max: 263.13Min: 26.89 / Avg: 235.94 / Max: 296.09Min: 53.46 / Avg: 237.33 / Max: 279.61Min: 33.64 / Avg: 268.97 / Max: 332.41Min: 33.53 / Avg: 270.65 / Max: 335.43Min: 58.81 / Avg: 290.68 / Max: 351.63Min: 83.56 / Avg: 307.45 / Max: 358.74Min: 71.72 / Avg: 307.61 / Max: 356.17Min: 105.44 / Avg: 362.01 / Max: 449.07Min: 40.95 / Avg: 366.52 / Max: 481.87Min: 108.29 / Avg: 411.57 / Max: 512.05Min: 54.66 / Avg: 428.39 / Max: 556.88Min: 102.12 / Avg: 428.69 / Max: 526.9Min: 79.54 / Avg: 462.52 / Max: 594.2Min: 69.6 / Avg: 480.42 / Max: 618.89Min: 155.31 / Avg: 554.16 / Max: 691.31Min: 206.23 / Avg: 588.17 / Max: 702.19Min: 196.2 / Avg: 589.54 / Max: 703.421. EPYC 8534PN: Approximate power consumption of 4680 Joules per run.2. EPYC 8534P: Approximate power consumption of 5090 Joules per run.3. Xeon 6766E: Approximate power consumption of 9228 Joules per run.4. EPYC 9754: Approximate power consumption of 5445 Joules per run.5. Xeon 6780E: Approximate power consumption of 10549 Joules per run.6. EPYC 9654: Approximate power consumption of 6685 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 9414 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 7621 Joules per run.9. EPYC 9684X: Approximate power consumption of 7578 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 8527 Joules per run.11. Xeon Max 9480: Approximate power consumption of 10146 Joules per run.12. Xeon Max 9468: Approximate power consumption of 10767 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 14601 Joules per run.14. EPYC 9754 2P: Approximate power consumption of 10043 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 14508 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 10995 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 11860 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 10638 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 12011 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 12746 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 15293 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 14738 Joules per run.

miniFE

MiniFE Finite Element is an application for unstructured implicit finite element codes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgCG Mflops, More Is BetterminiFE 2.2Problem Size: SmallEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9754Xeon Platinum 8490H 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754 2PXeon 6780EXeon 6766EXeon 6766E 2PXeon 6780E 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon Max 9480 2PXeon Max 9468Xeon Max 9468 2PXeon Max 948013K26K39K52K65KSE +/- 2182.93, N = 15SE +/- 92.04, N = 5SE +/- 42.89, N = 5SE +/- 53.07, N = 5SE +/- 467.78, N = 4SE +/- 1510.37, N = 15SE +/- 1633.92, N = 15SE +/- 2087.13, N = 15SE +/- 8.42, N = 4SE +/- 19.87, N = 4SE +/- 1039.71, N = 15SE +/- 712.94, N = 12SE +/- 11.14, N = 4SE +/- 135.77, N = 4SE +/- 366.08, N = 4SE +/- 42.17, N = 4SE +/- 49.20, N = 4SE +/- 54.57, N = 4SE +/- 283.44, N = 3SE +/- 601.03, N = 12SE +/- 1097.75, N = 15SE +/- 572.00, N = 1259466.653167.850909.650139.946877.543531.042114.642113.540626.440441.039580.937461.135230.131830.231046.524548.824526.022957.321583.220091.119876.518621.21. (CXX) g++ options: -O3 -fopenmp -lmpi_cxx -lmpi
OpenBenchmarking.orgCG Mflops Per Watt, More Is BetterminiFE 2.2Problem Size: SmallEPYC 9754Xeon 6766EXeon 6780EEPYC 9654EPYC 9684XEPYC 8534PNEPYC 8534PXeon 6766E 2PEPYC 9684X 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 9654 2PXeon Platinum 8380Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Max 9468Xeon Max 9480Xeon Max 9480 2PXeon Max 9468 2P90180270360450392.87373.28340.56334.41298.90282.72254.52183.43179.90165.96162.67160.18156.59140.84120.52114.81110.4895.0079.2471.5243.1139.85
OpenBenchmarking.orgWatts, Fewer Is BetterminiFE 2.2CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8380Xeon Platinum 8592+Xeon 6766E 2PXeon Platinum 8490HXeon 6780E 2PXeon Max 9468EPYC 9754 2PXeon Max 9480EPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P130260390520650Min: 15.16 / Avg: 86.83 / Max: 132.07Min: 19.07 / Avg: 96.36 / Max: 147.72Min: 43.59 / Avg: 108.34 / Max: 211.25Min: 43.53 / Avg: 119.29 / Max: 232.16Min: 21.36 / Avg: 127.63 / Max: 261.53Min: 28.79 / Avg: 152.24 / Max: 300.13Min: 33.7 / Avg: 177.88 / Max: 364.34Min: 53.33 / Avg: 190.48 / Max: 282.32Min: 31.62 / Avg: 198.71 / Max: 331.13Min: 104.71 / Avg: 215.79 / Max: 487.65Min: 61.92 / Avg: 224.98 / Max: 377.92Min: 106.66 / Avg: 225.73 / Max: 522.28Min: 75.77 / Avg: 253.53 / Max: 365.64Min: 40.05 / Avg: 258.88 / Max: 518.97Min: 73.91 / Avg: 260.35 / Max: 366.7Min: 53.09 / Avg: 309.09 / Max: 579.88Min: 99.06 / Avg: 326.82 / Max: 539.95Min: 63.04 / Avg: 330.55 / Max: 718.24Min: 73.08 / Avg: 366.83 / Max: 700.4Min: 168.8 / Avg: 424.3 / Max: 732.03Min: 189.32 / Avg: 498.77 / Max: 730.29Min: 199.32 / Avg: 500.61 / Max: 723.881. EPYC 8534PN: Approximate power consumption of 1758 Joules per run.2. EPYC 8534P: Approximate power consumption of 1927 Joules per run.3. Xeon 6766E: Approximate power consumption of 1815 Joules per run.4. Xeon 6780E: Approximate power consumption of 1939 Joules per run.5. EPYC 9754: Approximate power consumption of 1914 Joules per run.6. EPYC 9654: Approximate power consumption of 2101 Joules per run.7. EPYC 9684X: Approximate power consumption of 2419 Joules per run.8. Xeon Platinum 8380: Approximate power consumption of 3905 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 3328 Joules per run.10. Xeon 6766E 2P: Approximate power consumption of 4503 Joules per run.11. Xeon Platinum 8490H: Approximate power consumption of 3656 Joules per run.12. Xeon 6780E 2P: Approximate power consumption of 5022 Joules per run.13. Xeon Max 9468: Approximate power consumption of 5388 Joules per run.14. EPYC 9754 2P: Approximate power consumption of 4297 Joules per run.15. Xeon Max 9480: Approximate power consumption of 5814 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 4719 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 5964 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 4584 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 6114 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 6895 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 12802 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 11681 Joules per run.

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop TestEPYC 9684XEPYC 9684X 2PEPYC 9654EPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480EPYC 8534PXeon Max 9468EPYC 8534PNXeon Platinum 83801020304050SE +/- 0.19, N = 3SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.32, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.18, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.18, N = 3SE +/- 0.08, N = 3SE +/- 0.35, N = 3SE +/- 0.21, N = 320.4522.5222.5323.5323.6926.8827.5127.6327.8627.9028.2231.1731.4931.9233.2333.7535.9543.45
OpenBenchmarking.orgWatts, Fewer Is BetterOpenRadioss 2023.09.15CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PEPYC 9754Xeon Platinum 8380EPYC 9654Xeon Platinum 8592+EPYC 9684XXeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P140280420560700Min: 18.07 / Avg: 113.05 / Max: 140.62Min: 19.07 / Avg: 127.55 / Max: 161.94Min: 19.86 / Avg: 210.23 / Max: 333.55Min: 52.02 / Avg: 232.77 / Max: 290.08Min: 30.24 / Avg: 238.37 / Max: 343.81Min: 34.28 / Avg: 272.03 / Max: 374.83Min: 33.62 / Avg: 276.69 / Max: 409.57Min: 59.2 / Avg: 289.5 / Max: 374.11Min: 77.53 / Avg: 297.92 / Max: 375.01Min: 76.63 / Avg: 302.43 / Max: 377Min: 41.04 / Avg: 357.25 / Max: 670.96Min: 97.57 / Avg: 424.07 / Max: 583.23Min: 58.09 / Avg: 439.02 / Max: 706.97Min: 60.04 / Avg: 493.1 / Max: 819.11Min: 71.17 / Avg: 504.55 / Max: 754.24Min: 172.03 / Avg: 545.45 / Max: 745.98Min: 199.37 / Avg: 570.84 / Max: 753.68Min: 206.26 / Avg: 572.24 / Max: 749.991. EPYC 8534PN: Approximate power consumption of 5577 Joules per run.2. EPYC 8534P: Approximate power consumption of 5867 Joules per run.3. EPYC 9754: Approximate power consumption of 8760 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 12570 Joules per run.5. EPYC 9654: Approximate power consumption of 8661 Joules per run.6. Xeon Platinum 8592+: Approximate power consumption of 10519 Joules per run.7. EPYC 9684X: Approximate power consumption of 9407 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 12159 Joules per run.9. Xeon Max 9480: Approximate power consumption of 12612 Joules per run.10. Xeon Max 9468: Approximate power consumption of 13105 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 21316 Joules per run.12. Xeon Platinum 8380 2P: Approximate power consumption of 18942 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 19609 Joules per run.14. EPYC 9684X 2P: Approximate power consumption of 21697 Joules per run.15. Xeon Platinum 8592+ 2P: Approximate power consumption of 20687 Joules per run.16. Xeon Platinum 8490H 2P: Approximate power consumption of 23455 Joules per run.17. Xeon Max 9468 2P: Approximate power consumption of 22834 Joules per run.18. Xeon Max 9480 2P: Approximate power consumption of 23653 Joules per run.

VVenC

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FasterEPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9754Xeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 8592+ 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon 6780EXeon 6766E48121620SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.12, N = 3SE +/- 0.01, N = 3SE +/- 0.13, N = 6SE +/- 0.16, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 317.0216.7315.9715.0614.7914.3614.1013.9713.6113.2613.1013.0212.5411.9711.9011.1810.391. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects
OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FasterEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8592+Xeon Platinum 8380Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P0.03220.06440.09660.12880.1610.1430.1300.1140.1080.1060.0900.0800.0680.0620.0600.0510.0510.0380.0310.0280.0230.023
OpenBenchmarking.orgWatts, Fewer Is BetterVVenC 1.11CPU Power Consumption MonitorXeon 6766EEPYC 8534PNXeon 6780EEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8380EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P110220330440550Min: 43.53 / Avg: 90.8 / Max: 124.66Min: 17.01 / Avg: 95.43 / Max: 126.76Min: 43.51 / Avg: 103.62 / Max: 147.39Min: 18.52 / Avg: 107.71 / Max: 147.66Min: 20.86 / Avg: 139.36 / Max: 195.74Min: 29.27 / Avg: 185.29 / Max: 257.81Min: 54.24 / Avg: 210.37 / Max: 275.5Min: 34.49 / Avg: 211.98 / Max: 303.77Min: 34.91 / Avg: 235.39 / Max: 320.85Min: 60.17 / Avg: 250.97 / Max: 326.74Min: 74.46 / Avg: 275.77 / Max: 340.06Min: 73.18 / Avg: 282.13 / Max: 350.27Min: 100.84 / Avg: 347.13 / Max: 466.54Min: 77.34 / Avg: 425.45 / Max: 535.49Min: 149.66 / Avg: 449.44 / Max: 572.09Min: 204.58 / Avg: 521.13 / Max: 631.04Min: 209.37 / Avg: 521.79 / Max: 619.751. Xeon 6766E: Approximate power consumption of 5932 Joules per run.2. EPYC 8534PN: Approximate power consumption of 4931 Joules per run.3. Xeon 6780E: Approximate power consumption of 6321 Joules per run.4. EPYC 8534P: Approximate power consumption of 5422 Joules per run.5. EPYC 9754: Approximate power consumption of 7061 Joules per run.6. EPYC 9654: Approximate power consumption of 8153 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 10799 Joules per run.8. EPYC 9684X: Approximate power consumption of 9115 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 10436 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 11628 Joules per run.11. Xeon Max 9468: Approximate power consumption of 13421 Joules per run.12. Xeon Max 9480: Approximate power consumption of 13448 Joules per run.13. Xeon Platinum 8380 2P: Approximate power consumption of 18572 Joules per run.14. Xeon Platinum 8592+ 2P: Approximate power consumption of 23116 Joules per run.15. Xeon Platinum 8490H 2P: Approximate power consumption of 26067 Joules per run.16. Xeon Max 9480 2P: Approximate power consumption of 31268 Joules per run.17. Xeon Max 9468 2P: Approximate power consumption of 30960 Joules per run.

Video Input: Bosphorus 4K - Video Preset: Faster

EPYC 9684X 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

EPYC 9654 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

EPYC 9754 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

Xeon 6766E 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

Xeon 6780E 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

Primesieve

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e13EPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon 6780E 2PXeon Platinum 8490H 2PXeon 6766E 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380 2PEPYC 8534PXeon Platinum 8592+Xeon Platinum 8490HXeon 6780EEPYC 8534PNXeon 6766EXeon Max 9480Xeon Max 9468Xeon Platinum 838020406080100SE +/- 0.01, N = 4SE +/- 0.02, N = 4SE +/- 0.01, N = 4SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.25, N = 311.5612.1312.6321.7623.2724.2425.0226.4627.1129.3930.2033.9240.4445.9548.4151.8252.0754.3957.7158.1667.3281.361. (CXX) g++ options: -O3
OpenBenchmarking.orgWatts, Fewer Is BetterPrimesieve 12.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PEPYC 9754 2PXeon 6780E 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P140280420560700Min: 15.99 / Avg: 116.97 / Max: 130.2Min: 17.27 / Avg: 151.7 / Max: 165.81Min: 43.71 / Avg: 208.57 / Max: 226.96Min: 52.11 / Avg: 258.9 / Max: 290.98Min: 43.4 / Avg: 266.63 / Max: 294.13Min: 21.63 / Avg: 274.16 / Max: 334.73Min: 28.63 / Avg: 313.43 / Max: 370.81Min: 21.47 / Avg: 325.15 / Max: 377.46Min: 54.67 / Avg: 328.05 / Max: 377.53Min: 74.48 / Avg: 332.68 / Max: 375.62Min: 74.26 / Avg: 333.11 / Max: 377.38Min: 34.15 / Avg: 347.93 / Max: 410.94Min: 104.03 / Avg: 414.77 / Max: 479.6Min: 103.1 / Avg: 498.66 / Max: 583Min: 41.03 / Avg: 500.8 / Max: 682.66Min: 105.22 / Avg: 507.66 / Max: 599.09Min: 38.5 / Avg: 568.09 / Max: 750.08Min: 72.85 / Avg: 610.7 / Max: 755.46Min: 60.51 / Avg: 618.54 / Max: 821.49Min: 169.87 / Avg: 623.11 / Max: 754.26Min: 195.98 / Avg: 641.65 / Max: 754.11Min: 198.12 / Avg: 644.29 / Max: 754.211. EPYC 8534PN: Approximate power consumption of 6823 Joules per run.2. EPYC 8534P: Approximate power consumption of 7585 Joules per run.3. Xeon 6766E: Approximate power consumption of 12793 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 22093 Joules per run.5. Xeon 6780E: Approximate power consumption of 15020 Joules per run.6. EPYC 9754: Approximate power consumption of 7037 Joules per run.7. EPYC 9654: Approximate power consumption of 8985 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 17016 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 18371 Joules per run.10. Xeon Max 9480: Approximate power consumption of 20626 Joules per run.11. Xeon Max 9468: Approximate power consumption of 23762 Joules per run.12. EPYC 9684X: Approximate power consumption of 9626 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 13826 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 22273 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 7888 Joules per run.16. Xeon 6780E 2P: Approximate power consumption of 15568 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 9232 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 17914 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 10051 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 19524 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 22030 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 24698 Joules per run.

GROMACS

The GROMACS (GROningen MAchine for Chemical Simulations) molecular dynamics package testing with the water_GMX50 data. This test profile allows selecting between CPU and GPU-based GROMACS builds. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 8380510152025SE +/- 0.224, N = 14SE +/- 0.067, N = 3SE +/- 0.189, N = 6SE +/- 0.046, N = 3SE +/- 0.019, N = 3SE +/- 0.052, N = 3SE +/- 0.032, N = 3SE +/- 0.025, N = 3SE +/- 0.032, N = 3SE +/- 0.034, N = 3SE +/- 0.009, N = 3SE +/- 0.036, N = 3SE +/- 0.010, N = 3SE +/- 0.007, N = 3SE +/- 0.019, N = 3SE +/- 0.004, N = 3SE +/- 0.004, N = 3SE +/- 0.018, N = 322.52521.30520.23418.54015.45015.22214.12713.39213.24212.51410.4778.9648.7628.2827.5456.4996.2464.8131. (CXX) g++ options: -O3 -lm
OpenBenchmarking.orgNs Per Day Per Watt, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareEPYC 9754EPYC 8534PNEPYC 9654EPYC 9684XEPYC 8534PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9480Xeon Platinum 8490H 2PXeon Max 9468Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380Xeon Platinum 8380 2P0.01190.02380.03570.04760.05950.0530.0520.0480.0480.0470.0470.0400.0370.0360.0350.0290.0270.0260.0240.0230.0220.0190.019
OpenBenchmarking.orgWatts, Fewer Is BetterGROMACS 2024CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon Platinum 8380EPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9684XEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Max 9468 2PXeon Max 9480 2P140280420560700Min: 16.45 / Avg: 120.24 / Max: 142.62Min: 18.05 / Avg: 137.24 / Max: 164.83Min: 53.31 / Avg: 248.51 / Max: 290.81Min: 22.18 / Avg: 250.1 / Max: 348.03Min: 27.69 / Avg: 260.21 / Max: 348.03Min: 24.97 / Avg: 289.21 / Max: 376.32Min: 54.7 / Avg: 306.77 / Max: 376.19Min: 75.59 / Avg: 311.94 / Max: 375.77Min: 76.31 / Avg: 314 / Max: 374.89Min: 33.95 / Avg: 317.95 / Max: 409.49Min: 40.72 / Avg: 455.51 / Max: 701.31Min: 104.75 / Avg: 474.08 / Max: 581.34Min: 56.1 / Avg: 505.98 / Max: 708.92Min: 75.68 / Avg: 535.3 / Max: 753.28Min: 166.32 / Avg: 584.52 / Max: 753.32Min: 65.5 / Avg: 601.18 / Max: 820.89Min: 201.3 / Avg: 602.79 / Max: 753.69Min: 205.45 / Avg: 603.46 / Max: 753.721. EPYC 8534PN: Approximate power consumption of 5130 Joules per run.2. EPYC 8534P: Approximate power consumption of 5627 Joules per run.3. Xeon Platinum 8380: Approximate power consumption of 11846 Joules per run.4. EPYC 9754: Approximate power consumption of 7837 Joules per run.5. EPYC 9654: Approximate power consumption of 7459 Joules per run.6. Xeon Platinum 8592+: Approximate power consumption of 8965 Joules per run.7. Xeon Platinum 8490H: Approximate power consumption of 10328 Joules per run.8. Xeon Max 9480: Approximate power consumption of 10606 Joules per run.9. Xeon Max 9468: Approximate power consumption of 10990 Joules per run.10. EPYC 9684X: Approximate power consumption of 8055 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 19587 Joules per run.12. Xeon Platinum 8380 2P: Approximate power consumption of 16277 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 16529 Joules per run.14. Xeon Platinum 8592+ 2P: Approximate power consumption of 17130 Joules per run.15. Xeon Platinum 8490H 2P: Approximate power consumption of 18120 Joules per run.16. EPYC 9684X 2P: Approximate power consumption of 18680 Joules per run.17. Xeon Max 9468 2P: Approximate power consumption of 17883 Joules per run.18. Xeon Max 9480 2P: Approximate power consumption of 19110 Joules per run.

ASTC Encoder

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: ExhaustiveEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon 6780E 2PEPYC 9754Xeon Max 9480 2PXeon 6766E 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon 6780EXeon 6766EXeon Max 9480EPYC 8534PEPYC 8534PNXeon Max 9468Xeon Platinum 8380 2PXeon Platinum 838048121620SE +/- 0.1160, N = 3SE +/- 0.0170, N = 3SE +/- 0.0218, N = 3SE +/- 0.0157, N = 3SE +/- 0.0164, N = 3SE +/- 0.0118, N = 3SE +/- 0.0025, N = 3SE +/- 0.0016, N = 3SE +/- 0.0040, N = 3SE +/- 0.0086, N = 3SE +/- 0.0033, N = 3SE +/- 0.0002, N = 3SE +/- 0.0072, N = 3SE +/- 0.0024, N = 3SE +/- 0.0000, N = 3SE +/- 0.0007, N = 3SE +/- 0.0011, N = 3SE +/- 0.0010, N = 3SE +/- 0.0006, N = 3SE +/- 0.0003, N = 3SE +/- 0.0029, N = 3SE +/- 0.0016, N = 314.103811.910710.60188.90918.37017.90607.55737.20757.12916.30276.21265.63014.63034.26894.05743.65053.62763.51463.19933.12042.64711.33191. (CXX) g++ options: -O3 -flto -pthread
OpenBenchmarking.orgMT/s Per Watt, More Is BetterASTC Encoder 4.7Preset: ExhaustiveEPYC 9754 2PEPYC 9754EPYC 8534PNEPYC 8534PEPYC 9654 2PXeon 6766E 2PEPYC 9654EPYC 9684X 2PEPYC 9684XXeon 6780E 2PXeon 6766EXeon Platinum 8592+ 2PXeon 6780EXeon Platinum 8592+Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8380Xeon Platinum 8380 2P0.00740.01480.02220.02960.0370.0330.0290.0250.0230.0230.0210.0210.0210.0200.0190.0190.0170.0160.0160.0150.0140.0120.0120.0110.0100.0050.005
OpenBenchmarking.orgWatts, Fewer Is BetterASTC Encoder 4.7CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Platinum 8380EPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9684XXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Max 9480 2PXeon Max 9468 2P140280420560700Min: 15.2 / Avg: 129.53 / Max: 151.58Min: 18.31 / Avg: 151.62 / Max: 177.01Min: 43.7 / Avg: 193.71 / Max: 235.48Min: 43.55 / Avg: 250.35 / Max: 311.8Min: 54.67 / Avg: 254.82 / Max: 291.9Min: 22.1 / Avg: 264.41 / Max: 366.28Min: 29.24 / Avg: 271.69 / Max: 338.26Min: 36.03 / Avg: 293.73 / Max: 378.6Min: 57.84 / Avg: 300.87 / Max: 376.96Min: 82.06 / Avg: 312.54 / Max: 376.01Min: 74.57 / Avg: 315.36 / Max: 378.01Min: 35.44 / Avg: 322.22 / Max: 410.64Min: 105.14 / Avg: 347.52 / Max: 490.12Min: 107.83 / Avg: 422.73 / Max: 622.38Min: 41.13 / Avg: 424.16 / Max: 725.4Min: 58.38 / Avg: 469.68 / Max: 682.7Min: 103.02 / Avg: 483.56 / Max: 581.87Min: 80.68 / Avg: 525.87 / Max: 752.74Min: 152.83 / Avg: 551.93 / Max: 753.4Min: 65.5 / Avg: 555.22 / Max: 820.52Min: 207.67 / Avg: 586.49 / Max: 753.26Min: 207.97 / Avg: 591.29 / Max: 755.191. EPYC 8534PN: Approximate power consumption of 6995 Joules per run.2. EPYC 8534P: Approximate power consumption of 7531 Joules per run.3. Xeon 6766E: Approximate power consumption of 9621 Joules per run.4. Xeon 6780E: Approximate power consumption of 11349 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 29984 Joules per run.6. EPYC 9754: Approximate power consumption of 7404 Joules per run.7. EPYC 9654: Approximate power consumption of 9147 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 11553 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 12938 Joules per run.10. Xeon Max 9480: Approximate power consumption of 15210 Joules per run.11. Xeon Max 9468: Approximate power consumption of 17345 Joules per run.12. EPYC 9684X: Approximate power consumption of 9881 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 10889 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 11977 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 8907 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 10803 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 30948 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 13673 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 14902 Joules per run.20. EPYC 9684X 2P: Approximate power consumption of 11845 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 17008 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 18921 Joules per run.

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: MediumEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon 6780E 2PXeon Max 9468 2PXeon 6766E 2PEPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon 6780EXeon Platinum 8592+Xeon Platinum 8380 2PXeon Max 9480Xeon 6766EXeon Max 9468Xeon Platinum 83801020304050SE +/- 0.46, N = 4SE +/- 0.23, N = 4SE +/- 0.28, N = 11SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.16, N = 15SE +/- 0.03, N = 3SE +/- 0.23, N = 5SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.16, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 345.2642.0338.1232.7432.4431.4430.3727.6524.6522.5922.2522.0319.2517.8517.8017.2916.6416.1915.6815.6515.1712.56
OpenBenchmarking.orgFrames Per Second Per Watt, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: MediumEPYC 8534PNEPYC 9654EPYC 8534PEPYC 9754Xeon 6766EXeon 6780EEPYC 9754 2PEPYC 9684XXeon 6766E 2PEPYC 9654 2PXeon 6780E 2PEPYC 9684X 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380 2P0.03740.07480.11220.14960.1870.1660.1500.1480.1450.1340.1240.1050.1050.0940.0900.0870.0860.0620.0590.0570.0510.0510.0510.0510.0420.0390.038
OpenBenchmarking.orgWatts, Fewer Is Betteruvg266 0.4.1CPU Power Consumption MonitorEPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EEPYC 9654EPYC 9754Xeon 6766E 2PXeon Platinum 8380Xeon 6780E 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9684XEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P130260390520650Min: 16.52 / Avg: 107.55 / Max: 128.61Min: 43.61 / Avg: 116.67 / Max: 128.84Min: 18.2 / Avg: 130.37 / Max: 151.17Min: 43.45 / Avg: 138.99 / Max: 161.82Min: 29.07 / Avg: 209.83 / Max: 311.67Min: 22.31 / Avg: 224.13 / Max: 286.22Min: 104.75 / Avg: 234.71 / Max: 274.07Min: 52.84 / Avg: 248.57 / Max: 274.13Min: 107.22 / Avg: 259.74 / Max: 308.25Min: 26.08 / Avg: 283.27 / Max: 364.78Min: 60.4 / Avg: 287.16 / Max: 327.69Min: 76.55 / Avg: 299.38 / Max: 332.83Min: 74.3 / Avg: 306.72 / Max: 336.87Min: 34.79 / Avg: 310.62 / Max: 383.33Min: 40.54 / Avg: 362.19 / Max: 493.12Min: 103.64 / Avg: 425.24 / Max: 481.28Min: 56.62 / Avg: 464.69 / Max: 608.77Min: 66.05 / Avg: 527.19 / Max: 710.22Min: 76.25 / Avg: 536.26 / Max: 744.89Min: 168.73 / Avg: 543.59 / Max: 642.52Min: 208.68 / Avg: 571.96 / Max: 640.22Min: 190.07 / Avg: 582.58 / Max: 673.851. EPYC 8534PN: Approximate power consumption of 4087 Joules per run.2. Xeon 6766E: Approximate power consumption of 4939 Joules per run.3. EPYC 8534P: Approximate power consumption of 4606 Joules per run.4. Xeon 6780E: Approximate power consumption of 5421 Joules per run.5. EPYC 9654: Approximate power consumption of 6155 Joules per run.6. EPYC 9754: Approximate power consumption of 5155 Joules per run.7. Xeon 6766E 2P: Approximate power consumption of 7417 Joules per run.8. Xeon Platinum 8380: Approximate power consumption of 12760 Joules per run.9. Xeon 6780E 2P: Approximate power consumption of 8017 Joules per run.10. Xeon Platinum 8592+: Approximate power consumption of 11425 Joules per run.11. Xeon Platinum 8490H: Approximate power consumption of 10912 Joules per run.12. Xeon Max 9468: Approximate power consumption of 13173 Joules per run.13. Xeon Max 9480: Approximate power consumption of 12984 Joules per run.14. EPYC 9684X: Approximate power consumption of 6937 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 7244 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 17435 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 8481 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 9226 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 13049 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 14496 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 17731 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 16701 Joules per run.

John The Ripper

This is a benchmark of John The Ripper, which is a password cracker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: WPA PSKEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8380 2PXeon Platinum 8592+Xeon 6780E 2PXeon Platinum 8490HEPYC 8534PXeon 6766E 2PEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon Platinum 8380Xeon 6780EXeon 6766E300K600K900K1200K1500KSE +/- 4358.90, N = 3SE +/- 5291.50, N = 3SE +/- 1333.33, N = 3SE +/- 478.70, N = 3SE +/- 15579.94, N = 15SE +/- 2519.00, N = 3SE +/- 2683.36, N = 3SE +/- 788.50, N = 3SE +/- 921.74, N = 3SE +/- 5122.51, N = 3SE +/- 1491.72, N = 3SE +/- 864.17, N = 3SE +/- 394.40, N = 3SE +/- 1599.31, N = 3SE +/- 321.00, N = 3SE +/- 187.67, N = 3SE +/- 79.20, N = 3SE +/- 1274.00, N = 3SE +/- 987.33, N = 3SE +/- 177.03, N = 3SE +/- 66.16, N = 3SE +/- 30.00, N = 31551000129400012533338031877970937932536713226578896434755628754915834281164072564012783862123676573399983340762865522480662098031889251. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
OpenBenchmarking.orgReal C/S Per Watt, More Is BetterJohn The Ripper 2023.03.14Test: WPA PSKEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9754 2PEPYC 9654EPYC 9654 2PEPYC 9684XEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon 6766EXeon 6766E 2PXeon 6780EXeon 6780E 2P60012001800240030002563.932414.272304.832253.102017.721941.481853.751799.501374.721347.411285.881261.481204.611133.971100.831057.221017.121004.94953.29881.55815.37784.52
OpenBenchmarking.orgWatts, Fewer Is BetterJohn The Ripper 2023.03.14CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon Max 9468Xeon 6780EXeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+EPYC 9654EPYC 9754EPYC 9684XXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2P140280420560700Min: 17.08 / Avg: 132.61 / Max: 150.07Min: 18.24 / Avg: 159.97 / Max: 182.75Min: 43.68 / Avg: 198.18 / Max: 221.69Min: 53.04 / Avg: 243.89 / Max: 290.93Min: 66.96 / Avg: 252.7 / Max: 281.63Min: 43.57 / Avg: 257.31 / Max: 292.39Min: 76.35 / Avg: 277.33 / Max: 310.37Min: 56.65 / Avg: 297.81 / Max: 364.7Min: 23.24 / Avg: 311.42 / Max: 376.46Min: 29.6 / Avg: 318.91 / Max: 365.41Min: 22.59 / Avg: 348.48 / Max: 397.44Min: 33.28 / Avg: 362.14 / Max: 411.02Min: 108.35 / Avg: 417.06 / Max: 466.57Min: 99.22 / Avg: 489.17 / Max: 579.96Min: 109.89 / Avg: 519.11 / Max: 586.15Min: 186.18 / Avg: 532.41 / Max: 591.91Min: 193.96 / Avg: 597.63 / Max: 753.44Min: 64.41 / Avg: 619.88 / Max: 753.08Min: 165.05 / Avg: 628.83 / Max: 743.61Min: 59 / Avg: 645.56 / Max: 737.44Min: 43.51 / Avg: 688.39 / Max: 796.51Min: 67.44 / Avg: 719.09 / Max: 821.151. EPYC 8534PN: Approximate power consumption of 4553 Joules per run.2. EPYC 8534P: Approximate power consumption of 5492 Joules per run.3. Xeon 6766E: Approximate power consumption of 6738 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 8374 Joules per run.5. Xeon Max 9468: Approximate power consumption of 8676 Joules per run.6. Xeon 6780E: Approximate power consumption of 8920 Joules per run.7. Xeon Max 9480: Approximate power consumption of 9522 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 10324 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 10692 Joules per run.10. EPYC 9654: Approximate power consumption of 10843 Joules per run.11. EPYC 9754: Approximate power consumption of 11964 Joules per run.12. EPYC 9684X: Approximate power consumption of 12313 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 14458 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 16795 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 17996 Joules per run.16. Xeon Max 9468 2P: Approximate power consumption of 18457 Joules per run.17. Xeon Max 9480 2P: Approximate power consumption of 20718 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 21448 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 22009 Joules per run.20. EPYC 9654 2P: Approximate power consumption of 22164 Joules per run.21. EPYC 9754 2P: Approximate power consumption of 23864 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 24928 Joules per run.

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: GoogLeNetXeon Platinum 8380EPYC 8534PEPYC 8534PNXeon Max 9468EPYC 9684XXeon Platinum 8490HEPYC 9654Xeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8592+EPYC 9754Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon 6780EEPYC 9684X 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon 6766EEPYC 9754 2PXeon 6780E 2PXeon 6766E 2P1224364860SE +/- 0.24, N = 7SE +/- 0.30, N = 15SE +/- 0.14, N = 6SE +/- 0.27, N = 7SE +/- 0.33, N = 15SE +/- 0.19, N = 6SE +/- 0.41, N = 15SE +/- 0.27, N = 6SE +/- 0.34, N = 15SE +/- 0.21, N = 6SE +/- 0.27, N = 15SE +/- 0.20, N = 15SE +/- 0.23, N = 12SE +/- 0.23, N = 15SE +/- 0.09, N = 4SE +/- 0.17, N = 15SE +/- 0.12, N = 6SE +/- 0.14, N = 15SE +/- 0.04, N = 4SE +/- 0.04, N = 3SE +/- 0.06, N = 9SE +/- 0.05, N = 753.3836.6636.4836.1334.2033.5632.8031.4729.1821.6721.0018.2414.6713.5013.1412.8312.6912.4212.408.106.725.88
OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: GoogLeNetEPYC 8534PNEPYC 8534PXeon Platinum 8380EPYC 9654EPYC 9684XXeon Platinum 8490HEPYC 9754Xeon Max 9468Xeon 6766EXeon Platinum 8592+Xeon 6780EXeon Max 9480Xeon Platinum 8380 2PXeon Max 9468 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon 6780E 2PEPYC 9754 2PXeon 6766E 2P0.14580.29160.43740.58320.7290.6480.6070.4960.2830.2610.2170.2070.2040.1770.1740.1720.1710.1270.0430.0410.0410.0380.0340.0340.0320.0310.030
OpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.16.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754Xeon Platinum 8380EPYC 9654Xeon Platinum 8592+EPYC 9684XXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P100200300400500Min: 15.28 / Avg: 56.3 / Max: 109.74Min: 14.4 / Avg: 60.4 / Max: 120.48Min: 43.55 / Avg: 69.97 / Max: 94.67Min: 43.43 / Avg: 76.44 / Max: 108.57Min: 20.13 / Avg: 101.49 / Max: 176.75Min: 50.23 / Avg: 107.65 / Max: 211.46Min: 27.18 / Avg: 115.93 / Max: 228.86Min: 26.58 / Avg: 124.36 / Max: 199.6Min: 30.18 / Avg: 131.02 / Max: 261.02Min: 57.88 / Avg: 154.91 / Max: 259.01Min: 74.34 / Avg: 177.15 / Max: 279.76Min: 71.73 / Avg: 183.7 / Max: 287.38Min: 104.02 / Avg: 195.59 / Max: 247.83Min: 105.84 / Avg: 207.14 / Max: 268.89Min: 98.2 / Avg: 229.87 / Max: 381.04Min: 39.52 / Avg: 262.36 / Max: 352.55Min: 57.14 / Avg: 306.45 / Max: 450.83Min: 73.56 / Avg: 313.09 / Max: 440.43Min: 61.13 / Avg: 340.38 / Max: 500.24Min: 148.89 / Avg: 402.29 / Max: 545.86Min: 186.6 / Avg: 423.67 / Max: 565.69Min: 191.38 / Avg: 433 / Max: 578.391. EPYC 8534PN: Approximate power consumption of 619 Joules per run.2. EPYC 8534P: Approximate power consumption of 656 Joules per run.3. Xeon 6766E: Approximate power consumption of 1242 Joules per run.4. Xeon 6780E: Approximate power consumption of 1280 Joules per run.5. EPYC 9754: Approximate power consumption of 1353 Joules per run.6. Xeon Platinum 8380: Approximate power consumption of 1030 Joules per run.7. EPYC 9654: Approximate power consumption of 1237 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 1492 Joules per run.9. EPYC 9684X: Approximate power consumption of 1354 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 1627 Joules per run.11. Xeon Max 9468: Approximate power consumption of 1822 Joules per run.12. Xeon Max 9480: Approximate power consumption of 1959 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 5588 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 5340 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 2651 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 5859 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 5026 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 4957 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 5446 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 6303 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 5762 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 6820 Joules per run.

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 57Xeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9654 2PXeon Platinum 8380Xeon Platinum 8380 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P16M32M48M64M80MSE +/- 599433.09, N = 9SE +/- 68119.99, N = 3SE +/- 4910.31, N = 3SE +/- 5364.49, N = 3SE +/- 666.67, N = 3SE +/- 4163.33, N = 3SE +/- 3844.19, N = 3SE +/- 822374.71, N = 4SE +/- 7423.69, N = 3SE +/- 12719.19, N = 3SE +/- 34724.31, N = 3SE +/- 486361.09, N = 3SE +/- 15982.63, N = 3SE +/- 178712.37, N = 3SE +/- 7937.25, N = 3SE +/- 8089.77, N = 3SE +/- 4807.40, N = 3SE +/- 393224.42, N = 3SE +/- 5206.83, N = 3SE +/- 11392.00, N = 3SE +/- 20835.33, N = 3SE +/- 2185.81, N = 3731406677049900067130333671276676707466767064000669913336626600055455333554253335541566754954667540896675393033346270000462296674621066745486333371956673712133333444667334393331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s Per Watt, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 57EPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon 6780EXeon 6766EXeon Platinum 8490HEPYC 9754EPYC 9654Xeon Max 9468Xeon Platinum 8380Xeon Max 9480EPYC 9684XXeon 6780E 2PXeon 6766E 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9654 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P200K400K600K800K1000K924272.74919805.49859261.41845147.04764093.38741692.03633663.71604481.01575880.01572291.34539196.73529757.56344751.30315271.07310526.31295293.25287557.79256852.19250729.15243752.92235014.31229312.07
OpenBenchmarking.orgWatts, Fewer Is BetterLiquid-DSP 1.6CPU Power Consumption MonitorXeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9754Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9654Xeon Platinum 8380EPYC 9684XXeon 6766E 2PXeon 6780E 2PXeon Max 9468Xeon Max 9480EPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Max 9468 2PXeon Max 9480 2P60120180240300Min: 43.57 / Avg: 43.77 / Max: 45.58Min: 43.3 / Avg: 44.01 / Max: 45.17Min: 16 / Avg: 49.21 / Max: 54.17Min: 17.35 / Avg: 50.24 / Max: 54.91Min: 21.28 / Avg: 73.02 / Max: 80.63Min: 33.42 / Avg: 85.12 / Max: 133.8Min: 62.53 / Avg: 90.43 / Max: 122.85Min: 26.34 / Avg: 91.69 / Max: 100.53Min: 50.3 / Avg: 94.51 / Max: 101.21Min: 31.94 / Avg: 104.68 / Max: 114.13Min: 103.81 / Avg: 106.07 / Max: 107.92Min: 104.74 / Avg: 107.68 / Max: 108.89Min: 75.77 / Avg: 116.57 / Max: 125.17Min: 84.47 / Avg: 124.5 / Max: 135.18Min: 40.07 / Avg: 179.99 / Max: 198.16Min: 97.63 / Avg: 182.63 / Max: 203.03Min: 56.89 / Avg: 219.18 / Max: 239.46Min: 79.82 / Avg: 227.03 / Max: 288.68Min: 162.53 / Avg: 232.97 / Max: 292.63Min: 64.49 / Avg: 241.66 / Max: 264.36Min: 206.29 / Avg: 275.13 / Max: 324.32Min: 203.12 / Avg: 281.97 / Max: 319.461. Xeon 6766E: Approximate power consumption of 1488 Joules per run.2. Xeon 6780E: Approximate power consumption of 1496 Joules per run.3. EPYC 8534PN: Approximate power consumption of 1690 Joules per run.4. EPYC 8534P: Approximate power consumption of 1708 Joules per run.5. EPYC 9754: Approximate power consumption of 2483 Joules per run.6. Xeon Platinum 8592+: Approximate power consumption of 2904 Joules per run.7. Xeon Platinum 8490H: Approximate power consumption of 3105 Joules per run.8. EPYC 9654: Approximate power consumption of 3148 Joules per run.9. Xeon Platinum 8380: Approximate power consumption of 3213 Joules per run.10. EPYC 9684X: Approximate power consumption of 3559 Joules per run.11. Xeon 6766E 2P: Approximate power consumption of 3642 Joules per run.12. Xeon 6780E 2P: Approximate power consumption of 3661 Joules per run.13. Xeon Max 9468: Approximate power consumption of 4002 Joules per run.14. Xeon Max 9480: Approximate power consumption of 4233 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 6120 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 6210 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 7379 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 7795 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 7999 Joules per run.20. EPYC 9684X 2P: Approximate power consumption of 8216 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 9446 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 9587 Joules per run.

QuantLib

QuantLib is an open-source library/framework around quantitative finance for modeling, trading and risk management scenarios. QuantLib is written in C++ with Boost and its built-in benchmark used reports the QuantLib Benchmark Index benchmark score. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Single-ThreadedXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9468 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 8534PEPYC 8534PNEPYC 9754 2PXeon Platinum 8380 2PXeon Platinum 8380Xeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P8001600240032004000SE +/- 33.58, N = 3SE +/- 30.36, N = 12SE +/- 25.35, N = 3SE +/- 22.17, N = 3SE +/- 28.57, N = 3SE +/- 25.40, N = 3SE +/- 28.42, N = 3SE +/- 28.11, N = 3SE +/- 1.14, N = 3SE +/- 22.39, N = 3SE +/- 24.27, N = 3SE +/- 19.83, N = 3SE +/- 14.83, N = 3SE +/- 18.64, N = 3SE +/- 14.40, N = 3SE +/- 19.30, N = 3SE +/- 2.82, N = 3SE +/- 14.88, N = 3SE +/- 6.88, N = 3SE +/- 7.35, N = 3SE +/- 4.87, N = 3SE +/- 4.34, N = 33600.53586.33229.13225.73222.83210.13209.63207.03125.43114.23105.93098.52596.12593.32593.02590.82558.62534.51960.71954.21765.61760.81. (CXX) g++ options: -O3 -march=native -fPIE -pie
OpenBenchmarking.orgMFLOPS Per Watt, More Is BetterQuantLib 1.32Configuration: Single-ThreadedEPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon 6780EXeon 6766EEPYC 9754EPYC 9654Xeon Platinum 8490HEPYC 9684XXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon 6780E 2PXeon 6766E 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Max 9468 2PXeon Max 9480 2P112233445550.1449.1245.3543.8740.3034.8133.7431.9429.6027.3226.6824.9218.0916.4815.0114.2314.0713.9213.2912.8011.1511.01
OpenBenchmarking.orgWatts, Fewer Is BetterQuantLib 1.32CPU Power Consumption MonitorXeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9754Xeon Platinum 8592+EPYC 9654Xeon Platinum 8380Xeon Platinum 8490HEPYC 9684XXeon 6766E 2PXeon 6780E 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Max 9468 2PXeon Max 9480 2P70140210280350Min: 43.57 / Avg: 43.81 / Max: 45.53Min: 43.37 / Avg: 44.69 / Max: 46.71Min: 17.21 / Avg: 51.72 / Max: 57.08Min: 17.54 / Avg: 52.79 / Max: 57.91Min: 20.77 / Avg: 74.58 / Max: 81.84Min: 31.58 / Avg: 79.4 / Max: 103.91Min: 29.32 / Avg: 92.05 / Max: 101.3Min: 47.97 / Avg: 92.78 / Max: 99.62Min: 55.04 / Avg: 100.48 / Max: 155.72Min: 32.36 / Avg: 105.22 / Max: 115.88Min: 52.85 / Avg: 106.82 / Max: 109.76Min: 104.5 / Avg: 108.03 / Max: 111.66Min: 69.08 / Avg: 120.93 / Max: 183.43Min: 80.8 / Avg: 129.58 / Max: 191.82Min: 100.96 / Avg: 183.87 / Max: 210.8Min: 40.16 / Avg: 184.09 / Max: 202.33Min: 57.57 / Avg: 217.74 / Max: 241.62Min: 75.25 / Avg: 238.94 / Max: 292.83Min: 161.45 / Avg: 241.52 / Max: 334.35Min: 66.1 / Avg: 244.1 / Max: 269.19Min: 202.91 / Avg: 287.73 / Max: 404.53Min: 208.95 / Avg: 292.75 / Max: 399.591. Xeon 6766E: Approximate power consumption of 2059 Joules per run.2. Xeon 6780E: Approximate power consumption of 1907 Joules per run.3. EPYC 8534PN: Approximate power consumption of 1948 Joules per run.4. EPYC 8534P: Approximate power consumption of 1989 Joules per run.5. EPYC 9754: Approximate power consumption of 2809 Joules per run.6. Xeon Platinum 8592+: Approximate power consumption of 2064 Joules per run.7. EPYC 9654: Approximate power consumption of 2946 Joules per run.8. Xeon Platinum 8380: Approximate power consumption of 3340 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 2914 Joules per run.10. EPYC 9684X: Approximate power consumption of 3367 Joules per run.11. Xeon 6766E 2P: Approximate power consumption of 5021 Joules per run.12. Xeon 6780E 2P: Approximate power consumption of 4645 Joules per run.13. Xeon Max 9468: Approximate power consumption of 3426 Joules per run.14. Xeon Max 9480: Approximate power consumption of 3672 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 6497 Joules per run.16. EPYC 9754 2P: Approximate power consumption of 6995 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 7040 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 6173 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 7085 Joules per run.20. EPYC 9684X 2P: Approximate power consumption of 7648 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 8152 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 8295 Joules per run.

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 512Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9684X 2PEPYC 9654 2PEPYC 9654Xeon Platinum 8490H 2PXeon Platinum 8592+Xeon Max 9480 2PXeon Platinum 8490HXeon Max 9468 2PEPYC 9754EPYC 9754 2PXeon Max 9480Xeon Platinum 8380 2PEPYC 8534PXeon Max 9468EPYC 8534PNXeon Platinum 8380Xeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P200M400M600M800M1000MSE +/- 7562646.32, N = 8SE +/- 752558.60, N = 3SE +/- 3039034.93, N = 3SE +/- 2261241.06, N = 3SE +/- 1678355.68, N = 3SE +/- 3717554.45, N = 3SE +/- 1515552.70, N = 3SE +/- 6141471.96, N = 3SE +/- 940265.92, N = 3SE +/- 4432294.36, N = 3SE +/- 673003.22, N = 3SE +/- 958772.36, N = 3SE +/- 1289603.73, N = 3SE +/- 749718.47, N = 3SE +/- 822739.33, N = 3SE +/- 1611276.24, N = 3SE +/- 2292977.20, N = 3SE +/- 147685.85, N = 3SE +/- 124677.36, N = 3SE +/- 3610015.39, N = 3SE +/- 271682.00, N = 3SE +/- 584646.14, N = 38837012508505866678493400008245833338113733337994966677837700007571766677444100007325600007096500007093933336890033336465133336338600006323966675772633335032533333985666673844066673595766673497466671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s Per Watt, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 512EPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon 6766EEPYC 9684XXeon Platinum 8592+Xeon 6780EEPYC 9754 2PXeon Platinum 8490HXeon Max 9480EPYC 9654 2PXeon Platinum 8380Xeon Max 9468EPYC 9684X 2PXeon 6766E 2PXeon 6780E 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9468 2P1.2M2.4M3.6M4.8M6M5458880.225046791.283748079.603317050.162885618.692753902.962577646.652545869.672394875.442362548.082174337.882172222.162067133.311991130.781904459.881767425.561718163.341705499.351519282.711510160.811184768.101151612.89
OpenBenchmarking.orgWatts, Fewer Is BetterLiquid-DSP 1.6CPU Power Consumption MonitorEPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EEPYC 9754Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8380EPYC 9654EPYC 9754 2PXeon Platinum 8592+EPYC 9684XXeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P130260390520650Min: 16.94 / Avg: 105.75 / Max: 120.76Min: 43.66 / Avg: 124.61 / Max: 137.3Min: 17.47 / Avg: 125.6 / Max: 142.49Min: 43.52 / Avg: 156.55 / Max: 174.71Min: 18.89 / Avg: 189.34 / Max: 213.55Min: 104.54 / Avg: 197.88 / Max: 220.13Min: 107.13 / Avg: 223.73 / Max: 248.1Min: 52.9 / Avg: 243.45 / Max: 291.14Min: 28.29 / Avg: 244.61 / Max: 277.01Min: 39.32 / Avg: 296.21 / Max: 332.18Min: 26.5 / Avg: 304.06 / Max: 370.78Min: 34.73 / Avg: 308.87 / Max: 353.22Min: 61.24 / Avg: 315.09 / Max: 375.37Min: 80.39 / Avg: 316.88 / Max: 376.81Min: 79.61 / Avg: 317.61 / Max: 374.24Min: 59.09 / Avg: 379.6 / Max: 439.61Min: 103.26 / Avg: 428.11 / Max: 542.37Min: 65.79 / Avg: 445.97 / Max: 506.44Min: 67.01 / Avg: 518.15 / Max: 711.65Min: 164.45 / Avg: 526.23 / Max: 645.98Min: 195.75 / Avg: 636.12 / Max: 707.28Min: 148.91 / Avg: 639.09 / Max: 734.491. EPYC 8534PN: Approximate power consumption of 3631 Joules per run.2. Xeon 6766E: Approximate power consumption of 4320 Joules per run.3. EPYC 8534P: Approximate power consumption of 4354 Joules per run.4. Xeon 6780E: Approximate power consumption of 5427 Joules per run.5. EPYC 9754: Approximate power consumption of 6437 Joules per run.6. Xeon 6766E 2P: Approximate power consumption of 6860 Joules per run.7. Xeon 6780E 2P: Approximate power consumption of 7756 Joules per run.8. Xeon Platinum 8380: Approximate power consumption of 8277 Joules per run.9. EPYC 9654: Approximate power consumption of 8398 Joules per run.10. EPYC 9754 2P: Approximate power consumption of 10071 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 10440 Joules per run.12. EPYC 9684X: Approximate power consumption of 10501 Joules per run.13. Xeon Platinum 8490H: Approximate power consumption of 10818 Joules per run.14. Xeon Max 9480: Approximate power consumption of 10774 Joules per run.15. Xeon Max 9468: Approximate power consumption of 10905 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 13033 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 14698 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 15163 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 17747 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 18243 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 21416 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 21942 Joules per run.

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 13 - Input: Bosphorus 4KXeon Platinum 8592+EPYC 9654EPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490HEPYC 9684X 2PEPYC 8534PEPYC 9754 2PXeon Platinum 8490H 2PEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PXeon Platinum 8380Xeon 6780EXeon Max 9480 2PXeon Max 9468 2PXeon 6780E 2PXeon 6766EXeon 6766E 2P4080120160200SE +/- 2.83, N = 15SE +/- 4.38, N = 15SE +/- 4.23, N = 15SE +/- 4.48, N = 15SE +/- 2.84, N = 15SE +/- 3.81, N = 15SE +/- 2.31, N = 15SE +/- 1.54, N = 15SE +/- 4.25, N = 15SE +/- 4.46, N = 15SE +/- 2.18, N = 15SE +/- 3.84, N = 15SE +/- 1.62, N = 15SE +/- 1.44, N = 15SE +/- 3.34, N = 15SE +/- 1.11, N = 15SE +/- 1.12, N = 7SE +/- 1.67, N = 15SE +/- 1.63, N = 15SE +/- 1.79, N = 15SE +/- 1.01, N = 8SE +/- 0.80, N = 15174.83172.88167.22163.41162.98162.48162.47161.34160.79159.75154.50153.42150.00144.70138.72133.19124.60124.26122.62116.62114.54108.291. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 13 - Input: Bosphorus 4KEPYC 8534PNEPYC 8534PEPYC 9754Xeon 6780EXeon 6766EEPYC 9654EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380EPYC 9754 2PXeon 6766E 2PXeon 6780E 2PEPYC 9654 2PXeon Max 9480Xeon Max 9468EPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P0.62391.24781.87172.49563.11952.7732.6571.9421.6911.6601.6441.3661.3341.0421.0330.9330.8240.8210.8080.8010.7730.6980.6590.6320.4860.3100.308
OpenBenchmarking.orgWatts, Fewer Is BetterSVT-AV1 2.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8380Xeon Platinum 8592+Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8490HEPYC 9754 2PXeon Max 9480Xeon Max 9468EPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P100200300400500Min: 14.1 / Avg: 55.32 / Max: 107.14Min: 16.06 / Avg: 60.52 / Max: 126.9Min: 43.57 / Avg: 69.02 / Max: 130.57Min: 43.43 / Avg: 73.7 / Max: 142.81Min: 19.23 / Avg: 84.14 / Max: 169.24Min: 25.79 / Avg: 105.15 / Max: 208.71Min: 31.67 / Avg: 118.98 / Max: 227.28Min: 49.33 / Avg: 128.89 / Max: 223.87Min: 26.49 / Avg: 131.08 / Max: 275.44Min: 104.02 / Avg: 131.43 / Max: 193.79Min: 106.17 / Avg: 142.03 / Max: 219.81Min: 59.06 / Avg: 155.98 / Max: 273.08Min: 38.31 / Avg: 171.31 / Max: 283.81Min: 69.14 / Avg: 187.17 / Max: 307.31Min: 73.18 / Avg: 187.24 / Max: 299.74Min: 56.44 / Avg: 206.94 / Max: 347.98Min: 96.21 / Avg: 219.64 / Max: 381.28Min: 60.69 / Avg: 231.16 / Max: 380.35Min: 70.69 / Avg: 247.31 / Max: 459.08Min: 160.44 / Avg: 317.58 / Max: 460.42Min: 196.97 / Avg: 398.41 / Max: 555.31Min: 193.69 / Avg: 401.02 / Max: 565.31. EPYC 8534PN: Approximate power consumption of 605 Joules per run.2. EPYC 8534P: Approximate power consumption of 658 Joules per run.3. Xeon 6766E: Approximate power consumption of 828 Joules per run.4. Xeon 6780E: Approximate power consumption of 842 Joules per run.5. EPYC 9754: Approximate power consumption of 898 Joules per run.6. EPYC 9654: Approximate power consumption of 1052 Joules per run.7. EPYC 9684X: Approximate power consumption of 1222 Joules per run.8. Xeon Platinum 8380: Approximate power consumption of 1349 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 1197 Joules per run.10. Xeon 6766E 2P: Approximate power consumption of 1682 Joules per run.11. Xeon 6780E 2P: Approximate power consumption of 1742 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 1497 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 1862 Joules per run.14. Xeon Max 9480: Approximate power consumption of 1947 Joules per run.15. Xeon Max 9468: Approximate power consumption of 1972 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 2111 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 2387 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 2450 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 2407 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 3176 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 5020 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 4946 Joules per run.

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: SlowEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon 6780E 2PXeon 6766E 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8592+EPYC 8534PNXeon Platinum 8490HXeon 6780EXeon Max 9480Xeon Platinum 8380 2PXeon 6766EXeon Max 9468Xeon Platinum 83801020304050SE +/- 0.12, N = 4SE +/- 0.21, N = 4SE +/- 0.23, N = 4SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.18, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 343.3940.9637.1329.1829.0028.0127.1124.7122.1421.6320.4619.7517.0416.0615.7715.7115.2413.8913.7913.7713.3610.93
OpenBenchmarking.orgFrames Per Second Per Watt, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: SlowEPYC 8534PNEPYC 8534PEPYC 9754Xeon 6766EXeon 6780EEPYC 9654EPYC 9754 2PEPYC 9684XXeon 6766E 2PEPYC 9654 2PXeon 6780E 2PEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Max 9480Xeon Platinum 8490H 2PXeon Platinum 8380Xeon Max 9468Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380 2P0.03310.06620.09930.13240.16550.1470.1300.1270.1170.1090.1080.0990.0920.0860.0860.0810.0800.0550.0540.0490.0450.0450.0440.0440.0380.0340.033
OpenBenchmarking.orgWatts, Fewer Is Betteruvg266 0.4.1CPU Power Consumption MonitorEPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EEPYC 9754Xeon 6766E 2PXeon Platinum 8380EPYC 9654Xeon 6780E 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Max 9468Xeon Max 9480EPYC 9684XEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2P130260390520650Min: 16.27 / Avg: 107.27 / Max: 124.79Min: 43.62 / Avg: 117.38 / Max: 135.39Min: 18.85 / Avg: 130.95 / Max: 149.92Min: 43.49 / Avg: 139.76 / Max: 158.94Min: 21.98 / Avg: 227.72 / Max: 282.74Min: 104.27 / Avg: 238.73 / Max: 273.18Min: 53.14 / Avg: 249.24 / Max: 277.94Min: 28.73 / Avg: 258.29 / Max: 311.87Min: 106.34 / Avg: 267.41 / Max: 316.34Min: 61.29 / Avg: 289.12 / Max: 322.82Min: 26.18 / Avg: 291.45 / Max: 378.34Min: 76.03 / Avg: 301.55 / Max: 333.2Min: 38.16 / Avg: 306.83 / Max: 339.09Min: 32.45 / Avg: 317.42 / Max: 382.18Min: 40.4 / Avg: 375.03 / Max: 518.77Min: 102.97 / Avg: 423.75 / Max: 489.52Min: 57.99 / Avg: 473.23 / Max: 616.87Min: 66.68 / Avg: 543.26 / Max: 734.77Min: 171.75 / Avg: 547.66 / Max: 641.35Min: 75.78 / Avg: 550.27 / Max: 756.12Min: 196.37 / Avg: 575.73 / Max: 648.93Min: 181.76 / Avg: 590.16 / Max: 673.181. EPYC 8534PN: Approximate power consumption of 4505 Joules per run.2. Xeon 6766E: Approximate power consumption of 5595 Joules per run.3. EPYC 8534P: Approximate power consumption of 5151 Joules per run.4. Xeon 6780E: Approximate power consumption of 6103 Joules per run.5. EPYC 9754: Approximate power consumption of 5693 Joules per run.6. Xeon 6766E 2P: Approximate power consumption of 7958 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 14705 Joules per run.8. EPYC 9654: Approximate power consumption of 6630 Joules per run.9. Xeon 6780E 2P: Approximate power consumption of 8557 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 12336 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 12144 Joules per run.12. Xeon Max 9468: Approximate power consumption of 14776 Joules per run.13. Xeon Max 9480: Approximate power consumption of 14421 Joules per run.14. EPYC 9684X: Approximate power consumption of 7724 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 7688 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 20340 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 8873 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 9643 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 16065 Joules per run.20. Xeon Platinum 8592+ 2P: Approximate power consumption of 14674 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 19767 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 18492 Joules per run.

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 32Xeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Platinum 8490HXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XEPYC 9684X 2PEPYC 9654 2PXeon 6780EXeon 6780E 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon 6766EXeon 6766E 2PEPYC 9754EPYC 8534PEPYC 8534PNEPYC 9754 2P9M18M27M36M45MSE +/- 417042.80, N = 5SE +/- 419600.12, N = 5SE +/- 3000.00, N = 3SE +/- 1666.67, N = 3SE +/- 1452.97, N = 3SE +/- 1527.53, N = 3SE +/- 1201.85, N = 3SE +/- 1154.70, N = 3SE +/- 7753.14, N = 3SE +/- 7023.77, N = 3SE +/- 19139.84, N = 3SE +/- 13503.09, N = 3SE +/- 1527.53, N = 3SE +/- 881.92, N = 3SE +/- 1000.00, N = 3SE +/- 577.35, N = 3SE +/- 0.00, N = 3SE +/- 881.92, N = 3SE +/- 6984.11, N = 3SE +/- 2333.33, N = 3SE +/- 881.92, N = 3SE +/- 2185.81, N = 3402440003895060036539000365376673652133336506000364976673646100036068333360660003604000036033000352590003519066731995000319920003172600031705667299073332989966729899333298933331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s Per Watt, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 32Xeon 6780EXeon 6766EEPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon Platinum 8490HEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8380Xeon 6780E 2PXeon Max 9468Xeon 6766E 2PXeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Max 9468 2PXeon Max 9480 2P200K400K600K800K1000K803665.72725751.19596676.31588721.27509090.21411972.01410323.62393460.52344631.62340868.75326342.24318611.94300148.32300054.21215045.22175115.57166453.31165061.92158420.27148995.98133630.14130400.41
OpenBenchmarking.orgWatts, Fewer Is BetterLiquid-DSP 1.6CPU Power Consumption MonitorXeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9754Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9654Xeon Platinum 8380EPYC 9684XXeon 6766E 2PXeon 6780E 2PXeon Max 9468Xeon Max 9480EPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PEPYC 9654 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Max 9468 2PXeon Max 9480 2P60120180240300Min: 43.55 / Avg: 43.71 / Max: 45.4Min: 43.37 / Avg: 43.87 / Max: 45.94Min: 16.61 / Avg: 50.11 / Max: 55.4Min: 17.38 / Avg: 50.79 / Max: 56.16Min: 20.11 / Avg: 72.89 / Max: 80.63Min: 33.18 / Avg: 79.05 / Max: 85.63Min: 61.4 / Avg: 88.61 / Max: 120.23Min: 29.58 / Avg: 91.67 / Max: 100.42Min: 51.12 / Avg: 93.86 / Max: 101.44Min: 33.02 / Avg: 104.65 / Max: 115.43Min: 103.77 / Avg: 105.63 / Max: 107.48Min: 104.44 / Avg: 107.83 / Max: 110.44Min: 72.3 / Avg: 114.68 / Max: 123.65Min: 84.78 / Avg: 121.77 / Max: 132.95Min: 37.62 / Avg: 179.59 / Max: 198.37Min: 81.91 / Avg: 181.13 / Max: 198.07Min: 96.06 / Avg: 182.69 / Max: 203.89Min: 55.79 / Avg: 218.3 / Max: 239.44Min: 163.87 / Avg: 230.15 / Max: 297.76Min: 62.85 / Avg: 241.89 / Max: 266.07Min: 199.94 / Avg: 273.12 / Max: 314.88Min: 204.92 / Avg: 280.07 / Max: 323.051. Xeon 6766E: Approximate power consumption of 1486 Joules per run.2. Xeon 6780E: Approximate power consumption of 1506 Joules per run.3. EPYC 8534PN: Approximate power consumption of 1704 Joules per run.4. EPYC 8534P: Approximate power consumption of 1744 Joules per run.5. EPYC 9754: Approximate power consumption of 2502 Joules per run.6. Xeon Platinum 8592+: Approximate power consumption of 2688 Joules per run.7. Xeon Platinum 8490H: Approximate power consumption of 3042 Joules per run.8. EPYC 9654: Approximate power consumption of 3117 Joules per run.9. Xeon Platinum 8380: Approximate power consumption of 3223 Joules per run.10. EPYC 9684X: Approximate power consumption of 3593 Joules per run.11. Xeon 6766E 2P: Approximate power consumption of 3592 Joules per run.12. Xeon 6780E 2P: Approximate power consumption of 3666 Joules per run.13. Xeon Max 9468: Approximate power consumption of 3899 Joules per run.14. Xeon Max 9480: Approximate power consumption of 4181 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 6106 Joules per run.16. Xeon Platinum 8592+ 2P: Approximate power consumption of 6195 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 6211 Joules per run.18. EPYC 9654 2P: Approximate power consumption of 7495 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 7825 Joules per run.20. EPYC 9684X 2P: Approximate power consumption of 8305 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 9286 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 9522 Joules per run.

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: GoogLeNetXeon Platinum 8490HEPYC 9654Xeon Platinum 8380 2PXeon Max 9468 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490H 2PEPYC 9684XXeon Platinum 8592+EPYC 9754Xeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8380EPYC 8534PEPYC 8534PNEPYC 9684X 2PXeon 6780EEPYC 9654 2PXeon 6766EXeon 6780E 2PEPYC 9754 2PXeon 6766E 2P80160240320400SE +/- 1.62, N = 3SE +/- 4.22, N = 3SE +/- 1.42, N = 3SE +/- 3.52, N = 5SE +/- 0.83, N = 3SE +/- 1.94, N = 3SE +/- 2.37, N = 3SE +/- 1.66, N = 3SE +/- 1.12, N = 3SE +/- 3.84, N = 4SE +/- 2.38, N = 3SE +/- 0.21, N = 3SE +/- 0.49, N = 3SE +/- 0.30, N = 3SE +/- 0.44, N = 3SE +/- 2.47, N = 3SE +/- 0.64, N = 3SE +/- 2.41, N = 3SE +/- 0.29, N = 3SE +/- 0.21, N = 3SE +/- 1.18, N = 3SE +/- 2.29, N = 3380.14354.59347.72341.51335.58333.73331.76330.26319.76314.67308.95291.37282.50276.93256.79248.03232.51227.22214.14190.80176.00168.10
OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: GoogLeNetEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon 6766EEPYC 9684XXeon Platinum 8380Xeon 6780EXeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon 6780E 2PXeon Max 9480 2PXeon 6766E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P0.51641.03281.54922.06562.5822.2952.1691.6031.5681.4111.3781.3601.2741.2611.2401.1531.1420.8530.6830.6330.6060.5650.5530.5500.5130.5030.502
OpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.16.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754Xeon Platinum 8380EPYC 9654Xeon Platinum 8592+EPYC 9684XXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P120240360480600Min: 17.15 / Avg: 111.89 / Max: 138.4Min: 19.2 / Avg: 127.66 / Max: 158.33Min: 43.67 / Avg: 157.46 / Max: 196.46Min: 43.56 / Avg: 187.52 / Max: 236.56Min: 21.15 / Avg: 196.33 / Max: 257.11Min: 52.71 / Avg: 224.1 / Max: 274.4Min: 26.86 / Avg: 226.08 / Max: 291.32Min: 33.87 / Avg: 226.63 / Max: 286.57Min: 33.26 / Avg: 259.15 / Max: 327.64Min: 60.91 / Avg: 275.93 / Max: 349.1Min: 76.86 / Avg: 291.07 / Max: 351.95Min: 77.16 / Avg: 292.25 / Max: 352.1Min: 104.39 / Avg: 305.84 / Max: 369.61Min: 105.79 / Avg: 337.98 / Max: 420.56Min: 41.18 / Avg: 350.5 / Max: 413.71Min: 98.08 / Avg: 407.6 / Max: 516.03Min: 83.13 / Avg: 426.33 / Max: 534.67Min: 60.41 / Avg: 443.22 / Max: 530.84Min: 65.57 / Avg: 493.46 / Max: 594.88Min: 157.05 / Avg: 524.23 / Max: 643.88Min: 188.75 / Avg: 558.65 / Max: 667.23Min: 207.32 / Avg: 563.45 / Max: 671.041. EPYC 8534PN: Approximate power consumption of 3991 Joules per run.2. EPYC 8534P: Approximate power consumption of 4340 Joules per run.3. Xeon 6766E: Approximate power consumption of 6666 Joules per run.4. Xeon 6780E: Approximate power consumption of 7376 Joules per run.5. EPYC 9754: Approximate power consumption of 6086 Joules per run.6. Xeon Platinum 8380: Approximate power consumption of 7395 Joules per run.7. EPYC 9654: Approximate power consumption of 6179 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 6648 Joules per run.9. EPYC 9684X: Approximate power consumption of 7515 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 7266 Joules per run.11. Xeon Max 9480: Approximate power consumption of 8247 Joules per run.12. Xeon Max 9468: Approximate power consumption of 8378 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 16006 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 15885 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 17408 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 11549 Joules per run.17. Xeon Platinum 8592+ 2P: Approximate power consumption of 13785 Joules per run.18. EPYC 9654 2P: Approximate power consumption of 17433 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 17929 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 15552 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 17318 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 16227 Joules per run.

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 57EPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+EPYC 9754EPYC 9754 2PXeon Max 9480EPYC 8534PXeon Max 9468Xeon 6780EXeon 6780E 2PEPYC 8534PNXeon Platinum 8380 2PXeon 6766EXeon 6766E 2PXeon Platinum 8380600M1200M1800M2400M3000MSE +/- 8476044.68, N = 3SE +/- 3786085.64, N = 3SE +/- 8732315.46, N = 3SE +/- 10590929.03, N = 3SE +/- 28500058.48, N = 3SE +/- 32405829.38, N = 3SE +/- 7076957.92, N = 3SE +/- 28812627.44, N = 4SE +/- 27382304.50, N = 5SE +/- 11426868.92, N = 3SE +/- 8567444.84, N = 3SE +/- 17457503.96, N = 3SE +/- 5493127.02, N = 3SE +/- 4914717.13, N = 3SE +/- 2629533.12, N = 3SE +/- 1361779.88, N = 3SE +/- 7523814.04, N = 3SE +/- 7776531.65, N = 3SE +/- 25737283.81, N = 3SE +/- 1953913.45, N = 3SE +/- 4223873.95, N = 3SE +/- 4885465.97, N = 328620000002859833333277280000027302333332655500000262006666725392000002494050000249134000024755000002444933333237476666723089666672186833333213876666720990333332036733333202633333319992666671906266667185236666714691666671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s Per Watt, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 57EPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654EPYC 9684XXeon 6766E 2PXeon 6780E 2PXeon Platinum 8490HEPYC 9754 2PXeon Platinum 8592+Xeon Max 9480EPYC 9654 2PXeon Max 9468EPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Max 9468 2PXeon Max 9480 2P4M8M12M16M20M18884627.2016817799.6914237235.0212897729.0912777153.2810813033.939250164.539063033.048820935.858050132.038048978.368044246.297252530.076982683.346748464.676245758.055987302.635119414.534994066.824681614.533917514.643870621.21
OpenBenchmarking.orgWatts, Fewer Is BetterLiquid-DSP 1.6CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8380EPYC 9654EPYC 9754 2PXeon Platinum 8592+EPYC 9684XXeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P130260390520650Min: 16.16 / Avg: 107.3 / Max: 126.15Min: 17.61 / Avg: 130.03 / Max: 147.65Min: 43.66 / Avg: 133.68 / Max: 150Min: 43.55 / Avg: 162.74 / Max: 182.74Min: 18.99 / Avg: 191.35 / Max: 215.83Min: 104.16 / Avg: 204.39 / Max: 225.35Min: 107.02 / Avg: 230.9 / Max: 255.6Min: 52.59 / Avg: 245.38 / Max: 291.79Min: 27.79 / Avg: 264.48 / Max: 300.86Min: 37.21 / Avg: 295.04 / Max: 331.11Min: 27.41 / Avg: 307.74 / Max: 373.74Min: 32.57 / Avg: 309.4 / Max: 348.95Min: 60.17 / Avg: 315.42 / Max: 375.58Min: 74.72 / Avg: 316.93 / Max: 377.16Min: 76.69 / Avg: 318.37 / Max: 376.42Min: 54.92 / Avg: 391 / Max: 447.88Min: 101.13 / Avg: 427.05 / Max: 542.12Min: 64 / Avg: 443.95 / Max: 498.34Min: 67.62 / Avg: 511.79 / Max: 675.09Min: 154.62 / Avg: 531.73 / Max: 660.07Min: 203.4 / Avg: 636.64 / Max: 709.85Min: 206.33 / Avg: 643.65 / Max: 732.461. EPYC 8534PN: Approximate power consumption of 3684 Joules per run.2. EPYC 8534P: Approximate power consumption of 4421 Joules per run.3. Xeon 6766E: Approximate power consumption of 4590 Joules per run.4. Xeon 6780E: Approximate power consumption of 5533 Joules per run.5. EPYC 9754: Approximate power consumption of 6506 Joules per run.6. Xeon 6766E 2P: Approximate power consumption of 6949 Joules per run.7. Xeon 6780E 2P: Approximate power consumption of 7851 Joules per run.8. Xeon Platinum 8380: Approximate power consumption of 8343 Joules per run.9. EPYC 9654: Approximate power consumption of 8992 Joules per run.10. EPYC 9754 2P: Approximate power consumption of 10130 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 10668 Joules per run.12. EPYC 9684X: Approximate power consumption of 10520 Joules per run.13. Xeon Platinum 8490H: Approximate power consumption of 10830 Joules per run.14. Xeon Max 9468: Approximate power consumption of 10881 Joules per run.15. Xeon Max 9480: Approximate power consumption of 10824 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 13164 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 14662 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 15094 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 17401 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 18256 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 21487 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 21755 Joules per run.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 512Xeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9754EPYC 9684XEPYC 9754 2PXeon Max 9480 2PEPYC 9654 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480EPYC 8534PXeon Max 9468Xeon 6780EXeon 6780E 2PEPYC 8534PNXeon 6766EXeon 6766E 2PXeon Platinum 8380300M600M900M1200M1500MSE +/- 4790383.89, N = 3SE +/- 3901424.24, N = 3SE +/- 814452.78, N = 3SE +/- 2412697.89, N = 3SE +/- 503322.30, N = 3SE +/- 2123152.79, N = 3SE +/- 2338327.99, N = 3SE +/- 1047748.91, N = 3SE +/- 2313246.88, N = 3SE +/- 6842108.19, N = 3SE +/- 11560043.25, N = 5SE +/- 8061118.62, N = 3SE +/- 1740596.96, N = 3SE +/- 1345523.44, N = 3SE +/- 390953.25, N = 3SE +/- 681281.47, N = 3SE +/- 287923.60, N = 3SE +/- 866544.86, N = 3SE +/- 431058.13, N = 3SE +/- 305632.31, N = 3SE +/- 1072572.19, N = 3SE +/- 912164.70, N = 3149383333313947333331369800000136873333313498000001206066667119996666711581666671152933333112646666710914600009810900009185666678822000008099166678001866677963400007779400007317566677196266677070533335392266671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s Per Watt, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 512EPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8592+EPYC 9754 2PXeon 6766EXeon 6780EEPYC 9654 2PXeon Platinum 8490HEPYC 9684X 2PXeon Max 9480Xeon 6766E 2PXeon Max 9468Xeon 6780E 2PXeon Platinum 8592+ 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P1.4M2.8M4.2M5.6M7M6364836.355867538.625183635.114367851.073778092.653740373.113727692.533673478.123117578.502957086.752929507.992805690.782800439.162621658.592528910.042466244.282443783.022212405.842021740.471966021.921899608.971702250.87
OpenBenchmarking.orgWatts, Fewer Is BetterLiquid-DSP 1.6CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon 6780EEPYC 9754EPYC 9654Xeon 6766E 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon 6780E 2PXeon Max 9468EPYC 9754 2PEPYC 9684XEPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2P130260390520650Min: 16.09 / Avg: 114.97 / Max: 130.99Min: 18.57 / Avg: 138.03 / Max: 156.97Min: 43.64 / Avg: 195.9 / Max: 223.9Min: 52.09 / Avg: 243.73 / Max: 291.23Min: 43.62 / Avg: 255.44 / Max: 293.66Min: 21.47 / Avg: 264.25 / Max: 302.73Min: 26.08 / Avg: 265.16 / Max: 303.52Min: 104.69 / Avg: 269.7 / Max: 304.35Min: 27.09 / Avg: 308.24 / Max: 376.57Min: 60 / Avg: 313.56 / Max: 376Min: 75.73 / Avg: 315.02 / Max: 376.2Min: 107.89 / Avg: 315.44 / Max: 358.75Min: 77.21 / Avg: 316.42 / Max: 377.29Min: 40.86 / Avg: 362.1 / Max: 421.05Min: 32.21 / Avg: 362.28 / Max: 409.42Min: 53.51 / Avg: 405.79 / Max: 476.68Min: 102.29 / Avg: 485.27 / Max: 581.46Min: 65.97 / Avg: 497.11 / Max: 585.32Min: 168.69 / Avg: 572.97 / Max: 696.31Min: 70.15 / Avg: 611.28 / Max: 739.63Min: 206.37 / Avg: 634.9 / Max: 748.44Min: 197.48 / Avg: 641.19 / Max: 750.611. EPYC 8534PN: Approximate power consumption of 3986 Joules per run.2. EPYC 8534P: Approximate power consumption of 4785 Joules per run.3. Xeon 6766E: Approximate power consumption of 6856 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 8368 Joules per run.5. Xeon 6780E: Approximate power consumption of 8940 Joules per run.6. EPYC 9754: Approximate power consumption of 9161 Joules per run.7. EPYC 9654: Approximate power consumption of 9104 Joules per run.8. Xeon 6766E 2P: Approximate power consumption of 9439 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 10583 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 10870 Joules per run.11. Xeon Max 9480: Approximate power consumption of 10921 Joules per run.12. Xeon 6780E 2P: Approximate power consumption of 10935 Joules per run.13. Xeon Max 9468: Approximate power consumption of 10864 Joules per run.14. EPYC 9754 2P: Approximate power consumption of 12432 Joules per run.15. EPYC 9684X: Approximate power consumption of 12318 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 13797 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 16823 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 16736 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 19863 Joules per run.20. Xeon Platinum 8592+ 2P: Approximate power consumption of 21191 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 22010 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 22057 Joules per run.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 512EPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754EPYC 9754 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PXeon Max 9468 2PXeon 6780E 2PEPYC 9654Xeon 6766E 2PXeon Platinum 8592+Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480Xeon 6780EXeon 6766EXeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 8380500M1000M1500M2000M2500MSE +/- 14870701.99, N = 3SE +/- 11753202.87, N = 3SE +/- 14465476.14, N = 3SE +/- 1300000.00, N = 3SE +/- 1650252.51, N = 3SE +/- 5630373.98, N = 3SE +/- 2676440.42, N = 3SE +/- 6728628.72, N = 3SE +/- 4238841.56, N = 3SE +/- 6411708.04, N = 3SE +/- 520683.31, N = 3SE +/- 2198737.01, N = 3SE +/- 240370.09, N = 3SE +/- 11053858.05, N = 3SE +/- 1722723.94, N = 3SE +/- 740202.67, N = 3SE +/- 409267.64, N = 3SE +/- 320537.74, N = 3SE +/- 569766.03, N = 3SE +/- 776881.23, N = 3SE +/- 170391.71, N = 3SE +/- 4629652.01, N = 32394333333212953333320270000001744700000173480000016169666671570400000151893333314440666671437100000136216666713067333331178766667106103333310208333339445500009402700008483766678385300008210133337417400005426066671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s Per Watt, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 512EPYC 8534PNEPYC 9754EPYC 8534PEPYC 9654EPYC 9754 2PEPYC 9684XEPYC 9654 2PXeon 6766EXeon Platinum 8592+EPYC 9684X 2PXeon 6780EXeon Platinum 8592+ 2PXeon Platinum 8490HXeon 6766E 2PXeon Max 9480Xeon 6780E 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380Xeon Platinum 8380 2P1.4M2.8M4.2M5.6M7M6532499.056413920.525998206.244853033.944657018.094387111.544001237.143974344.333805850.463603186.163349035.563272343.493267678.463182607.792982249.172808259.472666847.492571656.772388645.742269719.802257184.322190947.55
OpenBenchmarking.orgWatts, Fewer Is BetterLiquid-DSP 1.6CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380EPYC 9754EPYC 9654Xeon 6780EXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9684XEPYC 9754 2PXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2P140280420560700Min: 17.93 / Avg: 113.55 / Max: 130.59Min: 17.86 / Avg: 136.88 / Max: 157.55Min: 43.63 / Avg: 213.46 / Max: 250.49Min: 53.55 / Avg: 240.39 / Max: 291.06Min: 20.69 / Avg: 272.02 / Max: 314.58Min: 29.69 / Avg: 280.68 / Max: 320.8Min: 43.73 / Avg: 280.76 / Max: 332.63Min: 25.3 / Avg: 309.72 / Max: 376.79Min: 60.01 / Avg: 312.4 / Max: 376.93Min: 74.44 / Avg: 314.43 / Max: 376.72Min: 77.34 / Avg: 316.72 / Max: 376.86Min: 35.59 / Avg: 357.96 / Max: 411.45Min: 40.06 / Avg: 372.51 / Max: 431.46Min: 108.01 / Avg: 410.59 / Max: 495.66Min: 104.84 / Avg: 484.28 / Max: 583.22Min: 109.82 / Avg: 511.74 / Max: 621.27Min: 53.43 / Avg: 532.22 / Max: 613.02Min: 70.53 / Avg: 619.43 / Max: 752.7Min: 157.59 / Avg: 628.76 / Max: 754.2Min: 198.99 / Avg: 635.9 / Max: 752.9Min: 210.59 / Avg: 636.23 / Max: 755.25Min: 67.21 / Avg: 664.5 / Max: 779.271. EPYC 8534PN: Approximate power consumption of 4012 Joules per run.2. EPYC 8534P: Approximate power consumption of 4791 Joules per run.3. Xeon 6766E: Approximate power consumption of 7756 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 8494 Joules per run.5. EPYC 9754: Approximate power consumption of 9521 Joules per run.6. EPYC 9654: Approximate power consumption of 9824 Joules per run.7. Xeon 6780E: Approximate power consumption of 10201 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 10737 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 10934 Joules per run.10. Xeon Max 9468: Approximate power consumption of 11005 Joules per run.11. Xeon Max 9480: Approximate power consumption of 10980 Joules per run.12. EPYC 9684X: Approximate power consumption of 12529 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 13038 Joules per run.14. Xeon 6766E 2P: Approximate power consumption of 15055 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 16950 Joules per run.16. Xeon 6780E 2P: Approximate power consumption of 18423 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 18095 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 21474 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 22007 Joules per run.20. Xeon Max 9480 2P: Approximate power consumption of 21832 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 22056 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 23258 Joules per run.

John The Ripper

This is a benchmark of John The Ripper, which is a password cracker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: bcryptEPYC 9754 2PXeon 6780E 2PEPYC 9684X 2PXeon 6766E 2PEPYC 9654 2PEPYC 9754Xeon 6780EXeon Platinum 8592+ 2PEPYC 9684XXeon 6766EXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon Platinum 838090K180K270K360K450KSE +/- 4958.68, N = 4SE +/- 2096.39, N = 3SE +/- 1315.55, N = 3SE +/- 801.76, N = 3SE +/- 710.46, N = 3SE +/- 1.33, N = 3SE +/- 87.49, N = 3SE +/- 288.38, N = 3SE +/- 154.46, N = 3SE +/- 32.84, N = 3SE +/- 292.24, N = 3SE +/- 20.00, N = 3SE +/- 576.80, N = 3SE +/- 866.68, N = 3SE +/- 12.67, N = 3SE +/- 46.28, N = 3SE +/- 22.28, N = 3SE +/- 10.67, N = 3SE +/- 0.00, N = 3SE +/- 8.67, N = 3SE +/- 8.84, N = 3SE +/- 6.33, N = 341272340227537626836313332052722018821131120677819289819005818360316654115595913386611321910578110222294551934727914467875569391. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
OpenBenchmarking.orgReal C/S Per Watt, More Is BetterJohn The Ripper 2023.03.14Test: bcryptEPYC 8534PNXeon 6766EXeon 6766E 2PEPYC 9754EPYC 8534PXeon 6780EXeon 6780E 2PEPYC 9754 2PEPYC 9654EPYC 9654 2PEPYC 9684XEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9480 2PXeon Max 9468Xeon Max 9468 2PXeon Platinum 8380Xeon Platinum 8380 2P2004006008001000920.41885.93816.03759.60749.17746.76712.79705.60606.47573.89531.63523.96342.68334.53305.82292.69273.70256.68256.35241.56233.71231.51

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 57EPYC 9684X 2PEPYC 9684XEPYC 9754EPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9654Xeon 6780EXeon 6780E 2PXeon Max 9480 2PXeon 6766EXeon Platinum 8490H 2PXeon 6766E 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PXeon Max 9480Xeon Platinum 8380 2PEPYC 8534PNXeon Max 9468Xeon Platinum 83801000M2000M3000M4000M5000MSE +/- 11892621.43, N = 3SE +/- 6778479.02, N = 3SE +/- 18691531.06, N = 3SE +/- 14606429.33, N = 3SE +/- 51282832.98, N = 4SE +/- 4098915.85, N = 3SE +/- 20120967.50, N = 3SE +/- 1909915.65, N = 3SE +/- 13354940.83, N = 3SE +/- 14772609.79, N = 3SE +/- 6887912.12, N = 3SE +/- 13655808.69, N = 3SE +/- 2709448.49, N = 3SE +/- 25888414.40, N = 3SE +/- 5260228.13, N = 3SE +/- 3116800.35, N = 3SE +/- 3527510.93, N = 3SE +/- 3119294.79, N = 3SE +/- 11686221.71, N = 3SE +/- 6398003.16, N = 3SE +/- 2030052.00, N = 3SE +/- 1549551.91, N = 347593666674755333333471450000046265666674450525000428093333342563000004136766667406866666738965000003736300000372366666737121333333596400000350320000031812666672982800000297240000026890333332687066667267003333315546666671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s Per Watt, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 57EPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EEPYC 9654Xeon 6766E 2PEPYC 9684XXeon 6780E 2PEPYC 9754 2PXeon Platinum 8592+EPYC 9654 2PXeon Platinum 8490HEPYC 9684X 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Platinum 8380Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380 2P5M10M15M20M25M22733164.5220620501.3817916149.9116705633.0115275772.4014722432.5713110978.9913085490.5312284401.9212234041.5111273487.1110089896.4110089438.819563226.729312055.828437038.997209189.046447021.006364402.846058163.975639264.935516263.53
OpenBenchmarking.orgWatts, Fewer Is BetterLiquid-DSP 1.6CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon 6780EEPYC 9754Xeon 6766E 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon 6780E 2PEPYC 9684XEPYC 9754 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2P130260390520650Min: 17.47 / Avg: 118.2 / Max: 136.58Min: 17.85 / Avg: 144.65 / Max: 162.72Min: 43.75 / Avg: 208.54 / Max: 241.22Min: 51.05 / Avg: 244.28 / Max: 290.35Min: 43.58 / Avg: 270.81 / Max: 310.28Min: 21.64 / Avg: 282.21 / Max: 320.93Min: 104.64 / Avg: 283.13 / Max: 314.71Min: 29.04 / Avg: 289.1 / Max: 326.36Min: 24.5 / Avg: 310.75 / Max: 376.14Min: 32.16 / Avg: 315.31 / Max: 376.7Min: 75.83 / Avg: 316.47 / Max: 376.18Min: 79.18 / Avg: 319.2 / Max: 376.38Min: 107.77 / Avg: 331.21 / Max: 370.24Min: 35.08 / Avg: 363.41 / Max: 409.45Min: 40.47 / Avg: 378.17 / Max: 438.15Min: 57.66 / Avg: 424.28 / Max: 495.38Min: 101.61 / Avg: 487.47 / Max: 581.03Min: 60.6 / Avg: 497.67 / Max: 581.47Min: 158.24 / Avg: 577.58 / Max: 700.7Min: 69.61 / Avg: 617.34 / Max: 730.41Min: 204.5 / Avg: 637.74 / Max: 753.77Min: 195.26 / Avg: 643.18 / Max: 753.461. EPYC 8534PN: Approximate power consumption of 4058 Joules per run.2. EPYC 8534P: Approximate power consumption of 4918 Joules per run.3. Xeon 6766E: Approximate power consumption of 7160 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 8387 Joules per run.5. Xeon 6780E: Approximate power consumption of 9298 Joules per run.6. EPYC 9754: Approximate power consumption of 9501 Joules per run.7. Xeon 6766E 2P: Approximate power consumption of 9626 Joules per run.8. EPYC 9654: Approximate power consumption of 9830 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 10669 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 10826 Joules per run.11. Xeon Max 9468: Approximate power consumption of 10760 Joules per run.12. Xeon Max 9480: Approximate power consumption of 10853 Joules per run.13. Xeon 6780E 2P: Approximate power consumption of 11371 Joules per run.14. EPYC 9684X: Approximate power consumption of 12235 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 12858 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 14425 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 16737 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 16921 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 20023 Joules per run.20. Xeon Platinum 8592+ 2P: Approximate power consumption of 20990 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 22108 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 21868 Joules per run.

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 4 - Input: Bosphorus 4KEPYC 9684XEPYC 9684X 2PEPYC 9654EPYC 9654 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9754EPYC 9754 2PXeon Platinum 8490HEPYC 8534PEPYC 8534PNXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P246810SE +/- 0.021, N = 3SE +/- 0.040, N = 3SE +/- 0.019, N = 3SE +/- 0.046, N = 3SE +/- 0.005, N = 3SE +/- 0.044, N = 3SE +/- 0.024, N = 3SE +/- 0.004, N = 3SE +/- 0.030, N = 3SE +/- 0.007, N = 3SE +/- 0.015, N = 3SE +/- 0.049, N = 3SE +/- 0.047, N = 3SE +/- 0.027, N = 3SE +/- 0.042, N = 3SE +/- 0.015, N = 3SE +/- 0.014, N = 3SE +/- 0.014, N = 3SE +/- 0.003, N = 3SE +/- 0.041, N = 3SE +/- 0.002, N = 3SE +/- 0.023, N = 38.5958.5138.4228.3497.8767.3607.2837.1537.0616.9396.7276.6986.5726.4906.0525.9915.4385.4374.3504.0403.9723.7101. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 4 - Input: Bosphorus 4KEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon 6766EXeon 6780EEPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HEPYC 9754 2PEPYC 9654 2PXeon Platinum 8380EPYC 9684X 2PXeon 6780E 2PXeon 6766E 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P0.02050.0410.06150.0820.10250.0910.0840.0670.0600.0560.0550.0540.0400.0340.0330.0320.0310.0290.0280.0270.0270.0270.0220.0210.0180.0130.013
OpenBenchmarking.orgWatts, Fewer Is BetterSVT-AV1 2.0CPU Power Consumption MonitorXeon 6766EEPYC 8534PNXeon 6780EEPYC 8534PEPYC 9754Xeon 6766E 2PEPYC 9654Xeon 6780E 2PEPYC 9684XXeon Platinum 8380Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9754 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P110220330440550Min: 43.55 / Avg: 71.01 / Max: 131.44Min: 15.18 / Avg: 74.03 / Max: 115.16Min: 43.43 / Avg: 78.63 / Max: 157.97Min: 16.63 / Avg: 82.61 / Max: 136.8Min: 20.56 / Avg: 108.62 / Max: 213.33Min: 104.17 / Avg: 135.78 / Max: 199.44Min: 26.67 / Avg: 140.24 / Max: 261.59Min: 105.45 / Avg: 146.79 / Max: 227.06Min: 33.04 / Avg: 159.73 / Max: 314.08Min: 52.81 / Avg: 173.53 / Max: 276.87Min: 34.17 / Avg: 196.16 / Max: 355Min: 59.43 / Avg: 204.79 / Max: 319.21Min: 40.1 / Avg: 214.15 / Max: 316.2Min: 73.83 / Avg: 242.37 / Max: 350.93Min: 73.14 / Avg: 245.81 / Max: 351.66Min: 97.29 / Avg: 264.19 / Max: 369.25Min: 57.39 / Avg: 264.94 / Max: 394.93Min: 64.63 / Avg: 294.39 / Max: 468.18Min: 78.08 / Avg: 333.26 / Max: 452.51Min: 168.49 / Avg: 378.27 / Max: 506.21Min: 209.94 / Avg: 456.54 / Max: 621.56Min: 198.73 / Avg: 457.13 / Max: 618.951. Xeon 6766E: Approximate power consumption of 3456 Joules per run.2. EPYC 8534PN: Approximate power consumption of 2418 Joules per run.3. Xeon 6780E: Approximate power consumption of 3539 Joules per run.4. EPYC 8534P: Approximate power consumption of 2616 Joules per run.5. EPYC 9754: Approximate power consumption of 3331 Joules per run.6. Xeon 6766E 2P: Approximate power consumption of 7151 Joules per run.7. EPYC 9654: Approximate power consumption of 3787 Joules per run.8. Xeon 6780E 2P: Approximate power consumption of 7144 Joules per run.9. EPYC 9684X: Approximate power consumption of 4260 Joules per run.10. Xeon Platinum 8380: Approximate power consumption of 6363 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 5362 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 6144 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 6639 Joules per run.14. Xeon Max 9468: Approximate power consumption of 7837 Joules per run.15. Xeon Max 9480: Approximate power consumption of 7866 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 9863 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 7153 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 7949 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 9998 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 12105 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 16587 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 16457 Joules per run.

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon 6780E 2PEPYC 9754EPYC 9684XXeon Platinum 8490H 2PXeon 6766E 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8380 2PXeon 6780EXeon Platinum 8490HXeon 6766EXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 838050100150200250SE +/- 1.72, N = 15SE +/- 3.26, N = 12SE +/- 1.58, N = 15SE +/- 0.29, N = 4SE +/- 0.09, N = 3SE +/- 0.07, N = 4SE +/- 0.11, N = 4SE +/- 0.22, N = 4SE +/- 0.22, N = 3SE +/- 0.02, N = 4SE +/- 0.89, N = 15SE +/- 0.76, N = 3SE +/- 0.35, N = 3SE +/- 0.10, N = 3SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3210.44200.16175.60173.22136.22133.93133.48132.28125.11113.28112.72104.8497.1984.8083.7379.3876.5371.8364.9664.3363.3447.64
OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjEPYC 9754EPYC 9754 2PXeon 6766EXeon 6780EEPYC 9684XEPYC 8534PNEPYC 9654Xeon 6780E 2PEPYC 8534PXeon 6766E 2PEPYC 9684X 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480Xeon Platinum 8380 2PXeon Max 9468Xeon Platinum 8380Xeon Max 9480 2PXeon Max 9468 2P0.22010.44020.66030.88041.10050.9780.7590.7460.7190.7160.7130.6930.6430.6420.6350.6020.5790.5750.5230.3680.3200.2910.2720.2630.2610.2400.222
OpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8380Xeon Platinum 8592+EPYC 9684XXeon 6766E 2PXeon 6780E 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P140280420560700Min: 17.83 / Avg: 88.8 / Max: 143.53Min: 17.71 / Avg: 100.16 / Max: 169.93Min: 43.56 / Avg: 102.53 / Max: 218.97Min: 43.49 / Avg: 116.43 / Max: 260.73Min: 19.95 / Avg: 136.96 / Max: 327.05Min: 28.7 / Avg: 163.54 / Max: 333.81Min: 54.43 / Avg: 182.65 / Max: 290.73Min: 26.36 / Avg: 185.86 / Max: 375.76Min: 32.74 / Avg: 186.36 / Max: 410.63Min: 104.6 / Avg: 197.13 / Max: 492.74Min: 106.69 / Avg: 211.77 / Max: 566.07Min: 61.45 / Avg: 215.69 / Max: 377.02Min: 86.41 / Avg: 246.7 / Max: 376.83Min: 73.93 / Avg: 247.01 / Max: 377.15Min: 36.73 / Avg: 263.84 / Max: 656.51Min: 66.3 / Avg: 299.17 / Max: 755.1Min: 56.83 / Avg: 305.41 / Max: 649.39Min: 101.28 / Avg: 312.13 / Max: 580.75Min: 65.49 / Avg: 349.82 / Max: 819.75Min: 164.62 / Avg: 413.97 / Max: 758.06Min: 187.33 / Avg: 469.55 / Max: 757.04Min: 193.13 / Avg: 472.12 / Max: 755.041. EPYC 8534PN: Approximate power consumption of 2368 Joules per run.2. EPYC 8534P: Approximate power consumption of 2637 Joules per run.3. Xeon 6766E: Approximate power consumption of 3007 Joules per run.4. Xeon 6780E: Approximate power consumption of 3144 Joules per run.5. EPYC 9754: Approximate power consumption of 2808 Joules per run.6. EPYC 9654: Approximate power consumption of 3271 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 5601 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 3965 Joules per run.9. EPYC 9684X: Approximate power consumption of 3494 Joules per run.10. Xeon 6766E 2P: Approximate power consumption of 5191 Joules per run.11. Xeon 6780E 2P: Approximate power consumption of 5082 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 5248 Joules per run.13. Xeon Max 9480: Approximate power consumption of 6168 Joules per run.14. Xeon Max 9468: Approximate power consumption of 6422 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 5101 Joules per run.16. Xeon Platinum 8592+ 2P: Approximate power consumption of 5460 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 5457 Joules per run.18. Xeon Platinum 8380 2P: Approximate power consumption of 7491 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 6040 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 8693 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 10080 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 10387 Joules per run.

John The Ripper

This is a benchmark of John The Ripper, which is a password cracker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: BlowfishEPYC 9754 2PXeon 6780E 2PEPYC 9684X 2PXeon 6766E 2PEPYC 9654 2PEPYC 9754Xeon 6780EXeon Platinum 8592+ 2PEPYC 9684XXeon 6766EXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon Platinum 838090K180K270K360K450KSE +/- 2397.15, N = 3SE +/- 482.17, N = 3SE +/- 454.86, N = 3SE +/- 353.58, N = 3SE +/- 3455.48, N = 3SE +/- 1.33, N = 3SE +/- 14.67, N = 3SE +/- 649.08, N = 3SE +/- 98.33, N = 3SE +/- 174.44, N = 3SE +/- 348.45, N = 3SE +/- 38.33, N = 3SE +/- 169.28, N = 3SE +/- 116.69, N = 3SE +/- 14.62, N = 3SE +/- 79.75, N = 3SE +/- 13.72, N = 3SE +/- 11.39, N = 3SE +/- 20.54, N = 3SE +/- 8.67, N = 3SE +/- 17.33, N = 3SE +/- 6.33, N = 341541240473937458936330031649222018821144920549919257419020918358316654115665813456211322310583110219894513934737915267893569391. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
OpenBenchmarking.orgReal C/S Per Watt, More Is BetterJohn The Ripper 2023.03.14Test: BlowfishXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 9754EPYC 8534PXeon 6780EXeon 6780E 2PEPYC 9754 2PEPYC 9654EPYC 9654 2PEPYC 9684XEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9480 2PXeon Max 9468Xeon Max 9468 2PXeon Platinum 8380Xeon Platinum 8380 2P2004006008001000885.52818.19805.43757.83753.26747.26720.56711.80605.49568.71531.08527.64339.84332.35305.95291.56274.74258.82257.14243.04233.58231.64
OpenBenchmarking.orgWatts, Fewer Is BetterJohn The Ripper 2023.03.14CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon Max 9468EPYC 9654Xeon 6780EXeon Max 9480EPYC 9754Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9684XXeon 6766E 2PXeon 6766E 2P FullXeon Platinum 8380 2PXeon Max 9468 2PEPYC 9654 2PXeon 6780E 2PEPYC 9754 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684X 2P140280420560700Min: 15.84 / Avg: 101.56 / Max: 134.16Min: 18.33 / Avg: 135.67 / Max: 154.48Min: 43.68 / Avg: 214.53 / Max: 240.46Min: 52.63 / Avg: 243.63 / Max: 290.65Min: 70.16 / Avg: 264.03 / Max: 291.4Min: 28.03 / Avg: 274.61 / Max: 310.69Min: 43.52 / Avg: 282.96 / Max: 321.53Min: 71.44 / Avg: 288.1 / Max: 318.09Min: 22.46 / Avg: 289.87 / Max: 333.39Min: 23.7 / Avg: 308.68 / Max: 376.19Min: 54.97 / Avg: 308.91 / Max: 345.11Min: 32.66 / Avg: 362.61 / Max: 410.64Min: 108.45 / Avg: 444.03 / Max: 499.02Min: 107.82 / Avg: 445 / Max: 497.2Min: 99.96 / Avg: 488.8 / Max: 580.11Min: 183.06 / Avg: 553.66 / Max: 618.19Min: 54.52 / Avg: 556.51 / Max: 637.38Min: 109.84 / Avg: 561.7 / Max: 638.73Min: 42.7 / Avg: 583.61 / Max: 678.24Min: 186.19 / Avg: 605.28 / Max: 739.27Min: 71.27 / Avg: 618.12 / Max: 752.32Min: 168.16 / Avg: 627.31 / Max: 720.15Min: 67.44 / Avg: 709.94 / Max: 820.991. EPYC 8534PN: Approximate power consumption of 4130 Joules per run.2. EPYC 8534P: Approximate power consumption of 4658 Joules per run.3. Xeon 6766E: Approximate power consumption of 7365 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 8283 Joules per run.5. Xeon Max 9468: Approximate power consumption of 8977 Joules per run.6. EPYC 9654: Approximate power consumption of 9428 Joules per run.7. Xeon 6780E: Approximate power consumption of 9715 Joules per run.8. Xeon Max 9480: Approximate power consumption of 9892 Joules per run.9. EPYC 9754: Approximate power consumption of 9952 Joules per run.10. Xeon Platinum 8592+: Approximate power consumption of 10701 Joules per run.11. Xeon Platinum 8490H: Approximate power consumption of 10606 Joules per run.12. EPYC 9684X: Approximate power consumption of 12329 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 15245 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 16619 Joules per run.15. Xeon Max 9468 2P: Approximate power consumption of 19009 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 19107 Joules per run.17. Xeon 6780E 2P: Approximate power consumption of 19472 Joules per run.18. EPYC 9754 2P: Approximate power consumption of 20037 Joules per run.19. Xeon Max 9480 2P: Approximate power consumption of 20983 Joules per run.20. Xeon Platinum 8592+ 2P: Approximate power consumption of 21634 Joules per run.21. Xeon Platinum 8490H 2P: Approximate power consumption of 22165 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 24138 Joules per run.

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 57EPYC 9684X 2PXeon 6780E 2PEPYC 9654 2PXeon 6766E 2PEPYC 9754EPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon 6780EXeon 6766EXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 8534PXeon Platinum 8380 2PXeon Max 9468EPYC 8534PNXeon Platinum 83802000M4000M6000M8000M10000MSE +/- 50144890.07, N = 3SE +/- 30821331.00, N = 3SE +/- 60380193.59, N = 3SE +/- 28436830.58, N = 3SE +/- 12739745.33, N = 3SE +/- 8069352.17, N = 3SE +/- 61971606.40, N = 3SE +/- 8144527.82, N = 3SE +/- 2331189.49, N = 3SE +/- 2618735.91, N = 3SE +/- 28453880.81, N = 3SE +/- 17558125.69, N = 3SE +/- 6906036.01, N = 3SE +/- 8015887.00, N = 3SE +/- 3555434.03, N = 3SE +/- 5292237.50, N = 3SE +/- 1976810.00, N = 3SE +/- 1959875.28, N = 3SE +/- 3572580.77, N = 3SE +/- 4088330.28, N = 3SE +/- 4481443.22, N = 3SE +/- 2935605.18, N = 380127000007597566667741186666768009000006401366667631626666762843000005811900000536126666752664666675036000000482513333347147000004259433333380683333335008333333222533333311693333330371000002848933333279370000016104666671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s Per Watt, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 57EPYC 8534PNEPYC 9754EPYC 8534PXeon 6766EEPYC 9654EPYC 9754 2PEPYC 9684XXeon 6780EXeon 6766E 2PXeon 6780E 2PEPYC 9654 2PXeon Platinum 8592+EPYC 9684X 2PXeon Platinum 8490HXeon Max 9480Xeon Platinum 8592+ 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380Xeon Platinum 8380 2P5M10M15M20M25M23457026.7322424548.8221345877.0218991058.6717475938.7716347865.8716030850.5615942975.3115666459.9413780225.2912864302.7012268330.0811934150.9211085612.9310156047.2810144378.398954185.908419315.637871904.977597124.436601048.416213581.60
OpenBenchmarking.orgWatts, Fewer Is BetterLiquid-DSP 1.6CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380EPYC 9754Xeon 6780EEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9684XEPYC 9754 2PXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9684X 2P140280420560700Min: 18.06 / Avg: 119.1 / Max: 135.86Min: 17.88 / Avg: 146.02 / Max: 166.38Min: 43.61 / Avg: 224.29 / Max: 267.77Min: 52.71 / Avg: 243.97 / Max: 290.99Min: 22.44 / Avg: 285.46 / Max: 328.97Min: 43.65 / Avg: 295.72 / Max: 355.96Min: 30.72 / Avg: 301.36 / Max: 345.8Min: 24.86 / Avg: 310.3 / Max: 377.83Min: 58.98 / Avg: 315.8 / Max: 377.13Min: 75.49 / Avg: 317.3 / Max: 376.02Min: 75.93 / Avg: 318.17 / Max: 376.27Min: 35.02 / Avg: 362.54 / Max: 411.45Min: 40.8 / Avg: 386.37 / Max: 445.76Min: 106.08 / Avg: 434.11 / Max: 495.15Min: 101.61 / Avg: 488.78 / Max: 580.58Min: 108.43 / Avg: 551.34 / Max: 625.76Min: 54.92 / Avg: 576.16 / Max: 661.98Min: 68.73 / Avg: 619.49 / Max: 754.72Min: 195.33 / Avg: 635.13 / Max: 752.27Min: 155.13 / Avg: 636.78 / Max: 752.99Min: 193.94 / Avg: 639.74 / Max: 752.86Min: 62.88 / Avg: 671.41 / Max: 791.351. EPYC 8534PN: Approximate power consumption of 4089 Joules per run.2. EPYC 8534P: Approximate power consumption of 4965 Joules per run.3. Xeon 6766E: Approximate power consumption of 7775 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 8458 Joules per run.5. EPYC 9754: Approximate power consumption of 9706 Joules per run.6. Xeon 6780E: Approximate power consumption of 10153 Joules per run.7. EPYC 9654: Approximate power consumption of 10246 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 10757 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 10842 Joules per run.10. Xeon Max 9480: Approximate power consumption of 11000 Joules per run.11. Xeon Max 9468: Approximate power consumption of 10924 Joules per run.12. EPYC 9684X: Approximate power consumption of 12327 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 13008 Joules per run.14. Xeon 6766E 2P: Approximate power consumption of 14904 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 16619 Joules per run.16. Xeon 6780E 2P: Approximate power consumption of 18929 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 19781 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 21476 Joules per run.19. Xeon Max 9468 2P: Approximate power consumption of 21594 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 21651 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 21965 Joules per run.22. EPYC 9684X 2P: Approximate power consumption of 22604 Joules per run.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 32EPYC 9684X 2PXeon 6780E 2PEPYC 9654 2PXeon 6766E 2PEPYC 9754EPYC 9754 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon 6780EXeon Max 9468 2PXeon 6766EXeon Platinum 8380 2PXeon Platinum 8490HXeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon Platinum 83802000M4000M6000M8000M10000MSE +/- 34610274.65, N = 3SE +/- 20501246.57, N = 3SE +/- 46730658.51, N = 3SE +/- 32054242.22, N = 3SE +/- 3768731.00, N = 3SE +/- 2936551.27, N = 3SE +/- 10496401.50, N = 3SE +/- 6711433.03, N = 3SE +/- 11426625.83, N = 3SE +/- 895048.11, N = 3SE +/- 1419311.26, N = 3SE +/- 2601495.30, N = 3SE +/- 2447674.63, N = 3SE +/- 821245.67, N = 3SE +/- 7369833.41, N = 3SE +/- 4021608.30, N = 3SE +/- 2516611.48, N = 3SE +/- 1501110.70, N = 3SE +/- 1928730.15, N = 3SE +/- 1338323.99, N = 3SE +/- 1320353.49, N = 3SE +/- 1266666.67, N = 379352666677546366667751333333368215333336588200000643900000061165666676077300000586246666753670333335271933333479913333346709666674301166667357223333332438000003167200000306220000027896000002769066667238180000018235666671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s Per Watt, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 32EPYC 8534PNEPYC 9754EPYC 8534PXeon 6766EXeon 6780EEPYC 9654Xeon 6766E 2PEPYC 9754 2PEPYC 9684XXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9468 2P5M10M15M20M25M23304528.1522727990.0921992105.6021409914.8418436155.3817844515.2117638157.2316713460.6716171511.9115839180.0713431732.6912478169.6710249944.7010180344.319752693.419661394.059061082.038576477.668335236.327475059.617299110.007263532.04
OpenBenchmarking.orgWatts, Fewer Is BetterLiquid-DSP 1.6CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon Platinum 8380Xeon 6780EXeon Max 9468EPYC 9754EPYC 9654Xeon Max 9480Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9684XEPYC 9754 2PXeon 6766E 2PXeon 6780E 2PXeon Platinum 8380 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Max 9468 2PXeon Max 9480 2P130260390520650Min: 16.68 / Avg: 119.7 / Max: 139.58Min: 18.82 / Avg: 139.24 / Max: 159.66Min: 43.68 / Avg: 200.9 / Max: 230.57Min: 52.43 / Avg: 243.95 / Max: 291.4Min: 43.63 / Avg: 260.31 / Max: 300.33Min: 74.86 / Avg: 277.71 / Max: 312.01Min: 21.58 / Avg: 289.87 / Max: 330.19Min: 30.54 / Avg: 295.44 / Max: 336.72Min: 78.49 / Avg: 305.6 / Max: 341.63Min: 25.92 / Avg: 311.11 / Max: 357.53Min: 59.61 / Avg: 316.47 / Max: 377.01Min: 34.34 / Avg: 362.52 / Max: 411.45Min: 40.61 / Avg: 385.26 / Max: 440.96Min: 104.79 / Avg: 386.75 / Max: 438.06Min: 107.72 / Avg: 476.44 / Max: 538.02Min: 101.34 / Avg: 489.41 / Max: 581.58Min: 59.09 / Avg: 559.37 / Max: 644.46Min: 70.49 / Avg: 623.14 / Max: 733.57Min: 160.12 / Avg: 633.09 / Max: 754.38Min: 65.54 / Avg: 635.93 / Max: 742.68Min: 186.6 / Avg: 643.07 / Max: 754.55Min: 204.52 / Avg: 643.9 / Max: 752.561. EPYC 8534PN: Approximate power consumption of 4070 Joules per run.2. EPYC 8534P: Approximate power consumption of 4781 Joules per run.3. Xeon 6766E: Approximate power consumption of 6897 Joules per run.4. Xeon Platinum 8380: Approximate power consumption of 8457 Joules per run.5. Xeon 6780E: Approximate power consumption of 9024 Joules per run.6. Xeon Max 9468: Approximate power consumption of 9627 Joules per run.7. EPYC 9754: Approximate power consumption of 9952 Joules per run.8. EPYC 9654: Approximate power consumption of 10143 Joules per run.9. Xeon Max 9480: Approximate power consumption of 10492 Joules per run.10. Xeon Platinum 8592+: Approximate power consumption of 10681 Joules per run.11. Xeon Platinum 8490H: Approximate power consumption of 10760 Joules per run.12. EPYC 9684X: Approximate power consumption of 12446 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 13099 Joules per run.14. Xeon 6766E 2P: Approximate power consumption of 13278 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 16358 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 16803 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 19019 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 21394 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 21736 Joules per run.20. EPYC 9684X 2P: Approximate power consumption of 21834 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 21864 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 21892 Joules per run.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 32EPYC 9684X 2PEPYC 9684XXeon 6780EEPYC 9654 2PEPYC 9654Xeon 6780E 2PEPYC 9754 2PEPYC 9754Xeon 6766EXeon 6766E 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8592+EPYC 8534PXeon Platinum 8380 2PEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon Platinum 8380900M1800M2700M3600M4500MSE +/- 4250882.26, N = 3SE +/- 841295.30, N = 3SE +/- 2023198.79, N = 3SE +/- 3186603.90, N = 3SE +/- 2714365.08, N = 3SE +/- 517472.49, N = 3SE +/- 384418.75, N = 3SE +/- 4056818.68, N = 3SE +/- 920748.49, N = 3SE +/- 3194265.70, N = 3SE +/- 26633124.74, N = 3SE +/- 13813198.20, N = 3SE +/- 2403700.85, N = 3SE +/- 4598671.31, N = 3SE +/- 1858314.65, N = 3SE +/- 2236316.42, N = 3SE +/- 3138116.92, N = 3SE +/- 3557152.42, N = 3SE +/- 2003607.86, N = 3SE +/- 1342054.81, N = 3SE +/- 400000.00, N = 3SE +/- 3178574.10, N = 344079000004353533333410220000040633333334032733333402103333337941333333791566667367196666736079000003558600000352076666733370666673254033333320060000031482333333047066667304470000027679333332739633333235190000017974000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s Per Watt, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 32EPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon 6766E 2PXeon 6780E 2PEPYC 9684XEPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 9654 2PXeon Max 9480EPYC 9684X 2PXeon Max 9468Xeon Platinum 8380Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9468 2P5M10M15M20M25M23574098.6021706213.4620349128.5817724724.8815541749.2414392112.2014282136.0513659351.7411993608.9610891038.6310144782.5810135010.799803609.248871933.768852490.978304651.147357841.696918246.026353287.786260399.405205818.865098423.00
OpenBenchmarking.orgWatts, Fewer Is BetterLiquid-DSP 1.6CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754Xeon Platinum 8380Xeon 6766E 2PEPYC 9654Xeon Max 9468Xeon 6780E 2PXeon Max 9480Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9754 2PEPYC 9684XEPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2P130260390520650Min: 16.54 / Avg: 117.41 / Max: 138.28Min: 16.53 / Avg: 140.38 / Max: 157.26Min: 43.66 / Avg: 180.45 / Max: 204.69Min: 43.44 / Avg: 231.44 / Max: 260.99Min: 21.67 / Avg: 243.96 / Max: 276.65Min: 52.85 / Avg: 244.28 / Max: 291.62Min: 104.22 / Avg: 252.62 / Max: 279.84Min: 28.95 / Avg: 280.2 / Max: 318.02Min: 74.4 / Avg: 283.2 / Max: 376.87Min: 107.24 / Avg: 294.38 / Max: 328.07Min: 80.13 / Avg: 308.8 / Max: 366.56Min: 27.32 / Avg: 310.33 / Max: 359.1Min: 62.65 / Avg: 315.8 / Max: 377.95Min: 40.25 / Avg: 348.37 / Max: 393.82Min: 35.34 / Avg: 362.99 / Max: 409.42Min: 56.36 / Avg: 414.47 / Max: 483.6Min: 104.18 / Avg: 486.34 / Max: 574.85Min: 66.83 / Avg: 497.93 / Max: 572.66Min: 144.18 / Avg: 514.38 / Max: 660.61Min: 75.15 / Avg: 554.16 / Max: 686.41Min: 189.62 / Avg: 638.24 / Max: 714.51Min: 196.59 / Avg: 641.03 / Max: 736.111. EPYC 8534PN: Approximate power consumption of 4031 Joules per run.2. EPYC 8534P: Approximate power consumption of 4726 Joules per run.3. Xeon 6766E: Approximate power consumption of 6195 Joules per run.4. Xeon 6780E: Approximate power consumption of 7946 Joules per run.5. EPYC 9754: Approximate power consumption of 8295 Joules per run.6. Xeon Platinum 8380: Approximate power consumption of 8387 Joules per run.7. Xeon 6766E 2P: Approximate power consumption of 8589 Joules per run.8. EPYC 9654: Approximate power consumption of 9527 Joules per run.9. Xeon Max 9468: Approximate power consumption of 9629 Joules per run.10. Xeon 6780E 2P: Approximate power consumption of 10107 Joules per run.11. Xeon Max 9480: Approximate power consumption of 10602 Joules per run.12. Xeon Platinum 8592+: Approximate power consumption of 10655 Joules per run.13. Xeon Platinum 8490H: Approximate power consumption of 10842 Joules per run.14. EPYC 9754 2P: Approximate power consumption of 11961 Joules per run.15. EPYC 9684X: Approximate power consumption of 12463 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 14230 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 16374 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 16930 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 17660 Joules per run.20. Xeon Platinum 8592+ 2P: Approximate power consumption of 19211 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 21913 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 21795 Joules per run.

Google SynthMark

SynthMark is a cross platform tool for benchmarking CPU performance under a variety of real-time audio workloads. It uses a polyphonic synthesizer model to provide standardized tests for latency, jitter and computational throughput. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgVoices, More Is BetterGoogle SynthMark 20201109Test: VoiceMark_100Xeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9654EPYC 9684XEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9480Xeon Platinum 8490HXeon Max 9468Xeon Max 9468 2PEPYC 8534PNEPYC 9754EPYC 8534PEPYC 9754 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon 6780EXeon 6780E 2PXeon 6766E 2PXeon 6766E2004006008001000SE +/- 0.13, N = 3SE +/- 0.38, N = 3SE +/- 0.55, N = 3SE +/- 0.69, N = 3SE +/- 0.72, N = 3SE +/- 0.56, N = 3SE +/- 1.51, N = 3SE +/- 0.48, N = 3SE +/- 0.24, N = 3SE +/- 0.22, N = 3SE +/- 0.26, N = 3SE +/- 0.30, N = 3SE +/- 0.60, N = 3SE +/- 0.45, N = 3SE +/- 0.14, N = 3SE +/- 0.88, N = 3SE +/- 7.09, N = 3SE +/- 0.53, N = 3SE +/- 0.18, N = 3SE +/- 0.06, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 3799.72799.49783.78783.42783.20782.32712.70712.09712.01711.38711.10710.92656.25655.80655.24655.05555.60548.36540.24538.91494.38494.051. (CXX) g++ options: -lm -lpthread -std=c++11 -Ofast
OpenBenchmarking.orgVoices Per Watt, More Is BetterGoogle SynthMark 20201109Test: VoiceMark_100EPYC 8534PNEPYC 8534PXeon 6780EXeon 6766EEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9684XXeon Max 9468Xeon Platinum 8380Xeon Max 9480Xeon 6780E 2PXeon 6766E 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9468 2P369121513.29512.98412.34011.2919.0068.6997.7777.6267.5826.2505.9545.8914.9694.6403.6103.6073.2463.1213.0442.9862.5672.322
OpenBenchmarking.orgWatts, Fewer Is BetterGoogle SynthMark 20201109CPU Power Consumption MonitorXeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8592+EPYC 9684XXeon 6766E 2PXeon 6780E 2PXeon Max 9468Xeon Max 9480EPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2P70140210280350Min: 43.51 / Avg: 43.76 / Max: 45.51Min: 43.34 / Avg: 43.78 / Max: 45.89Min: 16.18 / Avg: 49.36 / Max: 54.66Min: 17.96 / Avg: 50.47 / Max: 55.88Min: 21.02 / Avg: 72.82 / Max: 80.06Min: 28.69 / Avg: 90.1 / Max: 99.51Min: 52.55 / Avg: 93.31 / Max: 100.6Min: 63.55 / Avg: 93.65 / Max: 130.75Min: 33.54 / Avg: 102.83 / Max: 128.91Min: 33.97 / Avg: 103.33 / Max: 113.89Min: 104.37 / Avg: 106.55 / Max: 109.25Min: 106.8 / Avg: 108.46 / Max: 112.7Min: 75.06 / Avg: 113.78 / Max: 122.61Min: 84.65 / Avg: 120.87 / Max: 129.59Min: 40.35 / Avg: 181.43 / Max: 200.97Min: 99.91 / Avg: 183.65 / Max: 205.87Min: 57.99 / Avg: 216.87 / Max: 238.45Min: 172.36 / Avg: 234.1 / Max: 329.35Min: 61.62 / Avg: 241.28 / Max: 266.15Min: 77.31 / Avg: 256.19 / Max: 292.81Min: 201.92 / Avg: 277.45 / Max: 348.85Min: 203.32 / Avg: 306.14 / Max: 413.851. Xeon 6766E: Approximate power consumption of 1517 Joules per run.2. Xeon 6780E: Approximate power consumption of 1489 Joules per run.3. EPYC 8534PN: Approximate power consumption of 1678 Joules per run.4. EPYC 8534P: Approximate power consumption of 1733 Joules per run.5. EPYC 9754: Approximate power consumption of 2500 Joules per run.6. EPYC 9654: Approximate power consumption of 3063 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 3173 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 3215 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 3496 Joules per run.10. EPYC 9684X: Approximate power consumption of 3513 Joules per run.11. Xeon 6766E 2P: Approximate power consumption of 3658 Joules per run.12. Xeon 6780E 2P: Approximate power consumption of 3688 Joules per run.13. Xeon Max 9468: Approximate power consumption of 3906 Joules per run.14. Xeon Max 9480: Approximate power consumption of 4110 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 6229 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 6244 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 7374 Joules per run.18. Xeon Platinum 8490H 2P: Approximate power consumption of 8115 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 8284 Joules per run.20. Xeon Platinum 8592+ 2P: Approximate power consumption of 8796 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 9433 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 10511 Joules per run.

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 32EPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon 6780EXeon Platinum 8490H 2PXeon 6780E 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 9754EPYC 9754 2PXeon Platinum 8490HEPYC 8534PXeon 6766EXeon 6766E 2PEPYC 8534PNXeon Platinum 8380 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8380500M1000M1500M2000M2500MSE +/- 3000185.18, N = 3SE +/- 2810891.52, N = 3SE +/- 1567730.14, N = 3SE +/- 2510644.01, N = 3SE +/- 17236814.61, N = 3SE +/- 3017909.50, N = 3SE +/- 808290.38, N = 3SE +/- 3300505.01, N = 3SE +/- 4028647.42, N = 3SE +/- 2206304.10, N = 3SE +/- 27191440.65, N = 3SE +/- 1550627.11, N = 3SE +/- 1462114.15, N = 3SE +/- 3167192.94, N = 3SE +/- 3090487.20, N = 3SE +/- 1379613.47, N = 3SE +/- 1003881.36, N = 3SE +/- 3256958.36, N = 3SE +/- 9052685.30, N = 3SE +/- 692820.32, N = 3SE +/- 688799.28, N = 3SE +/- 3209534.41, N = 322874666672282766667228206666722793000002154633333209046666720573000002025000000198930000019632333331927766667189876666718949666671890566667187133333318414000001780533333177686666717311666671679700000164026666715617666671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s Per Watt, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 32EPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EEPYC 9754EPYC 9654Xeon 6780E 2PXeon 6766E 2PEPYC 9684XEPYC 9754 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Max 9468Xeon Max 9480Xeon Platinum 8380EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P4M8M12M16M20M17627091.4615528502.6814706486.7614358014.8011984070.919937920.609419289.569390076.738884551.107114576.186722664.606720931.256685402.046609424.936395094.296304024.255779445.494527054.564217240.973966847.183387722.733308597.89
OpenBenchmarking.orgWatts, Fewer Is BetterLiquid-DSP 1.6CPU Power Consumption MonitorEPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EEPYC 9754Xeon 6766E 2PXeon 6780E 2PEPYC 9654Xeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 9684XEPYC 9754 2PXeon Platinum 8490HXeon Platinum 8592+EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P120240360480600Min: 15.81 / Avg: 100.8 / Max: 114.74Min: 43.61 / Avg: 118.58 / Max: 131.69Min: 15.76 / Avg: 127.25 / Max: 146.72Min: 43.43 / Avg: 143.29 / Max: 159.65Min: 20.46 / Avg: 158.44 / Max: 178.44Min: 104.03 / Avg: 189.62 / Max: 209.49Min: 105.02 / Avg: 211.19 / Max: 235.86Min: 25.11 / Avg: 229.7 / Max: 257.97Min: 49.48 / Avg: 244.21 / Max: 290.74Min: 76.61 / Avg: 245.35 / Max: 268.44Min: 74.71 / Avg: 254.14 / Max: 326.8Min: 33.54 / Avg: 257.47 / Max: 292.35Min: 38.6 / Avg: 266.35 / Max: 296.68Min: 60.85 / Avg: 281.22 / Max: 356.43Min: 27.76 / Avg: 286.83 / Max: 364.52Min: 57.58 / Avg: 362 / Max: 403.93Min: 64.31 / Avg: 394.38 / Max: 445.2Min: 100.23 / Avg: 410.5 / Max: 516.01Min: 75.17 / Avg: 475.95 / Max: 586.43Min: 152.44 / Avg: 510.48 / Max: 610.23Min: 200.67 / Avg: 593.37 / Max: 651.17Min: 197.41 / Avg: 617.07 / Max: 678.021. EPYC 8534PN: Approximate power consumption of 3394 Joules per run.2. Xeon 6766E: Approximate power consumption of 4071 Joules per run.3. EPYC 8534P: Approximate power consumption of 4369 Joules per run.4. Xeon 6780E: Approximate power consumption of 4919 Joules per run.5. EPYC 9754: Approximate power consumption of 5440 Joules per run.6. Xeon 6766E 2P: Approximate power consumption of 6384 Joules per run.7. Xeon 6780E 2P: Approximate power consumption of 7251 Joules per run.8. EPYC 9654: Approximate power consumption of 7810 Joules per run.9. Xeon Platinum 8380: Approximate power consumption of 8303 Joules per run.10. Xeon Max 9468: Approximate power consumption of 8342 Joules per run.11. Xeon Max 9480: Approximate power consumption of 8725 Joules per run.12. EPYC 9684X: Approximate power consumption of 8668 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 9056 Joules per run.14. Xeon Platinum 8490H: Approximate power consumption of 9655 Joules per run.15. Xeon Platinum 8592+: Approximate power consumption of 9848 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 12308 Joules per run.17. EPYC 9684X 2P: Approximate power consumption of 13277 Joules per run.18. Xeon Platinum 8380 2P: Approximate power consumption of 13957 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 16499 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 17527 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 20372 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 21186 Joules per run.

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very FastEPYC 9684XEPYC 9654EPYC 9684X 2PXeon Platinum 8490H 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9654 2PEPYC 8534PXeon Platinum 8490HXeon Max 9480 2PEPYC 9754 2PEPYC 8534PNXeon Max 9468 2PXeon 6780EXeon Max 9480Xeon 6766EXeon Platinum 8380 2PXeon Max 9468Xeon Platinum 8592+Xeon Platinum 8380Xeon 6780E 2PXeon 6766E 2P1428425670SE +/- 0.13, N = 5SE +/- 0.13, N = 5SE +/- 0.12, N = 5SE +/- 0.50, N = 5SE +/- 0.18, N = 5SE +/- 0.16, N = 5SE +/- 0.55, N = 5SE +/- 0.08, N = 4SE +/- 0.01, N = 4SE +/- 0.38, N = 9SE +/- 0.43, N = 15SE +/- 0.06, N = 4SE +/- 0.39, N = 4SE +/- 0.06, N = 4SE +/- 0.02, N = 4SE +/- 0.01, N = 4SE +/- 0.18, N = 4SE +/- 0.12, N = 4SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.43, N = 15SE +/- 0.34, N = 1562.7062.0255.0554.8854.4653.6653.4450.0449.4246.2546.0044.9244.7544.4440.8240.7340.6939.5635.1030.1728.4327.33
OpenBenchmarking.orgFrames Per Second Per Watt, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very FastEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8490HEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+Xeon 6766E 2PEPYC 9684X 2PXeon 6780E 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8380Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9468 2P0.10870.21740.32610.43480.54350.4830.4450.3890.3690.3460.3100.2690.1930.1850.1670.1600.1570.1540.1520.1500.1470.1380.1320.1210.1100.0920.090
OpenBenchmarking.orgWatts, Fewer Is Betteruvg266 0.4.1CPU Power Consumption MonitorEPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EEPYC 9754Xeon 6766E 2PXeon 6780E 2PEPYC 9654Xeon Platinum 8380Xeon Platinum 8592+EPYC 9684XEPYC 9754 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P110220330440550Min: 17.16 / Avg: 92.93 / Max: 127.1Min: 43.61 / Avg: 104.71 / Max: 124.97Min: 17.76 / Avg: 112.52 / Max: 149.73Min: 43.47 / Avg: 120.53 / Max: 150.37Min: 18.78 / Avg: 157.17 / Max: 216.69Min: 104.1 / Avg: 174.26 / Max: 196.44Min: 106.09 / Avg: 187.3 / Max: 229.82Min: 28.57 / Avg: 200.36 / Max: 279.14Min: 53.16 / Avg: 217.91 / Max: 258.49Min: 27.1 / Avg: 218.83 / Max: 315.11Min: 33.4 / Avg: 232.88 / Max: 324.16Min: 39.54 / Avg: 249.19 / Max: 335.92Min: 59.83 / Avg: 256.47 / Max: 330.75Min: 76.83 / Avg: 268.38 / Max: 326.31Min: 73.99 / Avg: 272.27 / Max: 334.62Min: 52.01 / Avg: 320.69 / Max: 430.96Min: 57.76 / Avg: 357.6 / Max: 478.64Min: 103.41 / Avg: 370.67 / Max: 458.86Min: 77.02 / Avg: 407.69 / Max: 581.55Min: 161.1 / Avg: 454.5 / Max: 579.21Min: 193.43 / Avg: 495.22 / Max: 603.09Min: 191.29 / Avg: 503.31 / Max: 608.251. EPYC 8534PN: Approximate power consumption of 1650 Joules per run.2. Xeon 6766E: Approximate power consumption of 1963 Joules per run.3. EPYC 8534P: Approximate power consumption of 1828 Joules per run.4. Xeon 6780E: Approximate power consumption of 2139 Joules per run.5. EPYC 9754: Approximate power consumption of 2358 Joules per run.6. Xeon 6766E 2P: Approximate power consumption of 4577 Joules per run.7. Xeon 6780E 2P: Approximate power consumption of 4757 Joules per run.8. EPYC 9654: Approximate power consumption of 2725 Joules per run.9. Xeon Platinum 8380: Approximate power consumption of 5303 Joules per run.10. Xeon Platinum 8592+: Approximate power consumption of 4741 Joules per run.11. EPYC 9684X: Approximate power consumption of 3214 Joules per run.12. EPYC 9754 2P: Approximate power consumption of 4303 Joules per run.13. Xeon Platinum 8490H: Approximate power consumption of 4232 Joules per run.14. Xeon Max 9468: Approximate power consumption of 5166 Joules per run.15. Xeon Max 9480: Approximate power consumption of 5105 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 5003 Joules per run.17. EPYC 9684X 2P: Approximate power consumption of 5435 Joules per run.18. Xeon Platinum 8380 2P: Approximate power consumption of 6857 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 6360 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 7090 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 8790 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 8556 Joules per run.

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Junkshop - Compute: CPU-OnlyEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon 6780E 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XXeon 6766E 2PEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon 6780EXeon 6766EXeon Platinum 8592+Xeon Platinum 8380 2PEPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon Platinum 83801428425670SE +/- 0.02, N = 4SE +/- 0.08, N = 4SE +/- 0.02, N = 4SE +/- 0.14, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.19, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.24, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 311.2111.4712.8716.8917.7018.3118.6518.7021.0221.1523.4524.9926.4929.0632.0833.2035.8235.9638.8639.1742.8561.22
OpenBenchmarking.orgWatts, Fewer Is BetterBlender 4.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Platinum 8380EPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9684XXeon Max 9480Xeon Max 9468Xeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P140280420560700Min: 18.29 / Avg: 127.16 / Max: 145.93Min: 18.72 / Avg: 148.28 / Max: 170.5Min: 43.7 / Avg: 186.05 / Max: 225.88Min: 43.63 / Avg: 235.7 / Max: 293.05Min: 51.88 / Avg: 251.6 / Max: 290.8Min: 22.09 / Avg: 255.66 / Max: 340.71Min: 16.01 / Avg: 272.23 / Max: 337.39Min: 24.83 / Avg: 303.23 / Max: 378.56Min: 59.14 / Avg: 311.52 / Max: 376.21Min: 35.12 / Avg: 316.57 / Max: 411.05Min: 85.92 / Avg: 320.19 / Max: 376.39Min: 75.79 / Avg: 322.02 / Max: 374.53Min: 106.82 / Avg: 347.76 / Max: 500.93Min: 107.64 / Avg: 397.69 / Max: 593.53Min: 39.86 / Avg: 438.61 / Max: 691.32Min: 105.08 / Avg: 471.81 / Max: 581.38Min: 59.75 / Avg: 483.45 / Max: 681.8Min: 77.61 / Avg: 545.55 / Max: 722.02Min: 63.79 / Avg: 553.98 / Max: 822.05Min: 169.62 / Avg: 575.47 / Max: 754.28Min: 206.83 / Avg: 603.68 / Max: 753.22Min: 208.58 / Avg: 605.47 / Max: 751.551. EPYC 8534PN: Approximate power consumption of 5510 Joules per run.2. EPYC 8534P: Approximate power consumption of 6030 Joules per run.3. Xeon 6766E: Approximate power consumption of 6326 Joules per run.4. Xeon 6780E: Approximate power consumption of 7385 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 16606 Joules per run.6. EPYC 9754: Approximate power consumption of 5795 Joules per run.7. EPYC 9654: Approximate power consumption of 6987 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 11219 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 12772 Joules per run.10. EPYC 9684X: Approximate power consumption of 7492 Joules per run.11. Xeon Max 9480: Approximate power consumption of 14088 Joules per run.12. Xeon Max 9468: Approximate power consumption of 15242 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 8462 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 8882 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 7018 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 18086 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 8460 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 12548 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 9141 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 15538 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 18110 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 17155 Joules per run.

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Fishy Cat - Compute: CPU-OnlyEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon 6780E 2PXeon 6766E 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon 6780EXeon 6766EXeon Platinum 8380 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon Platinum 83801326395265SE +/- 0.04, N = 5SE +/- 0.02, N = 5SE +/- 0.05, N = 4SE +/- 0.01, N = 4SE +/- 0.05, N = 3SE +/- 0.13, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.11, N = 3SE +/- 0.18, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.37, N = 3SE +/- 0.27, N = 3SE +/- 0.06, N = 3SE +/- 0.23, N = 3SE +/- 0.11, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.17, N = 3SE +/- 0.15, N = 39.7110.1611.2515.1616.5216.5817.2918.3619.1320.1521.4523.1726.5229.5530.7531.9134.3534.8338.0438.4842.7859.15
OpenBenchmarking.orgWatts, Fewer Is BetterBlender 4.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Platinum 8380EPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9684XXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P140280420560700Min: 16.69 / Avg: 126.35 / Max: 143.05Min: 16.84 / Avg: 152.85 / Max: 176.56Min: 43.64 / Avg: 193.48 / Max: 236.22Min: 43.69 / Avg: 247.1 / Max: 308.06Min: 53.1 / Avg: 251.93 / Max: 290.63Min: 22.97 / Avg: 261.77 / Max: 349.11Min: 30.77 / Avg: 277.68 / Max: 346.38Min: 23.46 / Avg: 303.18 / Max: 371.62Min: 59.73 / Avg: 313.33 / Max: 377.56Min: 74.14 / Avg: 319.1 / Max: 376.73Min: 74.34 / Avg: 321.04 / Max: 375.24Min: 36.44 / Avg: 322.13 / Max: 410.23Min: 106.69 / Avg: 350.36 / Max: 494.32Min: 109.2 / Avg: 429.78 / Max: 624.43Min: 42.38 / Avg: 447.74 / Max: 705.75Min: 104.59 / Avg: 473.37 / Max: 583.21Min: 60.34 / Avg: 491.93 / Max: 710.82Min: 76.09 / Avg: 546.98 / Max: 735.92Min: 67.56 / Avg: 561.28 / Max: 821.67Min: 169.36 / Avg: 570.45 / Max: 755.96Min: 211.08 / Avg: 602.46 / Max: 751.81Min: 205.55 / Avg: 607.36 / Max: 752.781. EPYC 8534PN: Approximate power consumption of 5433 Joules per run.2. EPYC 8534P: Approximate power consumption of 6012 Joules per run.3. Xeon 6766E: Approximate power consumption of 6707 Joules per run.4. Xeon 6780E: Approximate power consumption of 7825 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 16123 Joules per run.6. EPYC 9754: Approximate power consumption of 5672 Joules per run.7. EPYC 9654: Approximate power consumption of 6942 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 11218 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 12429 Joules per run.10. Xeon Max 9480: Approximate power consumption of 13828 Joules per run.11. Xeon Max 9468: Approximate power consumption of 15303 Joules per run.12. EPYC 9684X: Approximate power consumption of 7409 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 7825 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 8810 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 6627 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 16726 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 7871 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 12398 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 8419 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 14261 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 16065 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 17209 Joules per run.

Appleseed

Appleseed is an open-source production renderer focused on physically-based global illumination rendering engine primarily designed for animation and visual effects. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterAppleseed 2.0 BetaScene: Disney MaterialEPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8592+Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon 6780EXeon Platinum 8490HXeon Max 9480EPYC 8534PXeon 6766EXeon Platinum 8380 2PXeon Max 9468EPYC 8534PNXeon Platinum 83802040608010040.9243.4543.7045.0848.4348.5649.1451.2552.3253.4956.4056.4258.3158.3858.3861.3679.83
OpenBenchmarking.orgWatts, Fewer Is BetterAppleseed 2.0 BetaCPU Power Consumption MonitorEPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8380Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 9684XXeon Max 9468Xeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P110220330440550Min: 18.2 / Avg: 115.79 / Max: 122.63Min: 43.67 / Avg: 135.79 / Max: 150.17Min: 19.19 / Avg: 137.83 / Max: 147Min: 43.44 / Avg: 166.47 / Max: 190.57Min: 22.6 / Avg: 224.95 / Max: 249.27Min: 30.66 / Avg: 254.33 / Max: 277.64Min: 52.88 / Avg: 259.51 / Max: 278.02Min: 35.24 / Avg: 282.12 / Max: 322.89Min: 58.9 / Avg: 287.38 / Max: 319.37Min: 88.66 / Avg: 299.9 / Max: 324.68Min: 35.51 / Avg: 308.24 / Max: 344.71Min: 74.96 / Avg: 328.29 / Max: 350.85Min: 100 / Avg: 465.64 / Max: 503.63Min: 80.77 / Avg: 529.15 / Max: 617.81Min: 166.95 / Avg: 558.49 / Max: 609.29Min: 213.38 / Avg: 604.56 / Max: 649.13Min: 211.94 / Avg: 609.71 / Max: 650.36

Scene: Disney Material

EPYC 9684X 2P: The test run did not produce a result.

EPYC 9654 2P: The test run did not produce a result.

EPYC 9754 2P: The test run did not produce a result.

Xeon 6766E 2P: The test run did not produce a result.

Xeon 6780E 2P: The test run did not produce a result.

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: AlexNetXeon Platinum 8490H 2PXeon Platinum 8490HEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PEPYC 9754Xeon Platinum 8380 2PEPYC 9684XXeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8592+EPYC 9684X 2PEPYC 9654 2PXeon Platinum 8380EPYC 8534PEPYC 9754 2PEPYC 8534PNXeon 6780E 2PXeon 6780EXeon 6766E 2PXeon 6766E2004006008001000SE +/- 7.98, N = 5SE +/- 0.51, N = 5SE +/- 1.31, N = 5SE +/- 7.35, N = 5SE +/- 6.39, N = 13SE +/- 2.99, N = 5SE +/- 3.70, N = 5SE +/- 1.37, N = 5SE +/- 2.22, N = 5SE +/- 2.31, N = 5SE +/- 1.95, N = 5SE +/- 6.22, N = 5SE +/- 7.66, N = 5SE +/- 8.87, N = 4SE +/- 0.27, N = 4SE +/- 0.45, N = 4SE +/- 7.43, N = 15SE +/- 0.16, N = 4SE +/- 5.91, N = 15SE +/- 0.97, N = 3SE +/- 5.44, N = 15SE +/- 0.70, N = 3996.47969.62942.19940.40932.59924.80904.36868.54858.84852.36841.68819.89738.31727.77690.09673.42658.97617.03520.01482.06464.80443.74
OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: AlexNetEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8490HEPYC 9684XXeon Platinum 8592+Xeon Platinum 8380Xeon Max 9480Xeon 6766EXeon Max 9468Xeon 6780EXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9654 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2PXeon 6780E 2PXeon 6766E 2P2468106.6646.5086.2385.4394.3754.3324.1453.4813.3743.3553.3413.0512.6772.4042.2692.2362.0651.9191.8981.8571.7941.740
OpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.16.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EEPYC 9654Xeon Platinum 8592+Xeon Platinum 8380EPYC 9684XXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P120240360480600Min: 15.55 / Avg: 92.59 / Max: 128.11Min: 17.62 / Avg: 103.47 / Max: 147.02Min: 43.64 / Avg: 132.25 / Max: 173.77Min: 21.07 / Avg: 148.26 / Max: 241.29Min: 43.45 / Avg: 158.02 / Max: 214.1Min: 27.88 / Avg: 173.22 / Max: 270.57Min: 33.53 / Avg: 197.79 / Max: 292.33Min: 53.17 / Avg: 198.24 / Max: 276.92Min: 32.91 / Avg: 200.48 / Max: 302.35Min: 58.85 / Avg: 221.64 / Max: 332.07Min: 72.44 / Avg: 251.93 / Max: 351.73Min: 75.5 / Avg: 252.6 / Max: 351.73Min: 104.81 / Avg: 267.11 / Max: 360.8Min: 107.28 / Avg: 289.41 / Max: 402.43Min: 40.23 / Avg: 294.77 / Max: 430.69Min: 99.68 / Avg: 337.77 / Max: 509.02Min: 59.14 / Avg: 352.38 / Max: 512.39Min: 76.02 / Avg: 357.25 / Max: 522.13Min: 64.28 / Avg: 397.64 / Max: 581.36Min: 156.12 / Avg: 439.21 / Max: 636.86Min: 186.67 / Avg: 489.99 / Max: 671.14Min: 196.31 / Avg: 491.23 / Max: 676.711. EPYC 8534PN: Approximate power consumption of 1690 Joules per run.2. EPYC 8534P: Approximate power consumption of 1785 Joules per run.3. Xeon 6766E: Approximate power consumption of 3042 Joules per run.4. EPYC 9754: Approximate power consumption of 2165 Joules per run.5. Xeon 6780E: Approximate power consumption of 3371 Joules per run.6. EPYC 9654: Approximate power consumption of 2390 Joules per run.7. Xeon Platinum 8592+: Approximate power consumption of 2888 Joules per run.8. Xeon Platinum 8380: Approximate power consumption of 3271 Joules per run.9. EPYC 9684X: Approximate power consumption of 2847 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 2970 Joules per run.11. Xeon Max 9468: Approximate power consumption of 3678 Joules per run.12. Xeon Max 9480: Approximate power consumption of 3688 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 6090 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 6078 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 5267 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 4864 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 5726 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 5216 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 6442 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 6061 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 6860 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 6839 Joules per run.

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: MediumEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654EPYC 9754Xeon Platinum 8490H 2PXeon 6780E 2PXeon Max 9480 2PXeon 6766E 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon 6780EXeon Platinum 8490HXeon Platinum 8380 2PXeon 6766EXeon Max 9480Xeon Max 9468Xeon Platinum 83801428425670SE +/- 0.40, N = 5SE +/- 0.56, N = 5SE +/- 0.52, N = 15SE +/- 0.27, N = 4SE +/- 0.01, N = 4SE +/- 0.07, N = 4SE +/- 0.04, N = 4SE +/- 0.06, N = 3SE +/- 0.23, N = 3SE +/- 0.07, N = 3SE +/- 0.21, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 363.4861.1154.5741.5840.5039.5839.0832.0431.7029.6229.1526.6924.8024.3123.0221.3920.9720.3319.3418.8418.1315.511. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: MediumEPYC 8534PNEPYC 9754EPYC 8534PXeon 6766EEPYC 9654Xeon 6780EEPYC 9754 2PEPYC 9654 2PEPYC 9684XXeon 6766E 2PEPYC 9684X 2PXeon 6780E 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Platinum 8380 2PXeon Max 9468 2P0.05220.10440.15660.20880.2610.2320.2070.2000.1850.1810.1720.1690.1510.1480.1350.1350.1300.0900.0820.0800.0660.0660.0650.0650.0540.0530.050
OpenBenchmarking.orgWatts, Fewer Is BetterKvazaar 2.2CPU Power Consumption MonitorEPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EEPYC 9754Xeon 6766E 2PEPYC 9654Xeon Platinum 8380Xeon 6780E 2PXeon Platinum 8490HEPYC 9684XXeon Platinum 8592+Xeon Max 9468Xeon Max 9480EPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2P120240360480600Min: 15.7 / Avg: 99.33 / Max: 124.48Min: 43.62 / Avg: 104.69 / Max: 123.24Min: 17.56 / Avg: 121.69 / Max: 146.12Min: 43.55 / Avg: 124.03 / Max: 147.77Min: 20.71 / Avg: 188.76 / Max: 248.4Min: 104.63 / Avg: 216.52 / Max: 253.59Min: 26.12 / Avg: 219.12 / Max: 294.65Min: 53 / Avg: 234.37 / Max: 263.04Min: 106.92 / Avg: 243.13 / Max: 293.72Min: 61.73 / Avg: 263.01 / Max: 306.52Min: 34.18 / Avg: 273.99 / Max: 354.7Min: 33.8 / Avg: 276.47 / Max: 362.01Min: 77.93 / Avg: 280.57 / Max: 315.37Min: 69.51 / Avg: 286.2 / Max: 325.03Min: 38.26 / Avg: 323.31 / Max: 486.48Min: 103.66 / Avg: 385.29 / Max: 444.98Min: 56.07 / Avg: 404.28 / Max: 599.6Min: 66.41 / Avg: 469.54 / Max: 685.47Min: 168.08 / Avg: 490.42 / Max: 593.69Min: 75.75 / Avg: 509.74 / Max: 682.24Min: 209.31 / Avg: 533.47 / Max: 617.43Min: 189.77 / Avg: 550.48 / Max: 652.571. EPYC 8534PN: Approximate power consumption of 3013 Joules per run.2. Xeon 6766E: Approximate power consumption of 3699 Joules per run.3. EPYC 8534P: Approximate power consumption of 3488 Joules per run.4. Xeon 6780E: Approximate power consumption of 3969 Joules per run.5. EPYC 9754: Approximate power consumption of 3634 Joules per run.6. Xeon 6766E 2P: Approximate power consumption of 5413 Joules per run.7. EPYC 9654: Approximate power consumption of 4437 Joules per run.8. Xeon Platinum 8380: Approximate power consumption of 10078 Joules per run.9. Xeon 6780E 2P: Approximate power consumption of 5673 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 8679 Joules per run.11. EPYC 9684X: Approximate power consumption of 5206 Joules per run.12. Xeon Platinum 8592+: Approximate power consumption of 7925 Joules per run.13. Xeon Max 9468: Approximate power consumption of 10381 Joules per run.14. Xeon Max 9480: Approximate power consumption of 10303 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 4914 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 12971 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 5741 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 6386 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 11606 Joules per run.20. Xeon Platinum 8592+ 2P: Approximate power consumption of 9558 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 14582 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 13579 Joules per run.

Pennant

Pennant is an application focused on hydrodynamics on general unstructured meshes in 2D. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: sedovbigEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 8534PXeon Max 9480 2PEPYC 8534PNXeon Max 9468 2PXeon Platinum 8380 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480Xeon Max 9468Xeon Platinum 8380612182430SE +/- 0.037087, N = 15SE +/- 0.041359, N = 15SE +/- 0.040626, N = 15SE +/- 0.074320, N = 15SE +/- 0.080453, N = 15SE +/- 0.052975, N = 7SE +/- 0.018471, N = 4SE +/- 0.016400, N = 4SE +/- 0.024479, N = 4SE +/- 0.003253, N = 4SE +/- 0.029749, N = 4SE +/- 0.003237, N = 4SE +/- 0.052953, N = 3SE +/- 0.002987, N = 3SE +/- 0.002400, N = 3SE +/- 0.013353, N = 3SE +/- 0.001847, N = 3SE +/- 0.034794, N = 32.9404563.0811083.4083375.1476585.4606605.9164589.96452611.28438011.36964012.10690012.15132013.21125015.24719016.03080016.96910019.88246021.02112025.7894501. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi
OpenBenchmarking.orgWatts, Fewer Is BetterPennant 1.0.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8380EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P140280420560700Min: 16.13 / Avg: 110.49 / Max: 145.79Min: 19.05 / Avg: 123.57 / Max: 166.99Min: 20.25 / Avg: 182.99 / Max: 330.83Min: 26.98 / Avg: 200.64 / Max: 329.21Min: 51.49 / Avg: 239.83 / Max: 289.95Min: 30.95 / Avg: 242.71 / Max: 409.53Min: 26.41 / Avg: 279.92 / Max: 376.36Min: 57.56 / Avg: 287.94 / Max: 376.04Min: 78.91 / Avg: 298.37 / Max: 377.04Min: 72.63 / Avg: 303.18 / Max: 377.15Min: 41.72 / Avg: 310.27 / Max: 663.85Min: 55.22 / Avg: 351.84 / Max: 674.58Min: 64.82 / Avg: 404.01 / Max: 819.66Min: 101.05 / Avg: 438.87 / Max: 580.29Min: 69.95 / Avg: 489.66 / Max: 753.78Min: 148.41 / Avg: 535.71 / Max: 753.56Min: 206.49 / Avg: 569.16 / Max: 751.77Min: 189.6 / Avg: 573.95 / Max: 754.131. EPYC 8534PN: Approximate power consumption of 1906 Joules per run.2. EPYC 8534P: Approximate power consumption of 2039 Joules per run.3. EPYC 9754: Approximate power consumption of 2025 Joules per run.4. EPYC 9654: Approximate power consumption of 2264 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 7275 Joules per run.6. EPYC 9684X: Approximate power consumption of 2589 Joules per run.7. Xeon Platinum 8592+: Approximate power consumption of 6345 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 6143 Joules per run.9. Xeon Max 9480: Approximate power consumption of 7658 Joules per run.10. Xeon Max 9468: Approximate power consumption of 7883 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 4819 Joules per run.12. EPYC 9654 2P: Approximate power consumption of 4246 Joules per run.13. EPYC 9684X 2P: Approximate power consumption of 4740 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 9216 Joules per run.15. Xeon Platinum 8592+ 2P: Approximate power consumption of 9304 Joules per run.16. Xeon Platinum 8490H 2P: Approximate power consumption of 10312 Joules per run.17. Xeon Max 9480 2P: Approximate power consumption of 11241 Joules per run.18. Xeon Max 9468 2P: Approximate power consumption of 11479 Joules per run.

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: SlowEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654EPYC 9754Xeon 6780E 2PXeon Platinum 8490H 2PXeon 6766E 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon 6780EXeon Platinum 8490HXeon Platinum 8380 2PXeon 6766EXeon Max 9480Xeon Max 9468Xeon Platinum 83801428425670SE +/- 0.26, N = 5SE +/- 0.50, N = 5SE +/- 0.47, N = 8SE +/- 0.04, N = 4SE +/- 0.07, N = 4SE +/- 0.01, N = 4SE +/- 0.05, N = 4SE +/- 0.18, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 362.8261.0754.8840.9240.0038.9038.4731.8531.2429.1528.9626.0024.2323.7122.4620.8720.2319.7118.8618.2417.5215.091. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: SlowEPYC 8534PNEPYC 9754EPYC 8534PXeon 6766EEPYC 9754 2PEPYC 9654Xeon 6780EEPYC 9654 2PEPYC 9684XEPYC 9684X 2PXeon 6766E 2PXeon 6780E 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Platinum 8380 2PXeon Max 9468 2P0.05130.10260.15390.20520.25650.2280.2020.1990.1770.1690.1690.1660.1490.1460.1350.1320.1280.0870.0800.0770.0640.0640.0630.0630.0520.0510.048
OpenBenchmarking.orgWatts, Fewer Is BetterKvazaar 2.2CPU Power Consumption MonitorEPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EEPYC 9754Xeon 6766E 2PEPYC 9654Xeon Platinum 8380Xeon 6780E 2PXeon Platinum 8490HEPYC 9684XXeon Platinum 8592+Xeon Max 9468Xeon Max 9480EPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2P120240360480600Min: 15.1 / Avg: 98.52 / Max: 118.03Min: 43.61 / Avg: 106.79 / Max: 125.47Min: 17.7 / Avg: 119.03 / Max: 142.44Min: 43.47 / Avg: 125.76 / Max: 153.18Min: 21.44 / Avg: 190.72 / Max: 249.47Min: 104.31 / Avg: 220.37 / Max: 264.43Min: 28.16 / Avg: 229.8 / Max: 294.04Min: 52.23 / Avg: 234.47 / Max: 262.38Min: 105.65 / Avg: 248.74 / Max: 300.85Min: 58.28 / Avg: 262.77 / Max: 303.74Min: 30.18 / Avg: 273.17 / Max: 355.5Min: 28.15 / Avg: 278.75 / Max: 351.38Min: 80.03 / Avg: 279.05 / Max: 314.96Min: 67.53 / Avg: 286.96 / Max: 322.9Min: 38.94 / Avg: 325.22 / Max: 485.91Min: 96.13 / Avg: 384.99 / Max: 445.25Min: 58.04 / Avg: 409.96 / Max: 602.7Min: 59.79 / Avg: 464.35 / Max: 680.95Min: 168.67 / Avg: 496.87 / Max: 590.71Min: 71.05 / Avg: 508.41 / Max: 687.83Min: 210.38 / Avg: 537.83 / Max: 613.5Min: 195.26 / Avg: 552.42 / Max: 652.441. EPYC 8534PN: Approximate power consumption of 3054 Joules per run.2. Xeon 6766E: Approximate power consumption of 3844 Joules per run.3. EPYC 8534P: Approximate power consumption of 3531 Joules per run.4. Xeon 6780E: Approximate power consumption of 4108 Joules per run.5. EPYC 9754: Approximate power consumption of 3767 Joules per run.6. Xeon 6766E 2P: Approximate power consumption of 5509 Joules per run.7. EPYC 9654: Approximate power consumption of 4539 Joules per run.8. Xeon Platinum 8380: Approximate power consumption of 10317 Joules per run.9. Xeon 6780E 2P: Approximate power consumption of 5721 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 8934 Joules per run.11. EPYC 9684X: Approximate power consumption of 5259 Joules per run.12. Xeon Platinum 8592+: Approximate power consumption of 8084 Joules per run.13. Xeon Max 9468: Approximate power consumption of 10790 Joules per run.14. Xeon Max 9480: Approximate power consumption of 10617 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 4960 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 13346 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 5739 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 6408 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 11925 Joules per run.20. Xeon Platinum 8592+ 2P: Approximate power consumption of 9787 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 14521 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 13810 Joules per run.

srsRAN Project

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PUSCH Processor Benchmark, Throughput ThreadXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8380Xeon Platinum 8380 2PEPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2P306090120150SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.07, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3129.7129.7129.7129.7129.7129.7129.5129.5112.3112.3112.2112.2112.2112.2112.1112.1112.1112.152.652.549.849.81. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -fno-trapping-math -fno-math-errno -ldl
OpenBenchmarking.orgMbps Per Watt, More Is BettersrsRAN Project 23.10.1-20240325Test: PUSCH Processor Benchmark, Throughput ThreadEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8380Xeon Platinum 8592+Xeon 6780EXeon 6766EEPYC 9684XXeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9754 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon 6780E 2PEPYC 9684X 2PXeon 6766E 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P0.5111.0221.5332.0442.5552.2712.2341.5511.2571.2011.1961.1931.1391.0950.9650.7500.7360.6370.6030.5640.5240.4870.4760.4670.4260.3470.345
OpenBenchmarking.orgWatts, Fewer Is BettersrsRAN Project 23.10.1-20240325CPU Power Consumption MonitorXeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8380EPYC 9684XXeon 6766E 2PXeon 6780E 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468EPYC 9754 2PXeon Max 9480Xeon Platinum 8380 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P70140210280350Min: 43.55 / Avg: 43.73 / Max: 45.56Min: 21.98 / Avg: 44.02 / Max: 45.61Min: 16.95 / Avg: 49.36 / Max: 56.04Min: 16.97 / Avg: 50.19 / Max: 57.02Min: 21.9 / Avg: 72.27 / Max: 82.25Min: 27.03 / Avg: 89.27 / Max: 101.62Min: 52.1 / Avg: 93.49 / Max: 102.87Min: 34.3 / Avg: 102.46 / Max: 115.98Min: 103.85 / Avg: 106.63 / Max: 109.21Min: 104.39 / Avg: 107.97 / Max: 110.48Min: 34.52 / Avg: 108.29 / Max: 130.82Min: 59.93 / Avg: 134.44 / Max: 153.53Min: 72.46 / Avg: 172.93 / Max: 196.41Min: 40.92 / Avg: 175.84 / Max: 200.95Min: 77.25 / Avg: 176.34 / Max: 199.62Min: 97.13 / Avg: 186.14 / Max: 224.52Min: 58.78 / Avg: 213.93 / Max: 242.48Min: 80.8 / Avg: 229.54 / Max: 284.84Min: 61.91 / Avg: 235.89 / Max: 267.82Min: 160.99 / Avg: 304.32 / Max: 339.38Min: 206.09 / Avg: 373.48 / Max: 412.46Min: 207.62 / Avg: 375.78 / Max: 415.171. Xeon 6766E: Approximate power consumption of 2361 Joules per run.2. Xeon 6780E: Approximate power consumption of 2216 Joules per run.3. EPYC 8534PN: Approximate power consumption of 1251 Joules per run.4. EPYC 8534P: Approximate power consumption of 1271 Joules per run.5. EPYC 9754: Approximate power consumption of 1831 Joules per run.6. EPYC 9654: Approximate power consumption of 2262 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 2368 Joules per run.8. EPYC 9684X: Approximate power consumption of 2596 Joules per run.9. Xeon 6766E 2P: Approximate power consumption of 5758 Joules per run.10. Xeon 6780E 2P: Approximate power consumption of 5434 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 2382 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 2958 Joules per run.13. Xeon Max 9468: Approximate power consumption of 3747 Joules per run.14. EPYC 9754 2P: Approximate power consumption of 4455 Joules per run.15. Xeon Max 9480: Approximate power consumption of 3821 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 4716 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 5348 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 5050 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 5976 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 6695 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 8217 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 8142 Joules per run.

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very FastEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 8534PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PNXeon Platinum 8490HXeon 6780EXeon Platinum 8380 2PXeon 6766EXeon Max 9480Xeon Max 9468Xeon 6780E 2PXeon Platinum 8592+Xeon 6766E 2PXeon Platinum 838020406080100SE +/- 0.32, N = 6SE +/- 0.62, N = 6SE +/- 0.28, N = 6SE +/- 0.71, N = 6SE +/- 0.21, N = 5SE +/- 0.45, N = 5SE +/- 0.36, N = 5SE +/- 0.63, N = 15SE +/- 0.07, N = 5SE +/- 0.29, N = 4SE +/- 0.33, N = 4SE +/- 0.07, N = 4SE +/- 0.08, N = 4SE +/- 0.00, N = 4SE +/- 0.18, N = 4SE +/- 0.04, N = 4SE +/- 0.08, N = 4SE +/- 0.06, N = 4SE +/- 0.50, N = 15SE +/- 0.04, N = 4SE +/- 0.36, N = 15SE +/- 0.06, N = 378.1576.8374.0372.6868.5667.6465.3859.0154.6052.2351.9151.5150.0346.1844.1141.8641.3440.2338.9238.0236.4031.251. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very FastEPYC 8534PNEPYC 8534PEPYC 9754Xeon 6766EXeon 6780EEPYC 9654EPYC 9684XEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon 6766E 2PXeon Platinum 8490HXeon 6780E 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9468 2P0.13320.26640.39960.53280.6660.5920.5070.4700.4490.4290.4060.3590.2490.2410.2190.2130.2120.2100.1830.1750.1630.1620.1560.1520.1290.1090.109
OpenBenchmarking.orgWatts, Fewer Is BetterKvazaar 2.2CPU Power Consumption MonitorEPYC 8534PNXeon 6766EXeon 6780EEPYC 8534PEPYC 9754Xeon 6766E 2PXeon 6780E 2PEPYC 9654Xeon Platinum 8380Xeon Platinum 8592+EPYC 9684XXeon Platinum 8490HEPYC 9754 2PXeon Max 9468Xeon Max 9480EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P110220330440550Min: 15.21 / Avg: 87.02 / Max: 118.81Min: 43.56 / Avg: 93.24 / Max: 111.07Min: 43.47 / Avg: 107.62 / Max: 131.78Min: 17.32 / Avg: 107.72 / Max: 144.07Min: 21.76 / Avg: 145.81 / Max: 208.59Min: 104.11 / Avg: 170.72 / Max: 196.41Min: 106.42 / Avg: 185.19 / Max: 224.67Min: 28.16 / Avg: 189.32 / Max: 280.14Min: 53.82 / Avg: 205.21 / Max: 244.22Min: 28.31 / Avg: 207.87 / Max: 283.73Min: 32 / Avg: 217.45 / Max: 322.84Min: 60.42 / Avg: 235.64 / Max: 301.41Min: 39.35 / Avg: 237.06 / Max: 332.11Min: 74.97 / Avg: 248.42 / Max: 303.88Min: 71.86 / Avg: 253.88 / Max: 311.53Min: 58.8 / Avg: 302.06 / Max: 438.45Min: 66.01 / Avg: 338.64 / Max: 489.89Min: 100.56 / Avg: 342.63 / Max: 431.07Min: 73.01 / Avg: 374.34 / Max: 560.15Min: 162.16 / Avg: 433.41 / Max: 581.27Min: 190.55 / Avg: 476.69 / Max: 591.36Min: 187.97 / Avg: 480.56 / Max: 609.821. EPYC 8534PN: Approximate power consumption of 1371 Joules per run.2. Xeon 6766E: Approximate power consumption of 1725 Joules per run.3. Xeon 6780E: Approximate power consumption of 1830 Joules per run.4. EPYC 8534P: Approximate power consumption of 1616 Joules per run.5. EPYC 9754: Approximate power consumption of 1866 Joules per run.6. Xeon 6766E 2P: Approximate power consumption of 3528 Joules per run.7. Xeon 6780E 2P: Approximate power consumption of 3642 Joules per run.8. EPYC 9654: Approximate power consumption of 2272 Joules per run.9. Xeon Platinum 8380: Approximate power consumption of 4788 Joules per run.10. Xeon Platinum 8592+: Approximate power consumption of 4157 Joules per run.11. EPYC 9684X: Approximate power consumption of 2573 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 3829 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 3414 Joules per run.14. Xeon Max 9468: Approximate power consumption of 4782 Joules per run.15. Xeon Max 9480: Approximate power consumption of 4760 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 3776 Joules per run.17. EPYC 9684X 2P: Approximate power consumption of 4177 Joules per run.18. Xeon Platinum 8380 2P: Approximate power consumption of 6082 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 5016 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 5721 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 7508 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 7449 Joules per run.

OpenFOAM

OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeEPYC 9684X 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PXeon Max 9480 2PEPYC 9684XXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+EPYC 9754Xeon Platinum 8380 2PXeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 83802040608010022.7123.5624.5725.0127.5828.3328.5628.9932.5933.0733.8140.2941.7542.2245.9558.1759.2774.961. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
OpenBenchmarking.orgWatts, Fewer Is BetterOpenFOAM 10CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon Platinum 8380EPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9684XEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P140280420560700Min: 18.23 / Avg: 127.4 / Max: 138.98Min: 18.43 / Avg: 144.44 / Max: 158.84Min: 52.29 / Avg: 257.16 / Max: 290.38Min: 21.51 / Avg: 279.79 / Max: 332.78Min: 26.89 / Avg: 291.57 / Max: 346.26Min: 34.57 / Avg: 309.91 / Max: 375.49Min: 59.81 / Avg: 321.01 / Max: 376.02Min: 86.83 / Avg: 326.72 / Max: 375.23Min: 75.09 / Avg: 327.52 / Max: 369.69Min: 28.87 / Avg: 354.56 / Max: 409.42Min: 40.14 / Avg: 494.35 / Max: 670.85Min: 99.76 / Avg: 494.65 / Max: 579.71Min: 55.42 / Avg: 556.32 / Max: 707.08Min: 77.55 / Avg: 575.65 / Max: 751.78Min: 169.28 / Avg: 612 / Max: 754.37Min: 207.44 / Avg: 635.4 / Max: 745.25Min: 214 / Avg: 635.45 / Max: 751.66Min: 63.58 / Avg: 654.7 / Max: 819.07

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh TimeEPYC 9684XEPYC 9684X 2PEPYC 9654 2PEPYC 9654Xeon Max 9480 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9754Xeon Platinum 8490HXeon Platinum 8592+Xeon Max 9468Xeon Max 9480Xeon Max 9468 2PEPYC 8534PXeon Platinum 8490H 2PEPYC 8534PNXeon Platinum 8380 2PXeon Platinum 838091827364525.9326.8227.7428.0328.8429.3329.4730.3831.3831.7031.7832.0032.4833.6735.6036.8236.8639.121. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 8 - Input: Bosphorus 4KEPYC 9654EPYC 9684X 2PEPYC 9654 2PEPYC 9684XXeon Platinum 8592+EPYC 9754EPYC 9754 2PXeon Platinum 8490HXeon Platinum 8592+ 2PEPYC 8534PXeon Max 9480Xeon Platinum 8490H 2PEPYC 8534PNXeon Max 9468Xeon Platinum 8380 2PXeon Max 9480 2PXeon Platinum 8380Xeon Max 9468 2PXeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P20406080100SE +/- 0.56, N = 5SE +/- 0.63, N = 5SE +/- 0.40, N = 5SE +/- 0.42, N = 5SE +/- 0.22, N = 5SE +/- 0.38, N = 5SE +/- 0.31, N = 4SE +/- 0.20, N = 5SE +/- 0.79, N = 5SE +/- 0.11, N = 4SE +/- 0.29, N = 4SE +/- 0.46, N = 4SE +/- 0.67, N = 4SE +/- 0.26, N = 4SE +/- 0.52, N = 7SE +/- 0.44, N = 15SE +/- 0.09, N = 4SE +/- 0.58, N = 5SE +/- 0.02, N = 4SE +/- 0.34, N = 3SE +/- 0.03, N = 4SE +/- 0.35, N = 1587.9987.8286.3486.3079.4478.7477.6070.9170.4368.1965.3665.2264.7962.7559.1055.9855.2454.8250.8247.2546.4842.861. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 8 - Input: Bosphorus 4KEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon 6766EXeon 6780EEPYC 9684XXeon Platinum 8592+EPYC 9754 2PXeon Platinum 8490HEPYC 9654 2PXeon Platinum 8380EPYC 9684X 2PXeon 6780E 2PXeon 6766E 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P0.21470.42940.64410.85881.07350.9540.8790.7370.6530.5950.5870.5700.4390.3880.3620.3490.3360.3210.3060.2990.2860.2780.2270.2240.1790.1260.124
OpenBenchmarking.orgWatts, Fewer Is BetterSVT-AV1 2.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon 6766E 2PEPYC 9684XXeon 6780E 2PXeon Platinum 8380Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9754 2PXeon Max 9468Xeon Max 9480EPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P100200300400500Min: 14.98 / Avg: 67.93 / Max: 107.89Min: 16.05 / Avg: 77.57 / Max: 129.87Min: 43.66 / Avg: 78.14 / Max: 117.48Min: 43.44 / Avg: 86.61 / Max: 139.64Min: 21.17 / Avg: 106.8 / Max: 187.26Min: 28.36 / Avg: 134.72 / Max: 238.02Min: 55.92 / Avg: 143.16 / Max: 199.83Min: 31.53 / Avg: 151.3 / Max: 266.73Min: 105.44 / Avg: 154.41 / Max: 213.01Min: 51.15 / Avg: 164.49 / Max: 247.62Min: 27.5 / Avg: 181.13 / Max: 316.97Min: 59.76 / Avg: 195.92 / Max: 293.59Min: 39.92 / Avg: 200.17 / Max: 302.35Min: 76.76 / Avg: 226.08 / Max: 319.38Min: 73.57 / Avg: 228.42 / Max: 325.25Min: 56.85 / Avg: 247.1 / Max: 379.6Min: 98.92 / Avg: 263.75 / Max: 406.42Min: 62.22 / Avg: 273.59 / Max: 425.17Min: 70.26 / Avg: 309.78 / Max: 476.6Min: 171.54 / Avg: 364.29 / Max: 488.45Min: 193.1 / Avg: 442.35 / Max: 576.63Min: 196.2 / Avg: 442.62 / Max: 580.631. EPYC 8534PN: Approximate power consumption of 1189 Joules per run.2. EPYC 8534P: Approximate power consumption of 1299 Joules per run.3. Xeon 6766E: Approximate power consumption of 1602 Joules per run.4. Xeon 6780E: Approximate power consumption of 1667 Joules per run.5. EPYC 9754: Approximate power consumption of 1645 Joules per run.6. EPYC 9654: Approximate power consumption of 1913 Joules per run.7. Xeon 6766E 2P: Approximate power consumption of 3226 Joules per run.8. EPYC 9684X: Approximate power consumption of 2179 Joules per run.9. Xeon 6780E 2P: Approximate power consumption of 3294 Joules per run.10. Xeon Platinum 8380: Approximate power consumption of 2879 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 2572 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 2939 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 3203 Joules per run.14. Xeon Max 9468: Approximate power consumption of 3730 Joules per run.15. Xeon Max 9480: Approximate power consumption of 3712 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 3558 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 4597 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 3994 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 4832 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 6102 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 8139 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 8085 Joules per run.

Intel Open Image Denoise

Open Image Denoise is a denoising library for ray-tracing and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RTLightmap.hdr.4096x4096 - Device: CPU-OnlyXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9754 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+Xeon 6766E 2PEPYC 9754Xeon Platinum 8380 2PEPYC 9654Xeon Platinum 8490HEPYC 9684XXeon Max 9480Xeon Max 9468Xeon 6780EXeon 6766EEPYC 8534PXeon Platinum 8380EPYC 8534PN0.541.081.622.162.7SE +/- 0.01, N = 4SE +/- 0.01, N = 4SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 4SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 32.402.181.741.721.711.681.671.641.581.511.501.481.311.291.281.141.081.070.980.860.860.80
OpenBenchmarking.orgImages / Sec Per Watt, More Is BetterIntel Open Image Denoise 2.2Run: RTLightmap.hdr.4096x4096 - Device: CPU-OnlyEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon 6780EXeon 6766EXeon 6766E 2PEPYC 9754 2PEPYC 9684XXeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9468 2PXeon Max 94680.00160.00320.00480.00640.0080.0070.0060.0060.0050.0050.0040.0040.0040.0040.0040.0040.0040.0040.0040.0030.0030.0030.0030.0030.0030.0030.003
OpenBenchmarking.orgWatts, Fewer Is BetterIntel Open Image Denoise 2.2CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon Platinum 8380EPYC 9654Xeon 6780EXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9684XXeon 6766E 2PEPYC 9754 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Max 9468 2PXeon Max 9480 2P130260390520650Min: 17.12 / Avg: 118.45 / Max: 132.79Min: 17.84 / Avg: 136.47 / Max: 153.36Min: 43.68 / Avg: 220.35 / Max: 250.91Min: 22.02 / Avg: 239.18 / Max: 293.59Min: 53.73 / Avg: 245.89 / Max: 283.33Min: 26.15 / Avg: 266.61 / Max: 316.67Min: 43.6 / Avg: 279.34 / Max: 327.38Min: 35.29 / Avg: 290 / Max: 378.6Min: 59.44 / Avg: 304.48 / Max: 364.78Min: 78.93 / Avg: 313 / Max: 373.31Min: 75.68 / Avg: 314.57 / Max: 370.97Min: 35.65 / Avg: 329.68 / Max: 387.49Min: 105.15 / Avg: 418.44 / Max: 529.24Min: 40.88 / Avg: 433.56 / Max: 546.1Min: 104.72 / Avg: 461.16 / Max: 559.61Min: 108.06 / Avg: 500.21 / Max: 643.27Min: 60.67 / Avg: 504.98 / Max: 617.56Min: 79.35 / Avg: 534.18 / Max: 740.08Min: 169.3 / Avg: 573.61 / Max: 745.77Min: 66.51 / Avg: 585.9 / Max: 726.86Min: 206.4 / Avg: 605.57 / Max: 749.65Min: 198.59 / Avg: 608.01 / Max: 748.721. EPYC 8534PN: Approximate power consumption of 5014 Joules per run.2. EPYC 8534P: Approximate power consumption of 5459 Joules per run.3. Xeon 6766E: Approximate power consumption of 7859 Joules per run.4. EPYC 9754: Approximate power consumption of 5980 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 9672 Joules per run.6. EPYC 9654: Approximate power consumption of 7287 Joules per run.7. Xeon 6780E: Approximate power consumption of 9125 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 6960 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 8525 Joules per run.10. Xeon Max 9480: Approximate power consumption of 9599 Joules per run.11. Xeon Max 9468: Approximate power consumption of 10171 Joules per run.12. EPYC 9684X: Approximate power consumption of 9231 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 10566 Joules per run.14. EPYC 9754 2P: Approximate power consumption of 9827 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 11529 Joules per run.16. Xeon 6780E 2P: Approximate power consumption of 11672 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 11446 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 9482 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 10899 Joules per run.20. EPYC 9684X 2P: Approximate power consumption of 13476 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 13524 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 13376 Joules per run.

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: BMW27 - Compute: CPU-OnlyEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon 6780E 2PXeon 6766E 2PXeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon 6780EXeon 6766EXeon Platinum 8380 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 9468Xeon Platinum 83801122334455SE +/- 0.02, N = 6SE +/- 0.03, N = 6SE +/- 0.02, N = 5SE +/- 0.09, N = 5SE +/- 0.06, N = 5SE +/- 0.03, N = 4SE +/- 0.01, N = 4SE +/- 0.08, N = 4SE +/- 0.04, N = 4SE +/- 0.08, N = 4SE +/- 0.07, N = 4SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.17, N = 8SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.15, N = 3SE +/- 0.04, N = 3SE +/- 0.24, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 3SE +/- 0.11, N = 37.177.758.619.7110.5612.7612.8613.7414.2915.2915.9616.5517.6119.8523.6723.7225.8927.1228.4930.0731.6646.32
OpenBenchmarking.orgWatts, Fewer Is BetterBlender 4.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754Xeon Platinum 8380EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 9684XXeon Max 9468Xeon 6766E 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P140280420560700Min: 18.72 / Avg: 121.31 / Max: 138.75Min: 17.13 / Avg: 146.16 / Max: 171.02Min: 43.62 / Avg: 189.01 / Max: 235.56Min: 43.52 / Avg: 237.13 / Max: 302.65Min: 21.13 / Avg: 247.78 / Max: 338.02Min: 52.7 / Avg: 250.52 / Max: 290.53Min: 27.61 / Avg: 264.26 / Max: 339.47Min: 33.51 / Avg: 297.61 / Max: 376.94Min: 57.12 / Avg: 303.66 / Max: 376.88Min: 80.66 / Avg: 311.66 / Max: 376.47Min: 35.39 / Avg: 314.77 / Max: 411.05Min: 72.63 / Avg: 316.78 / Max: 376.8Min: 104.11 / Avg: 337.47 / Max: 486.69Min: 106.78 / Avg: 401.76 / Max: 612.07Min: 41.39 / Avg: 414.63 / Max: 680.91Min: 56.75 / Avg: 465.75 / Max: 695.98Min: 103.59 / Avg: 467.53 / Max: 580.29Min: 66.83 / Avg: 521.92 / Max: 820.17Min: 73.16 / Avg: 522.14 / Max: 732.74Min: 171.9 / Avg: 556.95 / Max: 754.1Min: 211.29 / Avg: 584.52 / Max: 755.18Min: 204.3 / Avg: 589.35 / Max: 754.591. EPYC 8534PN: Approximate power consumption of 4206 Joules per run.2. EPYC 8534P: Approximate power consumption of 4677 Joules per run.3. Xeon 6766E: Approximate power consumption of 4607 Joules per run.4. Xeon 6780E: Approximate power consumption of 5296 Joules per run.5. EPYC 9754: Approximate power consumption of 4336 Joules per run.6. Xeon Platinum 8380: Approximate power consumption of 12693 Joules per run.7. EPYC 9654: Approximate power consumption of 5483 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 8432 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 9312 Joules per run.10. Xeon Max 9480: Approximate power consumption of 10389 Joules per run.11. EPYC 9684X: Approximate power consumption of 5823 Joules per run.12. Xeon Max 9468: Approximate power consumption of 11404 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 5197 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 5866 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 4768 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 6148 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 13247 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 6437 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 9268 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 10582 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 11690 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 12573 Joules per run.

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1EPYC 9684X 2PEPYC 9754EPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8592+EPYC 8534PNXeon Platinum 8380 2PXeon 6780E 2PXeon Platinum 8490HXeon 6766E 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8380Xeon 6780EXeon 6766E50100150200250SE +/- 6.15, N = 12SE +/- 0.70, N = 9SE +/- 2.97, N = 13SE +/- 3.98, N = 15SE +/- 1.02, N = 8SE +/- 3.27, N = 13SE +/- 1.18, N = 7SE +/- 0.81, N = 7SE +/- 1.85, N = 12SE +/- 1.28, N = 12SE +/- 0.04, N = 6SE +/- 0.20, N = 6SE +/- 0.03, N = 6SE +/- 1.19, N = 15SE +/- 0.46, N = 15SE +/- 0.61, N = 5SE +/- 0.05, N = 5SE +/- 0.84, N = 15SE +/- 0.12, N = 4SE +/- 0.38, N = 9SE +/- 0.01, N = 3SE +/- 0.02, N = 3236.61229.91217.85214.62199.73151.95136.95133.63114.90108.40107.35106.4098.2185.2984.3582.8576.6070.8463.6247.2643.5539.171. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
OpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1EPYC 9754EPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9654EPYC 9654 2PEPYC 9684XEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468Xeon 6766E 2PXeon 6766EXeon 6780E 2PXeon Max 9480 2PXeon Max 9468 2PXeon 6780EXeon Platinum 8380Xeon Platinum 8380 2P0.31790.63580.95371.27161.58951.4131.0431.0080.7320.7060.6550.6400.6110.5030.4450.3240.2910.2800.2620.2550.2490.2360.2310.2280.2220.2060.204
OpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754EPYC 9654Xeon 6780EXeon Platinum 8380EPYC 9684XXeon Platinum 8592+Xeon Max 9468Xeon Max 9480Xeon Platinum 8490HEPYC 9754 2PXeon 6766E 2PEPYC 9654 2PXeon 6780E 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P140280420560700Min: 17.11 / Avg: 94.19 / Max: 135.5Min: 18.42 / Avg: 106.48 / Max: 155.79Min: 43.57 / Avg: 157.01 / Max: 182.38Min: 19.01 / Avg: 162.7 / Max: 323.16Min: 26.83 / Avg: 194.1 / Max: 318.58Min: 43.42 / Avg: 196.03 / Max: 231.39Min: 52.99 / Avg: 229.13 / Max: 286.06Min: 29.7 / Avg: 237.41 / Max: 409.16Min: 21.92 / Avg: 239.11 / Max: 377.96Min: 71.42 / Avg: 242.48 / Max: 294.63Min: 72.35 / Avg: 253.17 / Max: 324.27Min: 60.74 / Avg: 255.91 / Max: 343.2Min: 39.64 / Avg: 293.27 / Max: 587.35Min: 105.45 / Avg: 300.28 / Max: 380.11Min: 53.82 / Avg: 332.37 / Max: 634.66Min: 107.92 / Avg: 357 / Max: 473.69Min: 64.39 / Avg: 387.38 / Max: 798.84Min: 63.44 / Avg: 396.77 / Max: 754.62Min: 100.78 / Avg: 417.23 / Max: 578.66Min: 149.89 / Avg: 459.2 / Max: 669.79Min: 179.1 / Avg: 476.05 / Max: 713.49Min: 188.58 / Avg: 496.58 / Max: 737.621. EPYC 8534PN: Approximate power consumption of 1162 Joules per run.2. EPYC 8534P: Approximate power consumption of 1224 Joules per run.3. Xeon 6766E: Approximate power consumption of 3873 Joules per run.4. EPYC 9754: Approximate power consumption of 1247 Joules per run.5. EPYC 9654: Approximate power consumption of 1913 Joules per run.6. Xeon 6780E: Approximate power consumption of 4378 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 4812 Joules per run.8. EPYC 9684X: Approximate power consumption of 2228 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 2829 Joules per run.10. Xeon Max 9468: Approximate power consumption of 4062 Joules per run.11. Xeon Max 9480: Approximate power consumption of 3899 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 3583 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 2327 Joules per run.14. Xeon 6766E 2P: Approximate power consumption of 4384 Joules per run.15. EPYC 9654 2P: Approximate power consumption of 2582 Joules per run.16. Xeon 6780E 2P: Approximate power consumption of 4903 Joules per run.17. EPYC 9684X 2P: Approximate power consumption of 2970 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 3323 Joules per run.19. Xeon Platinum 8380 2P: Approximate power consumption of 5619 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 4854 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 5475 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 5545 Joules per run.

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1EPYC 9684X 2PEPYC 9754EPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8592+EPYC 8534PNXeon Platinum 8380 2PXeon 6780E 2PXeon Platinum 8490HXeon 6766E 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8380Xeon 6780EXeon 6766E13002600390052006500SE +/- 153.85, N = 12SE +/- 17.54, N = 9SE +/- 74.36, N = 13SE +/- 99.42, N = 15SE +/- 25.44, N = 8SE +/- 81.83, N = 13SE +/- 29.52, N = 7SE +/- 20.15, N = 7SE +/- 46.19, N = 12SE +/- 32.01, N = 12SE +/- 0.97, N = 6SE +/- 5.07, N = 6SE +/- 0.82, N = 6SE +/- 29.84, N = 15SE +/- 11.58, N = 15SE +/- 15.23, N = 5SE +/- 1.36, N = 5SE +/- 21.10, N = 15SE +/- 2.91, N = 4SE +/- 9.38, N = 9SE +/- 0.29, N = 3SE +/- 0.46, N = 35915.255747.825446.165365.424993.343798.703423.633340.692872.562709.932683.832659.882455.162132.242108.682071.191915.041771.071590.501181.491088.83979.281. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

x265

OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.6Video Input: Bosphorus 4KXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9684XEPYC 9684X 2PEPYC 9654Xeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8380Xeon Max 9468EPYC 9654 2PEPYC 9754EPYC 8534PEPYC 9754 2PXeon Max 9480 2PEPYC 8534PNXeon Max 9468 2PXeon 6766E 2PXeon 6780EXeon 6766EXeon 6780E 2P918273645SE +/- 0.09, N = 4SE +/- 0.06, N = 4SE +/- 0.11, N = 4SE +/- 0.20, N = 4SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.39, N = 3SE +/- 0.05, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.22, N = 6SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.17, N = 339.3138.9337.8637.0432.1231.9531.7231.4030.8029.7629.0528.8128.1628.1328.1127.9027.7427.2622.0721.3020.2219.551. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
OpenBenchmarking.orgFrames Per Second Per Watt, More Is Betterx265 3.6Video Input: Bosphorus 4KEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EEPYC 9654EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380Xeon 6766E 2PEPYC 9754 2PXeon Max 9480Xeon 6780E 2PXeon Max 9468Xeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P0.07650.1530.22950.3060.38250.3400.3180.2510.2500.2420.2180.1950.1780.1610.1460.1380.1300.1200.1150.1130.1090.1080.1080.1030.0900.0590.059
OpenBenchmarking.orgWatts, Fewer Is Betterx265 3.6CPU Power Consumption MonitorXeon 6766EEPYC 8534PNXeon 6780EEPYC 8534PEPYC 9754EPYC 9654Xeon 6766E 2PEPYC 9684XXeon 6780E 2PXeon Platinum 8380EPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P90180270360450Min: 43.65 / Avg: 80.41 / Max: 103.35Min: 15.46 / Avg: 81.58 / Max: 101.27Min: 43.45 / Avg: 88.07 / Max: 115.63Min: 17.3 / Avg: 88.38 / Max: 113.06Min: 20.91 / Avg: 112.7 / Max: 141.97Min: 28.94 / Avg: 145.28 / Max: 189.25Min: 104.34 / Avg: 160.26 / Max: 184.55Min: 32.43 / Avg: 164.71 / Max: 212.57Min: 105.18 / Avg: 169.56 / Max: 195.88Min: 52.94 / Avg: 203.52 / Max: 247.27Min: 40.31 / Avg: 216.07 / Max: 262.6Min: 34.21 / Avg: 219.3 / Max: 292.58Min: 59.53 / Avg: 234.38 / Max: 293.23Min: 75.63 / Avg: 256.33 / Max: 294.6Min: 72.13 / Avg: 261.62 / Max: 312.67Min: 58.57 / Avg: 267.17 / Max: 327.8Min: 64.95 / Avg: 296.42 / Max: 367.45Min: 99.99 / Avg: 298.87 / Max: 362.74Min: 76.83 / Avg: 359.11 / Max: 458.52Min: 164.29 / Avg: 409.49 / Max: 491.55Min: 195.59 / Avg: 458.96 / Max: 515.27Min: 200.11 / Avg: 471.43 / Max: 532.571. Xeon 6766E: Approximate power consumption of 2734 Joules per run.2. EPYC 8534PN: Approximate power consumption of 2121 Joules per run.3. Xeon 6780E: Approximate power consumption of 2848 Joules per run.4. EPYC 8534P: Approximate power consumption of 2268 Joules per run.5. EPYC 9754: Approximate power consumption of 2893 Joules per run.6. EPYC 9654: Approximate power consumption of 3390 Joules per run.7. Xeon 6766E 2P: Approximate power consumption of 5075 Joules per run.8. EPYC 9684X: Approximate power consumption of 3733 Joules per run.9. Xeon 6780E 2P: Approximate power consumption of 5991 Joules per run.10. Xeon Platinum 8380: Approximate power consumption of 4952 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 5546 Joules per run.12. Xeon Platinum 8592+: Approximate power consumption of 4276 Joules per run.13. Xeon Platinum 8490H: Approximate power consumption of 4746 Joules per run.14. Xeon Max 9468: Approximate power consumption of 6237 Joules per run.15. Xeon Max 9480: Approximate power consumption of 6192 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 6768 Joules per run.17. EPYC 9684X 2P: Approximate power consumption of 6917 Joules per run.18. Xeon Platinum 8380 2P: Approximate power consumption of 7173 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 7092 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 8702 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 12086 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 12100 Joules per run.

Timed FFmpeg Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 7.0Time To CompileXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PEPYC 9754 2PXeon Platinum 8592+EPYC 9754Xeon 6780E 2PXeon Platinum 8490HXeon Max 9480Xeon 6780EXeon 6766E 2PXeon Platinum 8380 2PXeon Max 9468EPYC 8534PXeon 6766EEPYC 8534PNXeon Platinum 8380816243240SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.30, N = 3SE +/- 0.07, N = 3SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 317.3917.8418.0919.5119.9920.0120.4920.7921.2221.3623.2223.3224.0624.8425.2425.7125.9426.4627.5427.8528.4234.29
OpenBenchmarking.orgWatts, Fewer Is BetterTimed FFmpeg Compilation 7.0CPU Power Consumption MonitorEPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EEPYC 9754EPYC 9654Xeon 6766E 2PEPYC 9684XXeon 6780E 2PXeon Platinum 8380Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9754 2PXeon Max 9468Xeon Max 9480EPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P140280420560700Min: 17.2 / Avg: 81.55 / Max: 145.14Min: 43.59 / Avg: 88.1 / Max: 260.1Min: 17.56 / Avg: 90.17 / Max: 171.06Min: 43.39 / Avg: 101.96 / Max: 321.98Min: 21.46 / Avg: 124.42 / Max: 336.98Min: 28.44 / Avg: 151.49 / Max: 345.46Min: 103.98 / Avg: 158.14 / Max: 527.88Min: 32.76 / Avg: 171.98 / Max: 410.22Min: 55.1 / Avg: 172.28 / Max: 647.64Min: 52.91 / Avg: 184.1 / Max: 291.84Min: 34.1 / Avg: 198.27 / Max: 377.58Min: 57.21 / Avg: 220.08 / Max: 376.48Min: 39.64 / Avg: 238.4 / Max: 679.1Min: 74.35 / Avg: 250.86 / Max: 374.99Min: 81.57 / Avg: 251.37 / Max: 376.37Min: 55.22 / Avg: 281.94 / Max: 701.16Min: 98.24 / Avg: 301.65 / Max: 581.66Min: 65.37 / Avg: 314.5 / Max: 819.41Min: 85.35 / Avg: 348.01 / Max: 755.27Min: 157.82 / Avg: 400.67 / Max: 753.15Min: 198.1 / Avg: 467.2 / Max: 752.99Min: 208.48 / Avg: 470.97 / Max: 753.461. EPYC 8534PN: Approximate power consumption of 2963 Joules per run.2. Xeon 6766E: Approximate power consumption of 3172 Joules per run.3. EPYC 8534P: Approximate power consumption of 3186 Joules per run.4. Xeon 6780E: Approximate power consumption of 3331 Joules per run.5. EPYC 9754: Approximate power consumption of 3898 Joules per run.6. EPYC 9654: Approximate power consumption of 4191 Joules per run.7. Xeon 6766E 2P: Approximate power consumption of 5377 Joules per run.8. EPYC 9684X: Approximate power consumption of 4701 Joules per run.9. Xeon 6780E 2P: Approximate power consumption of 5398 Joules per run.10. Xeon Platinum 8380: Approximate power consumption of 7548 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 5618 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 6896 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 6993 Joules per run.14. Xeon Max 9468: Approximate power consumption of 8278 Joules per run.15. Xeon Max 9480: Approximate power consumption of 7876 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 7330 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 9955 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 7863 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 8700 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 10952 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 12459 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 13030 Joules per run.

Pennant

Pennant is an application focused on hydrodynamics on general unstructured meshes in 2D. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: leblancbigEPYC 9684X 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 83803691215SE +/- 0.055800, N = 15SE +/- 0.022246, N = 15SE +/- 0.013568, N = 6SE +/- 0.063684, N = 15SE +/- 0.008354, N = 7SE +/- 0.019069, N = 15SE +/- 0.010204, N = 7SE +/- 0.115724, N = 15SE +/- 0.115702, N = 15SE +/- 0.115723, N = 15SE +/- 0.022698, N = 7SE +/- 0.037316, N = 9SE +/- 0.022393, N = 7SE +/- 0.023904, N = 7SE +/- 0.025580, N = 6SE +/- 0.057580, N = 6SE +/- 0.045713, N = 13SE +/- 0.010812, N = 42.0768352.0843842.1594592.3129772.5273632.5298072.8810993.3604533.6543033.7548354.1827074.7025574.9558655.1141615.9309576.5417686.85271211.8521301. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi
OpenBenchmarking.orgWatts, Fewer Is BetterPennant 1.0.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8592+EPYC 9684XXeon Platinum 8380Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P140280420560700Min: 16.11 / Avg: 95.67 / Max: 145.23Min: 18.14 / Avg: 107.18 / Max: 164.25Min: 20.01 / Avg: 156.67 / Max: 328.66Min: 27.07 / Avg: 170.76 / Max: 330.73Min: 25.17 / Avg: 191.11 / Max: 377.76Min: 33.15 / Avg: 196.35 / Max: 409.53Min: 52.7 / Avg: 215.77 / Max: 289.7Min: 57.31 / Avg: 222.1 / Max: 377.34Min: 74.45 / Avg: 234.93 / Max: 375.6Min: 71.8 / Avg: 241.62 / Max: 375.61Min: 41.42 / Avg: 291.74 / Max: 665.7Min: 54.46 / Avg: 322.18 / Max: 670.5Min: 64.47 / Avg: 342.65 / Max: 753.04Min: 100.92 / Avg: 344.84 / Max: 581.63Min: 63.33 / Avg: 370.49 / Max: 818.97Min: 144.69 / Avg: 414.55 / Max: 753.5Min: 187.85 / Avg: 448.22 / Max: 752.01Min: 191.18 / Avg: 450.17 / Max: 753.291. EPYC 8534PN: Approximate power consumption of 1126 Joules per run.2. EPYC 8534P: Approximate power consumption of 1233 Joules per run.3. EPYC 9754: Approximate power consumption of 1556 Joules per run.4. EPYC 9654: Approximate power consumption of 1537 Joules per run.5. Xeon Platinum 8592+: Approximate power consumption of 1884 Joules per run.6. EPYC 9684X: Approximate power consumption of 1780 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 3560 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 2284 Joules per run.9. Xeon Max 9480: Approximate power consumption of 2416 Joules per run.10. Xeon Max 9468: Approximate power consumption of 2658 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 4279 Joules per run.12. EPYC 9654 2P: Approximate power consumption of 3544 Joules per run.13. Xeon Platinum 8592+ 2P: Approximate power consumption of 3826 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 3525 Joules per run.15. EPYC 9684X 2P: Approximate power consumption of 4026 Joules per run.16. Xeon Platinum 8490H 2P: Approximate power consumption of 4201 Joules per run.17. Xeon Max 9468 2P: Approximate power consumption of 4418 Joules per run.18. Xeon Max 9480 2P: Approximate power consumption of 4437 Joules per run.

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: AlexNetXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8380Xeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Platinum 8592+EPYC 9754EPYC 8534PEPYC 8534PNXeon Max 9480 2PEPYC 9654Xeon 6780EXeon Platinum 8592+ 2PXeon 6766EEPYC 9684XEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon 6780E 2PXeon 6766E 2P1326395265SE +/- 0.08, N = 8SE +/- 0.76, N = 15SE +/- 1.22, N = 15SE +/- 0.05, N = 7SE +/- 0.57, N = 15SE +/- 0.44, N = 15SE +/- 0.33, N = 15SE +/- 0.66, N = 15SE +/- 0.48, N = 15SE +/- 0.05, N = 7SE +/- 0.04, N = 7SE +/- 0.52, N = 15SE +/- 0.18, N = 7SE +/- 0.08, N = 7SE +/- 0.45, N = 15SE +/- 0.07, N = 6SE +/- 0.07, N = 7SE +/- 0.10, N = 6SE +/- 0.17, N = 15SE +/- 0.15, N = 9SE +/- 0.19, N = 5SE +/- 0.12, N = 1556.5348.2843.6742.0537.7637.5737.2635.5035.0834.5134.3533.2132.5631.9930.7629.5626.2319.9219.8818.5918.3416.24
OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: AlexNetEPYC 8534PNEPYC 8534PXeon 6780EXeon 6766EEPYC 9754Xeon Platinum 8490HXeon Platinum 8380Xeon Platinum 8592+EPYC 9654Xeon Max 9468Xeon Max 9480EPYC 9684XXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon 6780E 2PXeon Max 9468 2PXeon 6766E 2PEPYC 9754 2PXeon Max 9480 2PEPYC 9654 2PEPYC 9684X 2P0.12870.25740.38610.51480.64350.5720.5380.4070.4040.3750.3740.3400.2860.2750.2740.2340.1810.1540.1110.1060.0940.0940.0870.0830.0800.0710.065
OpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.16.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8380Xeon Platinum 8592+EPYC 9684XXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P120240360480600Min: 15.49 / Avg: 60.05 / Max: 115.86Min: 16.75 / Avg: 64.2 / Max: 124.93Min: 43.59 / Avg: 73.23 / Max: 123.49Min: 43.45 / Avg: 78.62 / Max: 138.98Min: 19.64 / Avg: 93.48 / Max: 194.83Min: 26.55 / Avg: 118.55 / Max: 230.07Min: 49.46 / Avg: 123.85 / Max: 241.53Min: 26.69 / Avg: 124.1 / Max: 239.48Min: 32.86 / Avg: 144.8 / Max: 258Min: 59.91 / Avg: 151.32 / Max: 308.57Min: 75.83 / Avg: 176.45 / Max: 326.47Min: 73.08 / Avg: 186.7 / Max: 334.25Min: 104 / Avg: 187.73 / Max: 277.66Min: 105.47 / Avg: 195.16 / Max: 299.02Min: 38.63 / Avg: 224.78 / Max: 359.48Min: 97.99 / Avg: 242.28 / Max: 449.95Min: 77.54 / Avg: 276.92 / Max: 490.49Min: 56.56 / Avg: 280.47 / Max: 458.42Min: 62.19 / Avg: 307.72 / Max: 505.41Min: 146.77 / Avg: 355.03 / Max: 612.45Min: 190.72 / Avg: 403 / Max: 643.72Min: 187.03 / Avg: 414.71 / Max: 652.721. EPYC 8534PN: Approximate power consumption of 592 Joules per run.2. EPYC 8534P: Approximate power consumption of 633 Joules per run.3. Xeon 6766E: Approximate power consumption of 793 Joules per run.4. Xeon 6780E: Approximate power consumption of 809 Joules per run.5. EPYC 9754: Approximate power consumption of 910 Joules per run.6. EPYC 9654: Approximate power consumption of 1135 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 1097 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 1109 Joules per run.9. EPYC 9684X: Approximate power consumption of 1489 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 1229 Joules per run.11. Xeon Max 9468: Approximate power consumption of 1494 Joules per run.12. Xeon Max 9480: Approximate power consumption of 1630 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 2666 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 2615 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 2847 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 2277 Joules per run.17. Xeon Platinum 8592+ 2P: Approximate power consumption of 2658 Joules per run.18. EPYC 9654 2P: Approximate power consumption of 3291 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 3590 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 3243 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 3788 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 3981 Joules per run.

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.CEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9754 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 838080K160K240K320K400KSE +/- 1666.53, N = 6SE +/- 1929.89, N = 5SE +/- 1528.09, N = 5SE +/- 1178.78, N = 6SE +/- 2064.71, N = 6SE +/- 560.20, N = 4SE +/- 420.81, N = 4SE +/- 679.14, N = 4SE +/- 126.50, N = 4SE +/- 72.03, N = 4SE +/- 31.76, N = 4SE +/- 33.85, N = 3SE +/- 150.79, N = 3SE +/- 9.58, N = 3SE +/- 67.02, N = 3SE +/- 23.20, N = 3SE +/- 14.31, N = 3SE +/- 11.99, N = 3390520.93256584.67228184.68225311.82214017.18147311.14141954.15135939.25127519.37125191.11109416.4290420.2571245.2669776.4158815.3652745.6452684.9337567.611. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
OpenBenchmarking.orgTotal Mop/s Per Watt, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.CEPYC 9684X 2PEPYC 9684XEPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 9654Xeon Platinum 8592+ 2PEPYC 8534PNXeon Platinum 8592+EPYC 8534PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9480Xeon Platinum 8380 2PXeon Max 9468Xeon Platinum 83802004006008001000916.62882.53649.64590.51567.85547.32515.52441.50411.62393.05275.88251.86243.32240.55229.75203.59189.97151.21
OpenBenchmarking.orgWatts, Fewer Is BetterNAS Parallel Benchmarks 3.4CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8380EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P140280420560700Min: 17.36 / Avg: 119.33 / Max: 138.69Min: 18.23 / Avg: 134.2 / Max: 159.66Min: 22.12 / Avg: 215.95 / Max: 323.68Min: 26 / Avg: 228.74 / Max: 319.02Min: 52.53 / Avg: 248.45 / Max: 283.18Min: 32.04 / Avg: 255.3 / Max: 409.27Min: 26.78 / Avg: 265.82 / Max: 376.59Min: 60.29 / Avg: 296.18 / Max: 370.22Min: 74.98 / Avg: 303.7 / Max: 376.9Min: 73.26 / Avg: 309.61 / Max: 365.04Min: 41.44 / Avg: 376.89 / Max: 668.41Min: 56.6 / Avg: 394.96 / Max: 670.11Min: 63.25 / Avg: 426.04 / Max: 818.12Min: 68.95 / Avg: 442.63 / Max: 754.48Min: 101.91 / Avg: 444.12 / Max: 565.31Min: 158.17 / Avg: 533.96 / Max: 753.09Min: 187.62 / Avg: 558.68 / Max: 751.91Min: 183.64 / Avg: 563.63 / Max: 754.821. EPYC 8534PN: Approximate power consumption of 3898 Joules per run.2. EPYC 8534P: Approximate power consumption of 4339 Joules per run.3. EPYC 9754: Approximate power consumption of 3779 Joules per run.4. EPYC 9654: Approximate power consumption of 3831 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 10766 Joules per run.6. EPYC 9684X: Approximate power consumption of 2936 Joules per run.7. Xeon Platinum 8592+: Approximate power consumption of 5117 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 7701 Joules per run.9. Xeon Max 9480: Approximate power consumption of 7896 Joules per run.10. Xeon Max 9468: Approximate power consumption of 9185 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 7287 Joules per run.12. EPYC 9654 2P: Approximate power consumption of 5529 Joules per run.13. EPYC 9684X 2P: Approximate power consumption of 5113 Joules per run.14. Xeon Platinum 8592+ 2P: Approximate power consumption of 6905 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 9623 Joules per run.16. Xeon Platinum 8490H 2P: Approximate power consumption of 9211 Joules per run.17. Xeon Max 9468 2P: Approximate power consumption of 9637 Joules per run.18. Xeon Max 9480 2P: Approximate power consumption of 9582 Joules per run.

PyBench

This test profile reports the total time of the different average timed test results from PyBench. PyBench reports average test times for different functions such as BuiltinFunctionCalls and NestedForLoops, with this total result providing a rough estimate as to Python's average performance on a given system. This test profile runs PyBench each time for 20 rounds. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test TimesXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PXeon Platinum 8380 2PEPYC 9754 2PXeon Platinum 8380EPYC 9754EPYC 8534PNEPYC 8534PXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2P2004006008001000SE +/- 0.41, N = 4SE +/- 0.48, N = 4SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 1.15, N = 3SE +/- 1.20, N = 3SE +/- 2.08, N = 3SE +/- 2.19, N = 3SE +/- 1.86, N = 3SE +/- 0.33, N = 3SE +/- 1.33, N = 3SE +/- 2.85, N = 3SE +/- 0.58, N = 3SE +/- 2.40, N = 3SE +/- 1.45, N = 3SE +/- 0.58, N = 3SE +/- 0.88, N = 3SE +/- 1.15, N = 3SE +/- 0.33, N = 36916927627637637637657678188188188229719729739749749761005100711171119
OpenBenchmarking.orgWatts, Fewer Is BetterPyBench 2018-02-16CPU Power Consumption MonitorXeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9754Xeon Platinum 8592+EPYC 9654Xeon Platinum 8490HXeon Platinum 8380EPYC 9684XXeon 6766E 2PXeon 6780E 2PXeon Max 9468Xeon Max 9480EPYC 9754 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Max 9468 2PXeon Max 9480 2P60120180240300Min: 43.58 / Avg: 43.95 / Max: 46.08Min: 43.46 / Avg: 45.25 / Max: 46Min: 14.86 / Avg: 47.57 / Max: 53.35Min: 15.93 / Avg: 48.41 / Max: 54.07Min: 19.44 / Avg: 72.53 / Max: 81.29Min: 33.53 / Avg: 85.96 / Max: 134.17Min: 28.15 / Avg: 88.41 / Max: 100.93Min: 58.93 / Avg: 88.45 / Max: 123.25Min: 49.36 / Avg: 92.52 / Max: 101.33Min: 33.11 / Avg: 99.97 / Max: 113.9Min: 103.97 / Avg: 107.3 / Max: 109.09Min: 106.05 / Avg: 107.95 / Max: 109.82Min: 74.61 / Avg: 114.52 / Max: 125.95Min: 83.03 / Avg: 121.48 / Max: 133.99Min: 38.38 / Avg: 175.13 / Max: 196.99Min: 98.37 / Avg: 177.98 / Max: 196.22Min: 79.78 / Avg: 194.14 / Max: 289.01Min: 57.47 / Avg: 207.73 / Max: 239.74Min: 163.51 / Avg: 228.16 / Max: 305.07Min: 65.07 / Avg: 232.2 / Max: 264.86Min: 206.86 / Avg: 276.72 / Max: 343.62Min: 205.54 / Avg: 276.95 / Max: 327.11. Xeon 6766E: Approximate power consumption of 1392 Joules per run.2. Xeon 6780E: Approximate power consumption of 1282 Joules per run.3. EPYC 8534PN: Approximate power consumption of 1332 Joules per run.4. EPYC 8534P: Approximate power consumption of 1339 Joules per run.5. EPYC 9754: Approximate power consumption of 2007 Joules per run.6. Xeon Platinum 8592+: Approximate power consumption of 1762 Joules per run.7. EPYC 9654: Approximate power consumption of 2092 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 1975 Joules per run.9. Xeon Platinum 8380: Approximate power consumption of 2498 Joules per run.10. EPYC 9684X: Approximate power consumption of 2399 Joules per run.11. Xeon 6766E 2P: Approximate power consumption of 3970 Joules per run.12. Xeon 6780E 2P: Approximate power consumption of 3059 Joules per run.13. Xeon Max 9468: Approximate power consumption of 2519 Joules per run.14. Xeon Max 9480: Approximate power consumption of 2713 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 4904 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 4805 Joules per run.17. Xeon Platinum 8592+ 2P: Approximate power consumption of 3980 Joules per run.18. EPYC 9654 2P: Approximate power consumption of 5055 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 5248 Joules per run.20. EPYC 9684X 2P: Approximate power consumption of 5418 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 6088 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 6093 Joules per run.

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: LU.CEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8380 2PXeon Platinum 8490HEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 9468Xeon Platinum 8380130K260K390K520K650KSE +/- 5800.63, N = 15SE +/- 1879.23, N = 6SE +/- 4162.49, N = 6SE +/- 726.00, N = 5SE +/- 1849.65, N = 6SE +/- 2566.89, N = 15SE +/- 789.76, N = 5SE +/- 398.40, N = 5SE +/- 411.20, N = 5SE +/- 441.66, N = 5SE +/- 213.44, N = 5SE +/- 155.95, N = 4SE +/- 130.20, N = 4SE +/- 314.42, N = 4SE +/- 37.04, N = 4SE +/- 274.93, N = 3SE +/- 71.37, N = 3SE +/- 123.65, N = 3588329.32551955.55472931.04455312.09362511.43279397.45269047.28261127.09257384.55246822.52232012.77185954.54135125.15133284.46131606.86130839.12126171.5298557.161. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
OpenBenchmarking.orgTotal Mop/s Per Watt, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: LU.CEPYC 9754 2PEPYC 9684XEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9654EPYC 8534PNXeon Platinum 8592+ 2PEPYC 8534PXeon Platinum 8592+Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480 2PXeon Max 9468 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PXeon Platinum 83804008001200160020001808.531613.951409.221398.791335.181333.711212.351127.301120.43960.89522.54503.44478.19459.15449.46449.20445.10422.75
OpenBenchmarking.orgWatts, Fewer Is BetterNAS Parallel Benchmarks 3.4CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8380Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P130260390520650Min: 17.84 / Avg: 107.92 / Max: 134.69Min: 17.95 / Avg: 118.96 / Max: 149.72Min: 21.38 / Avg: 198.26 / Max: 322.68Min: 26.14 / Avg: 201.73 / Max: 306.76Min: 32.65 / Avg: 224.61 / Max: 370.12Min: 51.86 / Avg: 233.13 / Max: 282.84Min: 26.25 / Avg: 241.46 / Max: 364.07Min: 59.44 / Avg: 268.4 / Max: 328.81Min: 74.49 / Avg: 280.72 / Max: 336.16Min: 76.87 / Avg: 292.98 / Max: 353.23Min: 40.45 / Avg: 325.31 / Max: 668.91Min: 56.83 / Avg: 354.21 / Max: 638.12Min: 65.04 / Avg: 394.59 / Max: 765.59Min: 67.67 / Avg: 403.9 / Max: 715.05Min: 99.57 / Avg: 417.78 / Max: 563.12Min: 157.28 / Avg: 499.73 / Max: 701.36Min: 194.99 / Avg: 537.56 / Max: 710.4Min: 196.19 / Avg: 538.25 / Max: 736.911. EPYC 8534PN: Approximate power consumption of 2230 Joules per run.2. EPYC 8534P: Approximate power consumption of 2439 Joules per run.3. EPYC 9754: Approximate power consumption of 2657 Joules per run.4. EPYC 9654: Approximate power consumption of 2582 Joules per run.5. EPYC 9684X: Approximate power consumption of 2433 Joules per run.6. Xeon Platinum 8380: Approximate power consumption of 5906 Joules per run.7. Xeon Platinum 8592+: Approximate power consumption of 3525 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 5435 Joules per run.9. Xeon Max 9468: Approximate power consumption of 5989 Joules per run.10. Xeon Max 9480: Approximate power consumption of 6006 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 5248 Joules per run.12. EPYC 9654 2P: Approximate power consumption of 4132 Joules per run.13. EPYC 9684X 2P: Approximate power consumption of 4341 Joules per run.14. Xeon Platinum 8592+ 2P: Approximate power consumption of 5574 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 6893 Joules per run.16. Xeon Platinum 8490H 2P: Approximate power consumption of 7296 Joules per run.17. Xeon Max 9468 2P: Approximate power consumption of 7741 Joules per run.18. Xeon Max 9480 2P: Approximate power consumption of 7536 Joules per run.

ASTC Encoder

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: ThoroughEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PXeon 6780E 2PEPYC 9684XXeon Max 9468 2PXeon 6766E 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon 6780EXeon Max 9480EPYC 8534PXeon 6766EEPYC 8534PNXeon Max 9468Xeon Platinum 8380 2PXeon Platinum 8380306090120150SE +/- 1.20, N = 5SE +/- 1.46, N = 12SE +/- 0.73, N = 15SE +/- 0.55, N = 5SE +/- 0.19, N = 5SE +/- 0.01, N = 5SE +/- 0.03, N = 5SE +/- 0.85, N = 4SE +/- 0.06, N = 5SE +/- 0.05, N = 4SE +/- 0.42, N = 4SE +/- 0.01, N = 4SE +/- 0.05, N = 4SE +/- 0.01, N = 4SE +/- 0.01, N = 3SE +/- 0.03, N = 4SE +/- 0.02, N = 4SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3121.30116.12105.4197.9486.9886.0183.3479.2973.3872.3371.0265.3054.4551.3045.2142.9841.0240.6937.9637.0130.0315.501. (CXX) g++ options: -O3 -flto -pthread
OpenBenchmarking.orgMT/s Per Watt, More Is BetterASTC Encoder 4.7Preset: ThoroughEPYC 9754EPYC 9754 2PEPYC 8534PNEPYC 8534PEPYC 9654EPYC 9684XEPYC 9654 2PEPYC 9684X 2PXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon Platinum 8592+ 2PXeon 6780EXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8380 2PXeon Platinum 83800.11360.22720.34080.45440.5680.5050.4560.3840.3590.3380.3300.3190.3160.3100.2990.2900.2620.2590.2440.2140.2030.1790.1640.1530.1390.0740.068
OpenBenchmarking.orgWatts, Fewer Is BetterASTC Encoder 4.7CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EEPYC 9654EPYC 9684XXeon Platinum 8592+Xeon Platinum 8380Xeon 6766E 2PXeon Platinum 8490HXeon Max 9480Xeon 6780E 2PXeon Max 9468EPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P130260390520650Min: 15.09 / Avg: 98.95 / Max: 145.65Min: 15.96 / Avg: 114.12 / Max: 173.87Min: 43.64 / Avg: 140.53 / Max: 230.96Min: 20.4 / Avg: 170.2 / Max: 353.81Min: 43.44 / Avg: 174.24 / Max: 297.52Min: 28.71 / Avg: 193.35 / Max: 335.29Min: 33.53 / Avg: 222.24 / Max: 407.18Min: 34.05 / Avg: 223.18 / Max: 369.47Min: 49.99 / Avg: 228.75 / Max: 289.57Min: 103.99 / Avg: 228.94 / Max: 433.24Min: 60.85 / Avg: 239.45 / Max: 374.18Min: 78.02 / Avg: 261.71 / Max: 374.53Min: 106.82 / Avg: 264.73 / Max: 530.48Min: 72.98 / Avg: 265.38 / Max: 375.06Min: 38.72 / Avg: 265.99 / Max: 577.68Min: 55.87 / Avg: 330.17 / Max: 623.66Min: 63.05 / Avg: 367.67 / Max: 734.43Min: 76.68 / Avg: 373.98 / Max: 732.13Min: 99.18 / Avg: 403.9 / Max: 572.69Min: 147.85 / Avg: 428.35 / Max: 731.41Min: 195.71 / Avg: 466.49 / Max: 741.06Min: 204.94 / Avg: 472.75 / Max: 744.211. EPYC 8534PN: Approximate power consumption of 2177 Joules per run.2. EPYC 8534P: Approximate power consumption of 2368 Joules per run.3. Xeon 6766E: Approximate power consumption of 3185 Joules per run.4. EPYC 9754: Approximate power consumption of 2485 Joules per run.5. Xeon 6780E: Approximate power consumption of 3601 Joules per run.6. EPYC 9654: Approximate power consumption of 3045 Joules per run.7. EPYC 9684X: Approximate power consumption of 3245 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 3961 Joules per run.9. Xeon Platinum 8380: Approximate power consumption of 9226 Joules per run.10. Xeon 6766E 2P: Approximate power consumption of 4293 Joules per run.11. Xeon Platinum 8490H: Approximate power consumption of 4430 Joules per run.12. Xeon Max 9480: Approximate power consumption of 5300 Joules per run.13. Xeon 6780E 2P: Approximate power consumption of 4567 Joules per run.14. Xeon Max 9468: Approximate power consumption of 5838 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 3830 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 4600 Joules per run.17. EPYC 9684X 2P: Approximate power consumption of 5025 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 5161 Joules per run.19. Xeon Platinum 8380 2P: Approximate power consumption of 10501 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 6425 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 6904 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 7446 Joules per run.

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: IS.DEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 8534PEPYC 8534PNXeon Platinum 83803K6K9K12K15KSE +/- 119.22, N = 6SE +/- 76.70, N = 10SE +/- 85.04, N = 8SE +/- 155.00, N = 15SE +/- 29.95, N = 5SE +/- 35.67, N = 5SE +/- 17.53, N = 5SE +/- 8.92, N = 4SE +/- 23.92, N = 4SE +/- 4.96, N = 4SE +/- 12.99, N = 4SE +/- 8.35, N = 4SE +/- 18.08, N = 4SE +/- 15.55, N = 4SE +/- 6.56, N = 3SE +/- 9.85, N = 4SE +/- 14.39, N = 4SE +/- 11.05, N = 312296.2710139.699771.417437.816346.155702.135229.414059.703960.283819.833816.703345.453076.663050.162865.722746.202718.942266.321. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
OpenBenchmarking.orgTotal Mop/s Per Watt, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: IS.DEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9684XEPYC 9754 2PEPYC 9654EPYC 8534PNEPYC 8534PXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Platinum 8380Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P81624324036.45435.30232.06332.04531.78029.66727.81825.26018.33218.03011.90911.81411.70710.7388.6468.3607.3337.258
OpenBenchmarking.orgWatts, Fewer Is BetterNAS Parallel Benchmarks 3.4CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8380Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P130260390520650Min: 9.26 / Avg: 97.74 / Max: 132.42Min: 19.1 / Avg: 108.72 / Max: 150.47Min: 20.68 / Avg: 156.42 / Max: 284.24Min: 25.79 / Avg: 176.27 / Max: 304.26Min: 32.82 / Avg: 198.04 / Max: 362.78Min: 54.69 / Avg: 211.05 / Max: 280.75Min: 25.68 / Avg: 225.16 / Max: 371.3Min: 60.58 / Avg: 242.56 / Max: 344.06Min: 75.18 / Avg: 256.12 / Max: 347.73Min: 75.39 / Avg: 262.81 / Max: 362.43Min: 41.36 / Avg: 307.47 / Max: 647.96Min: 54.94 / Avg: 316.24 / Max: 616.93Min: 66.48 / Avg: 348.31 / Max: 715.01Min: 103.51 / Avg: 386.95 / Max: 547.42Min: 67.06 / Avg: 405.72 / Max: 726.27Min: 145.91 / Avg: 473.71 / Max: 694.3Min: 196.72 / Avg: 520.51 / Max: 703.63Min: 196.74 / Avg: 526.3 / Max: 723.611. EPYC 8534PN: Approximate power consumption of 1882 Joules per run.2. EPYC 8534P: Approximate power consumption of 2066 Joules per run.3. EPYC 9754: Approximate power consumption of 2065 Joules per run.4. EPYC 9654: Approximate power consumption of 2433 Joules per run.5. EPYC 9684X: Approximate power consumption of 2574 Joules per run.6. Xeon Platinum 8380: Approximate power consumption of 5065 Joules per run.7. Xeon Platinum 8592+: Approximate power consumption of 3603 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 5094 Joules per run.9. Xeon Max 9468: Approximate power consumption of 5250 Joules per run.10. Xeon Max 9480: Approximate power consumption of 5322 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 5073 Joules per run.12. EPYC 9654 2P: Approximate power consumption of 3637 Joules per run.13. EPYC 9684X 2P: Approximate power consumption of 3890 Joules per run.14. Xeon Platinum 8380 2P: Approximate power consumption of 6675 Joules per run.15. Xeon Platinum 8592+ 2P: Approximate power consumption of 5869 Joules per run.16. Xeon Platinum 8490H 2P: Approximate power consumption of 8290 Joules per run.17. Xeon Max 9468 2P: Approximate power consumption of 8588 Joules per run.18. Xeon Max 9480 2P: Approximate power consumption of 8684 Joules per run.

Timed Mesa Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Mesa Compilation 24.0Time To CompileXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8490HEPYC 9754 2PXeon Max 9480EPYC 9754Xeon Max 9468EPYC 8534PXeon Platinum 8380 2PEPYC 8534PNXeon 6780EXeon 6780E 2PXeon Platinum 8380Xeon 6766E 2PXeon 6766E612182430SE +/- 0.05, N = 4SE +/- 0.08, N = 4SE +/- 0.02, N = 4SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.17, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 316.1816.4016.4116.6716.9617.2618.1418.2918.4719.2319.5619.6519.9120.1821.0421.4421.5323.4123.4623.6625.8825.89
OpenBenchmarking.orgWatts, Fewer Is BetterTimed Mesa Compilation 24.0CPU Power Consumption MonitorXeon 6766EEPYC 8534PNEPYC 8534PXeon 6780EEPYC 9754EPYC 9654Xeon 6766E 2PXeon 6780E 2PEPYC 9684XXeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8592+EPYC 9754 2PXeon Max 9480Xeon Max 9468EPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P140280420560700Min: 43.62 / Avg: 71.87 / Max: 255.49Min: 16.52 / Avg: 73.01 / Max: 143.27Min: 18.48 / Avg: 79 / Max: 166.34Min: 43.31 / Avg: 79.63 / Max: 313.34Min: 20.4 / Avg: 109.13 / Max: 324.24Min: 27.72 / Avg: 132.61 / Max: 328.77Min: 104.21 / Avg: 137.28 / Max: 498.1Min: 106.87 / Avg: 146.41 / Max: 572.5Min: 33.71 / Avg: 153.28 / Max: 411.05Min: 52.69 / Avg: 166.64 / Max: 291.22Min: 57 / Avg: 172.35 / Max: 378.42Min: 32.86 / Avg: 176.64 / Max: 377.39Min: 41.25 / Avg: 215.57 / Max: 638.97Min: 73.22 / Avg: 228.31 / Max: 375.9Min: 74.89 / Avg: 232.74 / Max: 375.37Min: 53.33 / Avg: 251.26 / Max: 671.83Min: 99.18 / Avg: 266.43 / Max: 584.3Min: 65.81 / Avg: 287.81 / Max: 802.37Min: 82.26 / Avg: 324.23 / Max: 753.39Min: 171.78 / Avg: 374.89 / Max: 753.6Min: 195.35 / Avg: 442.47 / Max: 753.73Min: 199.11 / Avg: 446.38 / Max: 751.991. Xeon 6766E: Approximate power consumption of 2324 Joules per run.2. EPYC 8534PN: Approximate power consumption of 2044 Joules per run.3. EPYC 8534P: Approximate power consumption of 2159 Joules per run.4. Xeon 6780E: Approximate power consumption of 2389 Joules per run.5. EPYC 9754: Approximate power consumption of 2874 Joules per run.6. EPYC 9654: Approximate power consumption of 3050 Joules per run.7. Xeon 6766E 2P: Approximate power consumption of 4484 Joules per run.8. Xeon 6780E 2P: Approximate power consumption of 4392 Joules per run.9. EPYC 9684X: Approximate power consumption of 3474 Joules per run.10. Xeon Platinum 8380: Approximate power consumption of 4944 Joules per run.11. Xeon Platinum 8490H: Approximate power consumption of 5343 Joules per run.12. Xeon Platinum 8592+: Approximate power consumption of 4063 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 5605 Joules per run.14. Xeon Max 9480: Approximate power consumption of 5860 Joules per run.15. Xeon Max 9468: Approximate power consumption of 5974 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 5402 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 7282 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 6260 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 7052 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 9247 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 10619 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 10862 Joules per run.

Xcompact3d Incompact3d

Xcompact3d Incompact3d is a Fortran-MPI based, finite difference high-performance code for solving the incompressible Navier-Stokes equation and as many as you need scalar transport equations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: input.i3d 193 Cells Per DirectionEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9684XXeon Max 9468 2PEPYC 9654EPYC 9754Xeon Platinum 8592+Xeon Platinum 8380 2PXeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 8380612182430SE +/- 0.00891960, N = 5SE +/- 0.04312156, N = 5SE +/- 0.01633300, N = 4SE +/- 0.03329814, N = 5SE +/- 0.04312801, N = 5SE +/- 0.05695382, N = 15SE +/- 0.05847189, N = 6SE +/- 0.01741826, N = 5SE +/- 0.06577912, N = 5SE +/- 0.03951909, N = 5SE +/- 0.02923582, N = 4SE +/- 0.02691998, N = 4SE +/- 0.01708632, N = 4SE +/- 0.01004100, N = 4SE +/- 0.04445674, N = 4SE +/- 0.01040414, N = 3SE +/- 0.10237421, N = 3SE +/- 0.01216869, N = 33.753199014.260785964.510618935.391259676.391698176.663875106.881212797.293491178.253835118.8722591410.1967066011.2498016012.7997582012.9293413013.9692376020.9379139021.1780307023.970828401. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
OpenBenchmarking.orgWatts, Fewer Is BetterXcompact3d Incompact3d 2021-03-11CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8380Xeon Platinum 8592+EPYC 9684XXeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9754 2PEPYC 9654 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P140280420560700Min: 17.28 / Avg: 114.52 / Max: 138.44Min: 19.02 / Avg: 124.9 / Max: 149.76Min: 22.21 / Avg: 200.17 / Max: 312.99Min: 30.56 / Avg: 216.15 / Max: 325.7Min: 53.04 / Avg: 237.24 / Max: 284.02Min: 24.14 / Avg: 251.56 / Max: 369.25Min: 34.54 / Avg: 254.46 / Max: 403.7Min: 58.88 / Avg: 278.29 / Max: 373.12Min: 77.21 / Avg: 283.32 / Max: 372.73Min: 75.94 / Avg: 288.56 / Max: 366.2Min: 40.05 / Avg: 313.08 / Max: 632.39Min: 57.92 / Avg: 371 / Max: 659.72Min: 100.46 / Avg: 415.93 / Max: 564.56Min: 78.61 / Avg: 426.75 / Max: 741.39Min: 64.22 / Avg: 431.35 / Max: 814.6Min: 151.7 / Avg: 495.02 / Max: 746.22Min: 187.55 / Avg: 524.04 / Max: 746.57Min: 196.28 / Avg: 524.59 / Max: 749.741. EPYC 8534PN: Approximate power consumption of 3016 Joules per run.2. EPYC 8534P: Approximate power consumption of 3289 Joules per run.3. EPYC 9754: Approximate power consumption of 3043 Joules per run.4. EPYC 9654: Approximate power consumption of 2983 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 6722 Joules per run.6. Xeon Platinum 8592+: Approximate power consumption of 4025 Joules per run.7. EPYC 9684X: Approximate power consumption of 3138 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 5148 Joules per run.9. Xeon Max 9480: Approximate power consumption of 5171 Joules per run.10. Xeon Max 9468: Approximate power consumption of 5483 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 6105 Joules per run.12. EPYC 9654 2P: Approximate power consumption of 4897 Joules per run.13. Xeon Platinum 8380 2P: Approximate power consumption of 7175 Joules per run.14. Xeon Platinum 8592+ 2P: Approximate power consumption of 6231 Joules per run.15. EPYC 9684X 2P: Approximate power consumption of 5435 Joules per run.16. Xeon Platinum 8490H 2P: Approximate power consumption of 7128 Joules per run.17. Xeon Max 9468 2P: Approximate power consumption of 7441 Joules per run.18. Xeon Max 9480 2P: Approximate power consumption of 7379 Joules per run.

Y-Cruncher

Y-Cruncher is a multi-threaded Pi benchmark capable of computing Pi to trillions of digits. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 1BXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 9654EPYC 9754Xeon Platinum 8490HXeon 6780E 2PEPYC 9684XXeon Platinum 8380 2PEPYC 9754 2PXeon Max 9480Xeon 6766E 2PEPYC 9654 2PXeon Max 9468EPYC 9684X 2PEPYC 8534PXeon 6780EEPYC 8534PNXeon Platinum 8380Xeon 6766E3691215SE +/- 0.007, N = 6SE +/- 0.010, N = 6SE +/- 0.142, N = 12SE +/- 0.122, N = 15SE +/- 0.030, N = 5SE +/- 0.008, N = 5SE +/- 0.007, N = 4SE +/- 0.005, N = 5SE +/- 0.002, N = 4SE +/- 0.008, N = 4SE +/- 0.010, N = 5SE +/- 0.049, N = 4SE +/- 0.026, N = 5SE +/- 0.007, N = 4SE +/- 0.012, N = 4SE +/- 0.045, N = 5SE +/- 0.012, N = 4SE +/- 0.005, N = 4SE +/- 0.020, N = 4SE +/- 0.001, N = 4SE +/- 0.011, N = 4SE +/- 0.018, N = 45.0085.1106.2666.3346.7016.7436.9287.0477.4687.4717.7447.9157.9597.9678.1968.3008.99210.20510.38610.42710.71211.198
OpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.3CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EEPYC 9654Xeon Platinum 8380Xeon Platinum 8592+EPYC 9684XXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon 6766E 2PEPYC 9754 2PXeon 6780E 2PEPYC 9654 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P130260390520650Min: 16.4 / Avg: 94.34 / Max: 147.45Min: 16.07 / Avg: 105.12 / Max: 171.94Min: 43.6 / Avg: 141.11 / Max: 252.27Min: 21.57 / Avg: 148.59 / Max: 323.95Min: 43.37 / Avg: 168.68 / Max: 308.71Min: 28.49 / Avg: 178.56 / Max: 342.72Min: 53.53 / Avg: 195.15 / Max: 284.61Min: 32.02 / Avg: 198.74 / Max: 364.57Min: 32.32 / Avg: 212.59 / Max: 399.38Min: 30.38 / Avg: 222.94 / Max: 366.15Min: 73.1 / Avg: 254.54 / Max: 371.3Min: 76.02 / Avg: 255.33 / Max: 373.96Min: 104.12 / Avg: 272.77 / Max: 508.32Min: 40.66 / Avg: 284.7 / Max: 529.69Min: 105.25 / Avg: 293.09 / Max: 598.55Min: 58.9 / Avg: 351.79 / Max: 591.63Min: 98.98 / Avg: 352.71 / Max: 555.83Min: 76.49 / Avg: 362.82 / Max: 745.4Min: 66.34 / Avg: 404.17 / Max: 643.66Min: 166.8 / Avg: 424.33 / Max: 738.75Min: 193.6 / Avg: 493.66 / Max: 748.88Min: 191.23 / Avg: 496.54 / Max: 748.221. EPYC 8534PN: Approximate power consumption of 1793 Joules per run.2. EPYC 8534P: Approximate power consumption of 1971 Joules per run.3. Xeon 6766E: Approximate power consumption of 2646 Joules per run.4. EPYC 9754: Approximate power consumption of 2489 Joules per run.5. Xeon 6780E: Approximate power consumption of 2952 Joules per run.6. EPYC 9654: Approximate power consumption of 2714 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 3415 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 2584 Joules per run.9. EPYC 9684X: Approximate power consumption of 3295 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 3121 Joules per run.11. Xeon Max 9480: Approximate power consumption of 3564 Joules per run.12. Xeon Max 9468: Approximate power consumption of 3626 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 4569 Joules per run.14. EPYC 9754 2P: Approximate power consumption of 5409 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 4836 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 5980 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 5220 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 4535 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 7275 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 5587 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 6747 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 6720 Joules per run.

Timed ImageMagick Compilation

This test times how long it takes to build ImageMagick. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed ImageMagick Compilation 6.9.0Time To CompileXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9684XXeon Platinum 8592+EPYC 9654 2PXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9480EPYC 9754 2PXeon Max 9468Xeon Platinum 8380 2PEPYC 9754EPYC 8534PEPYC 8534PNXeon Platinum 8380Xeon 6780E 2PXeon 6780EXeon 6766E 2PXeon 6766E510152025SE +/- 0.03, N = 4SE +/- 0.04, N = 4SE +/- 0.06, N = 4SE +/- 0.10, N = 4SE +/- 0.04, N = 4SE +/- 0.13, N = 4SE +/- 0.09, N = 4SE +/- 0.07, N = 4SE +/- 0.11, N = 4SE +/- 0.10, N = 4SE +/- 0.06, N = 4SE +/- 0.02, N = 4SE +/- 0.15, N = 4SE +/- 0.13, N = 4SE +/- 0.08, N = 4SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 311.4911.7212.2012.6012.7513.2613.4714.0914.4014.7215.3815.8116.0816.3316.3917.9218.1818.8418.8519.2020.5920.91
OpenBenchmarking.orgWatts, Fewer Is BetterTimed ImageMagick Compilation 6.9.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon 6766E 2PEPYC 9684XXeon 6780E 2PXeon Platinum 8380Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9754 2PXeon Max 9480Xeon Max 9468EPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P130260390520650Min: 16.43 / Avg: 65.12 / Max: 142.84Min: 17.83 / Avg: 69.48 / Max: 164.08Min: 43.53 / Avg: 69.56 / Max: 253.22Min: 43.41 / Avg: 74.98 / Max: 300.96Min: 21.44 / Avg: 97.43 / Max: 329.22Min: 28.39 / Avg: 120.39 / Max: 332.54Min: 103.94 / Avg: 137.3 / Max: 386.07Min: 32.48 / Avg: 139.23 / Max: 409.7Min: 107.23 / Avg: 143.22 / Max: 459.28Min: 51.29 / Avg: 152.46 / Max: 291.86Min: 26.01 / Avg: 162.46 / Max: 377Min: 60.5 / Avg: 186.22 / Max: 378.44Min: 40.62 / Avg: 204.88 / Max: 561.52Min: 75.62 / Avg: 220.24 / Max: 379.25Min: 73.52 / Avg: 220.79 / Max: 376.49Min: 57.57 / Avg: 245.77 / Max: 578.82Min: 97.82 / Avg: 252.21 / Max: 581.41Min: 62.42 / Avg: 273.56 / Max: 669.18Min: 81.81 / Avg: 295.33 / Max: 748.04Min: 164.76 / Avg: 362.03 / Max: 752.14Min: 198.51 / Avg: 429.23 / Max: 750.07Min: 203.42 / Avg: 435.59 / Max: 750.991. EPYC 8534PN: Approximate power consumption of 1997 Joules per run.2. EPYC 8534P: Approximate power consumption of 2084 Joules per run.3. Xeon 6766E: Approximate power consumption of 2342 Joules per run.4. Xeon 6780E: Approximate power consumption of 2349 Joules per run.5. EPYC 9754: Approximate power consumption of 2655 Joules per run.6. EPYC 9654: Approximate power consumption of 2769 Joules per run.7. Xeon 6766E 2P: Approximate power consumption of 4714 Joules per run.8. EPYC 9684X: Approximate power consumption of 3028 Joules per run.9. Xeon 6780E 2P: Approximate power consumption of 4535 Joules per run.10. Xeon Platinum 8380: Approximate power consumption of 4421 Joules per run.11. Xeon Platinum 8592+: Approximate power consumption of 3371 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 4423 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 5532 Joules per run.14. Xeon Max 9480: Approximate power consumption of 5286 Joules per run.15. Xeon Max 9468: Approximate power consumption of 5409 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 5591 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 6305 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 6018 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 6054 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 8236 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 9765 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 10019 Joules per run.

m-queens

A solver for the N-queens problem with multi-threading support via the OpenMP library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterm-queens 1.2Time To SolveEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon 6780E 2PXeon 6766E 2PEPYC 9754EPYC 9684XXeon Platinum 8592+ 2PEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon 6780EXeon Max 9468 2PXeon 6766EXeon Platinum 8380 2PEPYC 8534PXeon Platinum 8592+EPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8380612182430SE +/- 0.031, N = 8SE +/- 0.064, N = 15SE +/- 0.093, N = 15SE +/- 0.034, N = 7SE +/- 0.035, N = 7SE +/- 0.021, N = 6SE +/- 0.025, N = 6SE +/- 0.028, N = 6SE +/- 0.019, N = 6SE +/- 0.021, N = 6SE +/- 0.028, N = 5SE +/- 0.032, N = 5SE +/- 0.021, N = 5SE +/- 0.039, N = 5SE +/- 0.066, N = 4SE +/- 0.019, N = 4SE +/- 0.030, N = 4SE +/- 0.029, N = 4SE +/- 0.025, N = 4SE +/- 0.035, N = 3SE +/- 0.031, N = 3SE +/- 0.023, N = 33.9814.1334.6095.5126.0456.3506.9507.4027.7387.8819.28510.30110.84011.47912.39013.25014.25714.49315.21118.10221.03024.1751. (CXX) g++ options: -fopenmp -O2 -march=native
OpenBenchmarking.orgWatts, Fewer Is Betterm-queens 1.2CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754EPYC 9654Xeon 6780EXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8490HEPYC 9684XXeon Platinum 8592+EPYC 9754 2PXeon 6766E 2PEPYC 9654 2PXeon 6780E 2PEPYC 9684X 2PXeon Platinum 8380 2PXeon Max 9468 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2P140280420560700Min: 15.51 / Avg: 106.99 / Max: 136.77Min: 19.39 / Avg: 122.5 / Max: 158.25Min: 43.69 / Avg: 180.19 / Max: 242.1Min: 20.79 / Avg: 202.95 / Max: 326.11Min: 28.35 / Avg: 221.83 / Max: 330.6Min: 43.54 / Avg: 226.9 / Max: 315.05Min: 54.03 / Avg: 238.8 / Max: 290.84Min: 75.51 / Avg: 241.11 / Max: 276.68Min: 77.06 / Avg: 260.39 / Max: 302.34Min: 62.12 / Avg: 266.4 / Max: 324.62Min: 31.01 / Avg: 267.9 / Max: 411.07Min: 32.66 / Avg: 278.57 / Max: 374.34Min: 41.4 / Avg: 316.2 / Max: 657.62Min: 105.96 / Avg: 317.88 / Max: 500.32Min: 52.18 / Avg: 366.51 / Max: 668.54Min: 108.43 / Avg: 381.31 / Max: 634.03Min: 63.38 / Avg: 412.8 / Max: 820.43Min: 99.79 / Avg: 431.33 / Max: 582.73Min: 201.32 / Avg: 465.55 / Max: 574.13Min: 77.88 / Avg: 481.61 / Max: 753.74Min: 165.88 / Avg: 497.84 / Max: 742.37Min: 180.86 / Avg: 502.47 / Max: 745.731. EPYC 8534PN: Approximate power consumption of 1979 Joules per run.2. EPYC 8534P: Approximate power consumption of 2144 Joules per run.3. Xeon 6766E: Approximate power consumption of 2775 Joules per run.4. EPYC 9754: Approximate power consumption of 2097 Joules per run.5. EPYC 9654: Approximate power consumption of 2588 Joules per run.6. Xeon 6780E: Approximate power consumption of 3267 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 6766 Joules per run.8. Xeon Max 9468: Approximate power consumption of 6108 Joules per run.9. Xeon Max 9480: Approximate power consumption of 5728 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 5195 Joules per run.11. EPYC 9684X: Approximate power consumption of 2947 Joules per run.12. Xeon Platinum 8592+: Approximate power consumption of 5154 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 2530 Joules per run.14. Xeon 6766E 2P: Approximate power consumption of 3224 Joules per run.15. EPYC 9654 2P: Approximate power consumption of 3128 Joules per run.16. Xeon 6780E 2P: Approximate power consumption of 3595 Joules per run.17. EPYC 9684X 2P: Approximate power consumption of 3302 Joules per run.18. Xeon Platinum 8380 2P: Approximate power consumption of 7117 Joules per run.19. Xeon Max 9468 2P: Approximate power consumption of 7263 Joules per run.20. Xeon Platinum 8592+ 2P: Approximate power consumption of 5619 Joules per run.21. Xeon Platinum 8490H 2P: Approximate power consumption of 6057 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 6733 Joules per run.

Intel Open Image Denoise

Open Image Denoise is a denoising library for ray-tracing and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-OnlyXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754 2PEPYC 9654 2PXeon Max 9468 2PEPYC 9684X 2PXeon Platinum 8592+Xeon 6780E 2PEPYC 9754Xeon Platinum 8380 2PXeon 6766E 2PEPYC 9654Xeon Platinum 8490HEPYC 9684XXeon Max 9480Xeon Max 9468Xeon 6780EXeon 6766EXeon Platinum 8380EPYC 8534PEPYC 8534PN1.14532.29063.43594.58125.7265SE +/- 0.03, N = 6SE +/- 0.01, N = 6SE +/- 0.02, N = 5SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.02, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.03, N = 6SE +/- 0.00, N = 5SE +/- 0.01, N = 4SE +/- 0.01, N = 4SE +/- 0.00, N = 4SE +/- 0.02, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 35.094.483.663.573.493.493.473.323.313.163.102.972.732.712.662.392.272.111.931.811.801.69
OpenBenchmarking.orgImages / Sec Per Watt, More Is BetterIntel Open Image Denoise 2.2Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-OnlyEPYC 8534PNEPYC 8534PEPYC 9754Xeon Platinum 8592+EPYC 9654Xeon Platinum 8592+ 2PXeon 6766EEPYC 9754 2PXeon Platinum 8490HXeon 6780EEPYC 9684XXeon Platinum 8490H 2PXeon 6780E 2PXeon 6766E 2PEPYC 9654 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480Xeon Max 9468EPYC 9684X 2PXeon Max 9480 2PXeon Max 9468 2P0.00360.00720.01080.01440.0180.0160.0150.0150.0130.0120.0120.0100.0100.0100.0090.0090.0090.0080.0080.0080.0080.0080.0080.0080.0070.0070.006
OpenBenchmarking.orgWatts, Fewer Is BetterIntel Open Image Denoise 2.2CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon Platinum 8380EPYC 9654Xeon 6780EXeon Platinum 8592+Xeon Platinum 8490HEPYC 9684XXeon Max 9480Xeon Max 9468Xeon 6766E 2PEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PXeon 6780E 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Max 9480 2PXeon Max 9468 2P130260390520650Min: 17.42 / Avg: 107.91 / Max: 132.12Min: 18.74 / Avg: 123.7 / Max: 154.19Min: 43.72 / Avg: 199.4 / Max: 250.2Min: 21.62 / Avg: 205.54 / Max: 298.26Min: 52.95 / Avg: 224.45 / Max: 283.1Min: 27.41 / Avg: 233.36 / Max: 317.91Min: 43.54 / Avg: 247.22 / Max: 322.66Min: 26.77 / Avg: 249.97 / Max: 378.66Min: 59.91 / Avg: 268.44 / Max: 367.04Min: 32.55 / Avg: 282.53 / Max: 386.33Min: 76.35 / Avg: 284.74 / Max: 374.26Min: 73.66 / Avg: 286.68 / Max: 372.63Min: 105.15 / Avg: 359.38 / Max: 527.77Min: 40.05 / Avg: 372.52 / Max: 545.78Min: 100.45 / Avg: 406.6 / Max: 560.45Min: 57.66 / Avg: 424.59 / Max: 613.78Min: 108.16 / Avg: 427.37 / Max: 638.82Min: 80.74 / Avg: 440.63 / Max: 738.2Min: 165.7 / Avg: 496.66 / Max: 745.69Min: 63.03 / Avg: 499.92 / Max: 728.7Min: 193.7 / Avg: 538.98 / Max: 749.89Min: 208.03 / Avg: 550.26 / Max: 748.261. EPYC 8534PN: Approximate power consumption of 2446 Joules per run.2. EPYC 8534P: Approximate power consumption of 2680 Joules per run.3. Xeon 6766E: Approximate power consumption of 4088 Joules per run.4. EPYC 9754: Approximate power consumption of 2946 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 4788 Joules per run.6. EPYC 9654: Approximate power consumption of 3675 Joules per run.7. Xeon 6780E: Approximate power consumption of 4759 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 3450 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 4295 Joules per run.10. EPYC 9684X: Approximate power consumption of 4591 Joules per run.11. Xeon Max 9480: Approximate power consumption of 4912 Joules per run.12. Xeon Max 9468: Approximate power consumption of 5089 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 5750 Joules per run.14. EPYC 9754 2P: Approximate power consumption of 4992 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 5855 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 5605 Joules per run.17. Xeon 6780E 2P: Approximate power consumption of 6240 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 4847 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 5877 Joules per run.20. EPYC 9684X 2P: Approximate power consumption of 6699 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 7115 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 7374 Joules per run.

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-OnlyXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754 2PXeon Max 9468 2PEPYC 9654 2PEPYC 9684X 2PXeon 6780E 2PXeon Platinum 8592+EPYC 9754Xeon Platinum 8380 2PXeon 6766E 2PEPYC 9654Xeon Platinum 8490HEPYC 9684XXeon Max 9480Xeon Max 9468Xeon 6780EXeon 6766EXeon Platinum 8380EPYC 8534PEPYC 8534PN1.13182.26363.39544.52725.659SE +/- 0.03, N = 6SE +/- 0.03, N = 6SE +/- 0.04, N = 5SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.00, N = 5SE +/- 0.03, N = 5SE +/- 0.00, N = 5SE +/- 0.02, N = 5SE +/- 0.01, N = 5SE +/- 0.00, N = 4SE +/- 0.01, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 35.034.413.653.593.513.483.453.313.313.123.082.982.732.712.642.382.262.111.931.811.791.69
OpenBenchmarking.orgImages / Sec Per Watt, More Is BetterIntel Open Image Denoise 2.2Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-OnlyEPYC 8534PNEPYC 9754EPYC 8534PXeon Platinum 8592+EPYC 9654Xeon Platinum 8592+ 2PXeon 6766EEPYC 9754 2PXeon Platinum 8490HXeon 6780EEPYC 9684XXeon Platinum 8490H 2PXeon 6780E 2PXeon 6766E 2PEPYC 9654 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480Xeon Max 9468EPYC 9684X 2PXeon Max 9480 2PXeon Max 9468 2P0.00360.00720.01080.01440.0180.0160.0150.0140.0130.0120.0110.0100.0100.0100.0090.0090.0090.0080.0080.0080.0080.0080.0080.0080.0070.0070.006
OpenBenchmarking.orgWatts, Fewer Is BetterIntel Open Image Denoise 2.2CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon Platinum 8380EPYC 9654Xeon 6780EXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 9684XXeon Max 9468Xeon 6766E 2PEPYC 9754 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Max 9480 2PXeon Max 9468 2P130260390520650Min: 17.3 / Avg: 107.16 / Max: 132.19Min: 19.01 / Avg: 124.67 / Max: 154.19Min: 43.68 / Avg: 198.71 / Max: 249.99Min: 21.86 / Avg: 203.92 / Max: 294.28Min: 53.39 / Avg: 224.83 / Max: 282.65Min: 25.93 / Avg: 230.11 / Max: 317.81Min: 43.49 / Avg: 246.81 / Max: 322.99Min: 26.29 / Avg: 249.88 / Max: 378.95Min: 60.35 / Avg: 271.32 / Max: 366.61Min: 76.26 / Avg: 283.96 / Max: 374.08Min: 32.59 / Avg: 284.36 / Max: 386.47Min: 73.14 / Avg: 287.37 / Max: 372.13Min: 104.93 / Avg: 363.85 / Max: 529.39Min: 40.47 / Avg: 369.54 / Max: 546.36Min: 100.7 / Avg: 406.71 / Max: 559.15Min: 107.69 / Avg: 422.71 / Max: 638.83Min: 56.38 / Avg: 425.53 / Max: 615.08Min: 72.33 / Avg: 443.88 / Max: 736.09Min: 177.66 / Avg: 501.77 / Max: 743.78Min: 66.11 / Avg: 502.25 / Max: 723.91Min: 193.14 / Avg: 539.15 / Max: 749.93Min: 203.58 / Avg: 542.52 / Max: 747.251. EPYC 8534PN: Approximate power consumption of 2465 Joules per run.2. EPYC 8534P: Approximate power consumption of 2701 Joules per run.3. Xeon 6766E: Approximate power consumption of 4074 Joules per run.4. EPYC 9754: Approximate power consumption of 2977 Joules per run.5. Xeon Platinum 8380: Approximate power consumption of 4796 Joules per run.6. EPYC 9654: Approximate power consumption of 3682 Joules per run.7. Xeon 6780E: Approximate power consumption of 4751 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 3448 Joules per run.9. Xeon Platinum 8490H: Approximate power consumption of 4273 Joules per run.10. Xeon Max 9480: Approximate power consumption of 4898 Joules per run.11. EPYC 9684X: Approximate power consumption of 4479 Joules per run.12. Xeon Max 9468: Approximate power consumption of 5101 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 5731 Joules per run.14. EPYC 9754 2P: Approximate power consumption of 4878 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 5938 Joules per run.16. Xeon 6780E 2P: Approximate power consumption of 6256 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 5787 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 4883 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 6021 Joules per run.20. EPYC 9684X 2P: Approximate power consumption of 6831 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 7117 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 7270 Joules per run.

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: CG.CXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9654 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 9754 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654EPYC 9754Xeon Platinum 8380 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490HXeon Platinum 8380EPYC 8534PEPYC 8534PN20K40K60K80K100KSE +/- 271.54, N = 6SE +/- 661.05, N = 7SE +/- 779.47, N = 7SE +/- 560.41, N = 15SE +/- 545.92, N = 15SE +/- 328.18, N = 8SE +/- 545.82, N = 5SE +/- 386.70, N = 9SE +/- 178.23, N = 8SE +/- 393.67, N = 15SE +/- 480.71, N = 15SE +/- 28.62, N = 7SE +/- 260.16, N = 15SE +/- 313.88, N = 7SE +/- 243.41, N = 12SE +/- 34.34, N = 6SE +/- 126.79, N = 6SE +/- 207.19, N = 698764.9388487.9184477.7266492.4465396.2263760.4563265.0162071.1058128.2453182.7743799.7838906.1335234.0635116.5533811.6322655.3222229.9421684.801. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
OpenBenchmarking.orgTotal Mop/s Per Watt, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: CG.CXeon Platinum 8592+EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754EPYC 9754 2PEPYC 8534PNEPYC 8534PXeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8380Xeon Platinum 8380 2P90180270360450401.38384.09356.27305.56302.72295.11283.84254.62244.61226.89157.12156.61155.78154.97153.93145.15119.97119.68
OpenBenchmarking.orgWatts, Fewer Is BetterNAS Parallel Benchmarks 3.4CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PEPYC 9654EPYC 9754Xeon Platinum 8592+EPYC 9684XXeon Platinum 8380Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P140280420560700Min: 16.9 / Avg: 88.65 / Max: 135.53Min: 17.31 / Avg: 97.98 / Max: 151Min: 26.59 / Avg: 149.28 / Max: 317.86Min: 19.49 / Avg: 154.31 / Max: 321.83Min: 25.74 / Avg: 158.85 / Max: 377.04Min: 17.06 / Avg: 161.61 / Max: 378.41Min: 52.98 / Avg: 188.84 / Max: 288.7Min: 57.02 / Avg: 215.9 / Max: 374.98Min: 74.58 / Avg: 223.5 / Max: 376.44Min: 71.23 / Avg: 226.18 / Max: 377.45Min: 38.61 / Avg: 248.47 / Max: 653.54Min: 55.55 / Avg: 279.06 / Max: 655.46Min: 58.39 / Avg: 299.85 / Max: 772.2Min: 54.43 / Avg: 323.22 / Max: 766.2Min: 100.01 / Avg: 325.09 / Max: 579.93Min: 146.08 / Avg: 400.48 / Max: 754.34Min: 187.39 / Avg: 424.86 / Max: 754.4Min: 189.85 / Avg: 429.08 / Max: 754.241. EPYC 8534PN: Approximate power consumption of 1064 Joules per run.2. EPYC 8534P: Approximate power consumption of 1143 Joules per run.3. EPYC 9654: Approximate power consumption of 1174 Joules per run.4. EPYC 9754: Approximate power consumption of 1471 Joules per run.5. Xeon Platinum 8592+: Approximate power consumption of 1271 Joules per run.6. EPYC 9684X: Approximate power consumption of 1203 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 2109 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 2015 Joules per run.9. Xeon Max 9468: Approximate power consumption of 2043 Joules per run.10. Xeon Max 9480: Approximate power consumption of 2081 Joules per run.11. EPYC 9754 2P: Approximate power consumption of 4721 Joules per run.12. EPYC 9654 2P: Approximate power consumption of 2551 Joules per run.13. EPYC 9684X 2P: Approximate power consumption of 2656 Joules per run.14. Xeon Platinum 8592+ 2P: Approximate power consumption of 3502 Joules per run.15. Xeon Platinum 8380 2P: Approximate power consumption of 3065 Joules per run.16. Xeon Platinum 8490H 2P: Approximate power consumption of 3604 Joules per run.17. Xeon Max 9468 2P: Approximate power consumption of 3569 Joules per run.18. Xeon Max 9480 2P: Approximate power consumption of 3633 Joules per run.

GNU Octave Benchmark

This test profile measures how long it takes to complete several reference GNU Octave files via octave-benchmark. GNU Octave is used for numerical computations and is an open-source alternative to MATLAB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGNU Octave Benchmark 8.4.0Xeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9684X 2PEPYC 9654Xeon Platinum 8490HXeon Max 9468EPYC 9654 2PXeon Max 9480Xeon Platinum 8490H 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon Platinum 8380Xeon Platinum 8380 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2PXeon Max 9480 2PXeon Max 9468 2P3691215SE +/- 0.020, N = 6SE +/- 0.019, N = 6SE +/- 0.018, N = 6SE +/- 0.007, N = 6SE +/- 0.009, N = 6SE +/- 0.015, N = 6SE +/- 0.015, N = 6SE +/- 0.004, N = 6SE +/- 0.024, N = 6SE +/- 0.019, N = 6SE +/- 0.014, N = 5SE +/- 0.025, N = 5SE +/- 0.011, N = 5SE +/- 0.007, N = 5SE +/- 0.017, N = 5SE +/- 0.052, N = 5SE +/- 0.051, N = 5SE +/- 0.035, N = 5SE +/- 0.108, N = 7SE +/- 0.023, N = 5SE +/- 0.082, N = 5SE +/- 0.096, N = 56.4586.8566.8576.9557.5287.5327.6227.6457.7488.0368.8018.8488.9298.9489.1049.69410.24310.99611.61912.24512.57812.617
OpenBenchmarking.orgWatts, Fewer Is BetterGNU Octave Benchmark 8.4.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8380Xeon Platinum 8592+Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8490HEPYC 9754 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P80160240320400Min: 15.49 / Avg: 47.63 / Max: 72.89Min: 17.25 / Avg: 49.95 / Max: 77.01Min: 43.6 / Avg: 52.88 / Max: 68.56Min: 43.45 / Avg: 55 / Max: 74.81Min: 20.26 / Avg: 67.77 / Max: 105.08Min: 27.81 / Avg: 84.26 / Max: 135.67Min: 34.49 / Avg: 95.8 / Max: 154.31Min: 53.19 / Avg: 97.85 / Max: 151.32Min: 32.85 / Avg: 108.34 / Max: 202.86Min: 103.69 / Avg: 114.72 / Max: 127.74Min: 104.36 / Avg: 116.68 / Max: 139.31Min: 56.04 / Avg: 133.36 / Max: 217.89Min: 40.57 / Avg: 161.36 / Max: 222.38Min: 74.85 / Avg: 164.13 / Max: 237.93Min: 79.51 / Avg: 166.55 / Max: 232.48Min: 99.24 / Avg: 180.92 / Max: 246.72Min: 56.62 / Avg: 189.57 / Max: 270.57Min: 61.74 / Avg: 205.11 / Max: 301.54Min: 167.67 / Avg: 296.93 / Max: 375.38Min: 197.53 / Avg: 371.49 / Max: 456.41Min: 202.03 / Avg: 373.8 / Max: 446.621. EPYC 8534PN: Approximate power consumption of 629 Joules per run.2. EPYC 8534P: Approximate power consumption of 649 Joules per run.3. Xeon 6766E: Approximate power consumption of 793 Joules per run.4. Xeon 6780E: Approximate power consumption of 781 Joules per run.5. EPYC 9754: Approximate power consumption of 867 Joules per run.6. EPYC 9654: Approximate power consumption of 983 Joules per run.7. EPYC 9684X: Approximate power consumption of 1054 Joules per run.8. Xeon Platinum 8380: Approximate power consumption of 1292 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 1156 Joules per run.10. Xeon 6766E 2P: Approximate power consumption of 1858 Joules per run.11. Xeon 6780E 2P: Approximate power consumption of 1817 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 1556 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 2065 Joules per run.14. Xeon Max 9468: Approximate power consumption of 1915 Joules per run.15. Xeon Max 9480: Approximate power consumption of 1971 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 2461 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 2212 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 2256 Joules per run.19. Xeon Platinum 8490H 2P: Approximate power consumption of 3613 Joules per run.20. Xeon Max 9480 2P: Approximate power consumption of 6167 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 6280 Joules per run.

Y-Cruncher

Y-Cruncher is a multi-threaded Pi benchmark capable of computing Pi to trillions of digits. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 500MXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8592+Xeon 6780E 2PXeon 6766E 2PXeon Max 9480Xeon Platinum 8380 2PXeon Max 9468EPYC 9654EPYC 9754EPYC 9754 2PEPYC 9684XEPYC 9654 2PEPYC 9684X 2PXeon 6780EXeon Platinum 8380EPYC 8534PEPYC 8534PNXeon 6766E1.16482.32963.49444.65925.824SE +/- 0.002, N = 8SE +/- 0.004, N = 7SE +/- 0.074, N = 15SE +/- 0.064, N = 15SE +/- 0.003, N = 7SE +/- 0.008, N = 7SE +/- 0.004, N = 6SE +/- 0.004, N = 6SE +/- 0.023, N = 15SE +/- 0.006, N = 7SE +/- 0.010, N = 7SE +/- 0.003, N = 6SE +/- 0.005, N = 6SE +/- 0.015, N = 5SE +/- 0.003, N = 6SE +/- 0.003, N = 5SE +/- 0.007, N = 5SE +/- 0.007, N = 6SE +/- 0.003, N = 6SE +/- 0.006, N = 6SE +/- 0.008, N = 6SE +/- 0.005, N = 62.3642.6592.9613.1103.2673.3913.4113.6293.7043.7243.7813.8503.9684.1004.3124.3294.5104.7704.8745.0775.1655.177
OpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.3CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EEPYC 9654Xeon Platinum 8592+Xeon Platinum 8380EPYC 9684XXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P130260390520650Min: 16.77 / Avg: 78.49 / Max: 143.84Min: 16.15 / Avg: 86.13 / Max: 163.32Min: 43.7 / Avg: 116.04 / Max: 224.06Min: 20.76 / Avg: 118.84 / Max: 272.84Min: 43.46 / Avg: 134.29 / Max: 274.09Min: 27.89 / Avg: 146.25 / Max: 317.02Min: 31.93 / Avg: 151.06 / Max: 346.25Min: 52.29 / Avg: 167.23 / Max: 285.41Min: 32.78 / Avg: 173.58 / Max: 352.72Min: 57.55 / Avg: 181.21 / Max: 363.23Min: 70.98 / Avg: 211.16 / Max: 373.06Min: 74.95 / Avg: 212.09 / Max: 370.6Min: 104.3 / Avg: 221.86 / Max: 497.5Min: 106.12 / Avg: 236.59 / Max: 561.92Min: 37.77 / Avg: 238.41 / Max: 478.35Min: 81.75 / Avg: 285.35 / Max: 686.94Min: 53.19 / Avg: 293.51 / Max: 558.3Min: 97.45 / Avg: 293.71 / Max: 562.12Min: 66.18 / Avg: 327.67 / Max: 622.14Min: 164.95 / Avg: 367.73 / Max: 733.59Min: 189.46 / Avg: 425.51 / Max: 749.34Min: 197.01 / Avg: 434.63 / Max: 747.051. EPYC 8534PN: Approximate power consumption of 942 Joules per run.2. EPYC 8534P: Approximate power consumption of 1062 Joules per run.3. Xeon 6766E: Approximate power consumption of 1334 Joules per run.4. EPYC 9754: Approximate power consumption of 1466 Joules per run.5. Xeon 6780E: Approximate power consumption of 1477 Joules per run.6. EPYC 9654: Approximate power consumption of 1584 Joules per run.7. Xeon Platinum 8592+: Approximate power consumption of 1360 Joules per run.8. Xeon Platinum 8380: Approximate power consumption of 1756 Joules per run.9. EPYC 9684X: Approximate power consumption of 1996 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 1631 Joules per run.11. Xeon Max 9480: Approximate power consumption of 1914 Joules per run.12. Xeon Max 9468: Approximate power consumption of 1939 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 2514 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 2642 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 3385 Joules per run.16. Xeon Platinum 8592+ 2P: Approximate power consumption of 2650 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 3698 Joules per run.18. Xeon Platinum 8380 2P: Approximate power consumption of 2853 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 4063 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 3264 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 4085 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 4143 Joules per run.

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonEPYC 9684X 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754EPYC 9684XXeon Platinum 8490H 2PXeon 6780E 2PXeon 6766E 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8380 2PXeon 6780EXeon Platinum 8490HXeon 6766EXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 838050100150200250SE +/- 2.04, N = 8SE +/- 1.88, N = 7SE +/- 0.26, N = 8SE +/- 1.54, N = 8SE +/- 0.12, N = 7SE +/- 0.07, N = 7SE +/- 0.13, N = 7SE +/- 0.16, N = 7SE +/- 0.10, N = 6SE +/- 0.03, N = 6SE +/- 1.20, N = 15SE +/- 0.63, N = 6SE +/- 0.13, N = 6SE +/- 0.29, N = 6SE +/- 0.05, N = 5SE +/- 0.05, N = 5SE +/- 0.04, N = 5SE +/- 0.11, N = 5SE +/- 0.04, N = 5SE +/- 0.03, N = 5SE +/- 0.05, N = 5SE +/- 0.04, N = 4231.43208.31199.61185.71156.39155.12152.75151.25138.85132.49129.75125.75112.6699.2492.8891.9984.7183.4975.4775.2173.9155.42
OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonEPYC 9754EPYC 9654EPYC 8534PNEPYC 9684XEPYC 9754 2PEPYC 8534PEPYC 9684X 2PXeon 6766EXeon 6780EEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PXeon Platinum 8380Xeon Max 9480 2PXeon Max 9468 2P0.1940.3880.5820.7760.970.8620.7350.7060.6620.6200.6130.5640.5500.5200.5180.5080.4940.4570.4530.4280.3230.3120.2760.2580.2530.2530.246
OpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9654EPYC 9754Xeon Platinum 8490HXeon Platinum 8380Xeon Platinum 8592+EPYC 9684XXeon Max 9480Xeon Max 9468Xeon 6766E 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P140280420560700Min: 16.8 / Avg: 104.66 / Max: 145.45Min: 18.74 / Avg: 122.78 / Max: 171.96Min: 43.66 / Avg: 153.94 / Max: 217.83Min: 43.49 / Avg: 178.58 / Max: 261.5Min: 28.26 / Avg: 180.38 / Max: 335.4Min: 20.65 / Avg: 181.41 / Max: 329.67Min: 60.02 / Avg: 215.03 / Max: 377.71Min: 54.93 / Avg: 219.18 / Max: 290.54Min: 24.21 / Avg: 228.28 / Max: 376.12Min: 31.26 / Avg: 234.18 / Max: 410.22Min: 74.25 / Avg: 267.87 / Max: 377.44Min: 66.39 / Avg: 273.07 / Max: 377.18Min: 105.4 / Avg: 303.74 / Max: 488.69Min: 108.43 / Avg: 333.95 / Max: 567.53Min: 42.62 / Avg: 335.83 / Max: 642.99Min: 55.21 / Avg: 358.56 / Max: 646.17Min: 102.21 / Avg: 383.99 / Max: 581.28Min: 66.59 / Avg: 393.21 / Max: 754.66Min: 59.43 / Avg: 410.15 / Max: 817.39Min: 166.53 / Avg: 472.72 / Max: 754.96Min: 200.84 / Avg: 511.17 / Max: 752.67Min: 185.96 / Avg: 511.91 / Max: 753.561. EPYC 8534PN: Approximate power consumption of 1549 Joules per run.2. EPYC 8534P: Approximate power consumption of 1817 Joules per run.3. Xeon 6766E: Approximate power consumption of 2124 Joules per run.4. Xeon 6780E: Approximate power consumption of 2322 Joules per run.5. EPYC 9654: Approximate power consumption of 2165 Joules per run.6. EPYC 9754: Approximate power consumption of 1762 Joules per run.7. Xeon Platinum 8490H: Approximate power consumption of 3527 Joules per run.8. Xeon Platinum 8380: Approximate power consumption of 4000 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 2625 Joules per run.10. EPYC 9684X: Approximate power consumption of 2241 Joules per run.11. Xeon Max 9480: Approximate power consumption of 3697 Joules per run.12. Xeon Max 9468: Approximate power consumption of 3987 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 3291 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 3483 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 3118 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 3406 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 4800 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 3441 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 3538 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 4795 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 5623 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 5563 Joules per run.

WebP Image Encode

This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Highest CompressionEPYC 9654 2PEPYC 9654EPYC 9684X 2PEPYC 9684XXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9754EPYC 8534PNEPYC 8534PEPYC 9754 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P0.81451.6292.44353.2584.0725SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 53.623.623.623.613.473.463.103.103.093.093.083.073.043.033.033.032.822.812.492.472.232.231. (CC) gcc options: -fvisibility=hidden -O2 -lm
OpenBenchmarking.orgMP/s Per Watt, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Highest CompressionEPYC 8534PNEPYC 8534PXeon 6780EXeon 6766EXeon Platinum 8592+EPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8490HXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon 6780E 2PXeon 6766E 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P0.01620.03240.04860.06480.0810.0720.0690.0560.0510.0510.0490.0480.0440.0350.0330.0280.0260.0230.0210.0210.0200.0190.0190.0170.0140.0110.011
OpenBenchmarking.orgWatts, Fewer Is BetterWebP Image Encode 1.2.4CPU Power Consumption MonitorEPYC 8534PNXeon 6766EXeon 6780EEPYC 8534PEPYC 9754Xeon Platinum 8592+EPYC 9654EPYC 9684XXeon Platinum 8380Xeon Platinum 8490HXeon 6766E 2PXeon 6780E 2PXeon Max 9468Xeon Max 9480EPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P70140210280350Min: 16.53 / Avg: 42.26 / Max: 55.05Min: 43.59 / Avg: 43.93 / Max: 46.02Min: 43.35 / Avg: 44.16 / Max: 45.33Min: 16.45 / Avg: 44.16 / Max: 57.18Min: 20.53 / Avg: 61.84 / Max: 81.06Min: 34.25 / Avg: 68.3 / Max: 101.37Min: 28.98 / Avg: 75.95 / Max: 101.21Min: 32.65 / Avg: 82.63 / Max: 115.67Min: 50.09 / Avg: 86.28 / Max: 102.41Min: 59.48 / Avg: 88.57 / Max: 151.52Min: 103.85 / Avg: 107.03 / Max: 109.06Min: 105.24 / Avg: 107.9 / Max: 111.31Min: 70.24 / Avg: 111.05 / Max: 144.04Min: 81.36 / Avg: 119.53 / Max: 163.62Min: 39.42 / Avg: 149.38 / Max: 197.42Min: 100.4 / Avg: 169.36 / Max: 210.51Min: 56.66 / Avg: 176 / Max: 238.56Min: 74.68 / Avg: 186.13 / Max: 288.17Min: 63.07 / Avg: 192.89 / Max: 262.1Min: 148.59 / Avg: 222.03 / Max: 316.69Min: 200.76 / Avg: 274.15 / Max: 348.74Min: 205.94 / Avg: 277 / Max: 371.071. EPYC 8534PN: Approximate power consumption of 514 Joules per run.2. Xeon 6766E: Approximate power consumption of 659 Joules per run.3. Xeon 6780E: Approximate power consumption of 618 Joules per run.4. EPYC 8534P: Approximate power consumption of 537 Joules per run.5. EPYC 9754: Approximate power consumption of 752 Joules per run.6. Xeon Platinum 8592+: Approximate power consumption of 774 Joules per run.7. EPYC 9654: Approximate power consumption of 810 Joules per run.8. EPYC 9684X: Approximate power consumption of 978 Joules per run.9. Xeon Platinum 8380: Approximate power consumption of 1104 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 1078 Joules per run.11. Xeon 6766E 2P: Approximate power consumption of 1627 Joules per run.12. Xeon 6780E 2P: Approximate power consumption of 1532 Joules per run.13. Xeon Max 9468: Approximate power consumption of 1314 Joules per run.14. Xeon Max 9480: Approximate power consumption of 1434 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 1842 Joules per run.16. Xeon Platinum 8380 2P: Approximate power consumption of 2202 Joules per run.17. EPYC 9654 2P: Approximate power consumption of 1907 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 2109 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 2122 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 2701 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 3336 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 3370 Joules per run.

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon 6780E 2PEPYC 9684XEPYC 9754Xeon Platinum 8490H 2PXeon 6766E 2PXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8380 2PXeon 6780EXeon 6766EXeon Platinum 8490HXeon Max 9480EPYC 8534PXeon Max 9468EPYC 8534PNXeon Platinum 838050100150200250SE +/- 1.23, N = 8SE +/- 1.04, N = 7SE +/- 0.43, N = 7SE +/- 0.07, N = 7SE +/- 0.14, N = 6SE +/- 0.20, N = 7SE +/- 0.64, N = 6SE +/- 0.12, N = 6SE +/- 0.11, N = 6SE +/- 0.48, N = 6SE +/- 0.08, N = 6SE +/- 0.14, N = 6SE +/- 0.05, N = 5SE +/- 0.08, N = 5SE +/- 0.02, N = 5SE +/- 0.05, N = 5SE +/- 0.07, N = 5SE +/- 0.02, N = 4SE +/- 0.04, N = 4SE +/- 0.05, N = 4SE +/- 0.07, N = 4SE +/- 0.07, N = 3214.02190.08176.21153.16133.42130.79126.15124.71121.43116.61110.53107.6382.9782.9281.8373.9670.0565.3362.1958.4258.2843.67
OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownEPYC 9754EPYC 9754 2PEPYC 9684XEPYC 8534PNEPYC 9654EPYC 9684X 2PEPYC 8534PEPYC 9654 2PXeon 6766EXeon 6780EXeon 6766E 2PXeon 6780E 2PXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9480 2PXeon Max 9468Xeon Platinum 8380 2PXeon Max 9468 2PXeon Platinum 83800.14150.2830.42450.5660.70750.6290.5320.5220.5170.4990.4990.4820.4680.4220.3810.3770.3730.3630.3310.2580.2520.2320.2260.2060.2050.2050.192
OpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EEPYC 9754Xeon 6780EEPYC 9654Xeon Platinum 8380EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon 6766E 2PEPYC 9754 2PXeon 6780E 2PEPYC 9654 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P140280420560700Min: 16.58 / Avg: 112.82 / Max: 146.36Min: 17.65 / Avg: 128.92 / Max: 171.09Min: 43.6 / Avg: 175.27 / Max: 236.71Min: 20.38 / Avg: 200.39 / Max: 335.38Min: 43.42 / Avg: 214.8 / Max: 302.74Min: 27.85 / Avg: 221.71 / Max: 341.98Min: 53.87 / Avg: 227.2 / Max: 288.12Min: 32.54 / Avg: 250.47 / Max: 410.99Min: 26.17 / Avg: 250.53 / Max: 384.62Min: 60.79 / Avg: 271.03 / Max: 377.88Min: 75.4 / Avg: 281.67 / Max: 377.64Min: 71.98 / Avg: 284.3 / Max: 376.72Min: 104.47 / Avg: 322.07 / Max: 484.23Min: 39.31 / Avg: 357.16 / Max: 678.39Min: 105.86 / Avg: 357.3 / Max: 564.3Min: 58.37 / Avg: 376.52 / Max: 669.54Min: 102.04 / Avg: 404.97 / Max: 574.07Min: 65.93 / Avg: 422.5 / Max: 748.67Min: 60.99 / Avg: 428.94 / Max: 819.87Min: 171.82 / Avg: 493.94 / Max: 734.13Min: 178.12 / Avg: 516.97 / Max: 755.2Min: 192.27 / Avg: 525.15 / Max: 751.361. EPYC 8534PN: Approximate power consumption of 1946 Joules per run.2. EPYC 8534P: Approximate power consumption of 2159 Joules per run.3. Xeon 6766E: Approximate power consumption of 2594 Joules per run.4. EPYC 9754: Approximate power consumption of 2071 Joules per run.5. Xeon 6780E: Approximate power consumption of 2964 Joules per run.6. EPYC 9654: Approximate power consumption of 2439 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 4923 Joules per run.8. EPYC 9684X: Approximate power consumption of 2576 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 3407 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 4228 Joules per run.11. Xeon Max 9480: Approximate power consumption of 4507 Joules per run.12. Xeon Max 9468: Approximate power consumption of 4975 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 3596 Joules per run.14. EPYC 9754 2P: Approximate power consumption of 3214 Joules per run.15. Xeon 6780E 2P: Approximate power consumption of 3811 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 3389 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 5589 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 4165 Joules per run.19. EPYC 9684X 2P: Approximate power consumption of 3646 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 5433 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 5859 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 6127 Joules per run.

ASTC Encoder

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: MediumXeon Platinum 8592+ 2PEPYC 9754EPYC 9684X 2PEPYC 9684XEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754 2PEPYC 9654Xeon Max 9468 2PXeon 6780E 2PXeon 6766E 2PXeon Platinum 8490HXeon Platinum 8592+Xeon 6780EEPYC 8534PXeon 6766EXeon Max 9480EPYC 8534PNXeon Max 9468Xeon Platinum 8380 2PXeon Platinum 8380120240360480600SE +/- 1.56, N = 7SE +/- 0.39, N = 7SE +/- 3.11, N = 7SE +/- 0.63, N = 7SE +/- 3.54, N = 6SE +/- 2.79, N = 6SE +/- 0.77, N = 6SE +/- 0.52, N = 6SE +/- 0.20, N = 7SE +/- 0.52, N = 6SE +/- 2.01, N = 5SE +/- 1.77, N = 5SE +/- 0.16, N = 6SE +/- 1.17, N = 6SE +/- 0.13, N = 6SE +/- 0.07, N = 6SE +/- 0.18, N = 5SE +/- 0.08, N = 6SE +/- 0.07, N = 6SE +/- 0.03, N = 6SE +/- 2.26, N = 5SE +/- 0.32, N = 4550.02527.80508.09500.77491.53484.55483.10462.24449.11441.65363.38338.15333.99327.78314.62294.62284.46284.33273.67247.30216.97126.441. (CXX) g++ options: -O3 -flto -pthread
OpenBenchmarking.orgMT/s Per Watt, More Is BetterASTC Encoder 4.7Preset: MediumEPYC 9754EPYC 8534PNEPYC 8534PEPYC 9654EPYC 9684XXeon 6766EXeon 6780EEPYC 9754 2PEPYC 9654 2PXeon 6766E 2PXeon 6780E 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9480 2PXeon Max 9468Xeon Max 9468 2PXeon Platinum 8380 2PXeon Platinum 83801.13632.27263.40894.54525.68155.0503.9893.9263.5533.4883.1913.0762.3772.0992.0842.0482.0121.9831.9661.9231.4141.3731.2151.1671.0940.7410.720
OpenBenchmarking.orgWatts, Fewer Is BetterASTC Encoder 4.7CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654EPYC 9684XXeon 6766E 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380Xeon 6780E 2PEPYC 9754 2PXeon Max 9480Xeon Max 9468EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P130260390520650Min: 15.15 / Avg: 68.61 / Max: 143.04Min: 16.05 / Avg: 75.04 / Max: 166.06Min: 43.61 / Avg: 89.14 / Max: 212.79Min: 43.4 / Avg: 102.28 / Max: 269.1Min: 20.85 / Avg: 104.51 / Max: 314.72Min: 27.98 / Avg: 126.4 / Max: 324.02Min: 32.4 / Avg: 143.57 / Max: 393.87Min: 103.94 / Avg: 162.27 / Max: 347.6Min: 26.56 / Avg: 162.88 / Max: 364.95Min: 60.47 / Avg: 173.64 / Max: 368.66Min: 49.69 / Avg: 175.72 / Max: 288.95Min: 105.97 / Avg: 177.44 / Max: 411Min: 38.51 / Avg: 194.48 / Max: 419.92Min: 46.45 / Avg: 207.12 / Max: 368.04Min: 73.51 / Avg: 211.87 / Max: 372.54Min: 57.21 / Avg: 234.22 / Max: 515.92Min: 60.92 / Avg: 258.49 / Max: 596.25Min: 75.77 / Avg: 277.37 / Max: 691.02Min: 94.9 / Avg: 291.19 / Max: 532.11Min: 149.65 / Avg: 342.67 / Max: 671.28Min: 188.21 / Avg: 397.48 / Max: 724.85Min: 202.14 / Avg: 403.63 / Max: 727.091. EPYC 8534PN: Approximate power consumption of 812 Joules per run.2. EPYC 8534P: Approximate power consumption of 876 Joules per run.3. Xeon 6766E: Approximate power consumption of 1194 Joules per run.4. Xeon 6780E: Approximate power consumption of 1279 Joules per run.5. EPYC 9754: Approximate power consumption of 1090 Joules per run.6. EPYC 9654: Approximate power consumption of 1246 Joules per run.7. EPYC 9684X: Approximate power consumption of 1395 Joules per run.8. Xeon 6766E 2P: Approximate power consumption of 2207 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 1819 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 2084 Joules per run.11. Xeon Platinum 8380: Approximate power consumption of 2855 Joules per run.12. Xeon 6780E 2P: Approximate power consumption of 2307 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 2237 Joules per run.14. Xeon Max 9480: Approximate power consumption of 2451 Joules per run.15. Xeon Max 9468: Approximate power consumption of 2613 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 2381 Joules per run.17. EPYC 9684X 2P: Approximate power consumption of 2659 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 2774 Joules per run.19. Xeon Platinum 8380 2P: Approximate power consumption of 3960 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 3712 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 4240 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 4305 Joules per run.

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 12 - Input: Bosphorus 4KEPYC 9654Xeon Platinum 8592+EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 8534PXeon Platinum 8490HEPYC 9684X 2PEPYC 8534PNXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PXeon Platinum 8380Xeon Max 9480 2PXeon 6780EXeon Max 9468 2PXeon 6780E 2PXeon 6766EXeon 6766E 2P4080120160200SE +/- 0.80, N = 7SE +/- 0.20, N = 7SE +/- 1.88, N = 15SE +/- 1.32, N = 6SE +/- 1.41, N = 6SE +/- 0.43, N = 7SE +/- 0.42, N = 7SE +/- 0.71, N = 6SE +/- 0.41, N = 7SE +/- 0.88, N = 6SE +/- 0.78, N = 6SE +/- 0.25, N = 7SE +/- 0.40, N = 7SE +/- 0.61, N = 7SE +/- 1.28, N = 6SE +/- 0.48, N = 6SE +/- 0.97, N = 6SE +/- 0.15, N = 6SE +/- 0.83, N = 5SE +/- 1.07, N = 6SE +/- 0.08, N = 6SE +/- 0.88, N = 5178.52177.86171.22169.23168.78165.75165.50165.09164.25163.80157.36156.52151.72146.10140.76134.07127.55126.59122.09117.68115.35108.501. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 12 - Input: Bosphorus 4KEPYC 8534PNEPYC 8534PEPYC 9754Xeon 6780EEPYC 9654Xeon 6766EEPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380EPYC 9754 2PXeon 6780E 2PXeon 6766E 2PEPYC 9654 2PXeon Max 9480Xeon Max 9468EPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P0.63991.27981.91972.55963.19952.8442.7842.0191.7411.7141.7031.3991.3631.0971.0541.0010.8430.8330.8290.8120.7840.7090.6750.6380.5000.3180.306
OpenBenchmarking.orgWatts, Fewer Is BetterSVT-AV1 2.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8380Xeon 6766E 2PXeon Platinum 8592+Xeon 6780E 2PXeon Platinum 8490HEPYC 9754 2PXeon Max 9468Xeon Max 9480EPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P100200300400500Min: 14.97 / Avg: 55.32 / Max: 108.24Min: 16.3 / Avg: 59.31 / Max: 124.91Min: 43.6 / Avg: 67.73 / Max: 107.71Min: 43.49 / Avg: 72.69 / Max: 125.26Min: 21.46 / Avg: 83.8 / Max: 173.31Min: 25.96 / Avg: 104.16 / Max: 214.25Min: 28.14 / Avg: 118.49 / Max: 228.43Min: 49.17 / Avg: 127.22 / Max: 220.81Min: 104.27 / Avg: 130.28 / Max: 174.4Min: 27.81 / Avg: 130.54 / Max: 271.31Min: 105.73 / Avg: 139.65 / Max: 205.54Min: 58.81 / Avg: 149.76 / Max: 276.69Min: 39.75 / Avg: 168.64 / Max: 285.91Min: 78.53 / Avg: 186.44 / Max: 299.02Min: 70.86 / Avg: 186.8 / Max: 304.11Min: 57.32 / Avg: 206.47 / Max: 350.04Min: 98.84 / Avg: 220.59 / Max: 378.11Min: 64.22 / Avg: 231.05 / Max: 380.24Min: 72.44 / Avg: 245.05 / Max: 463.8Min: 162.99 / Avg: 313.03 / Max: 463.03Min: 206.55 / Avg: 399.09 / Max: 553.52Min: 192.02 / Avg: 400.5 / Max: 567.381. EPYC 8534PN: Approximate power consumption of 599 Joules per run.2. EPYC 8534P: Approximate power consumption of 633 Joules per run.3. Xeon 6766E: Approximate power consumption of 813 Joules per run.4. Xeon 6780E: Approximate power consumption of 824 Joules per run.5. EPYC 9754: Approximate power consumption of 880 Joules per run.6. EPYC 9654: Approximate power consumption of 1012 Joules per run.7. EPYC 9684X: Approximate power consumption of 1202 Joules per run.8. Xeon Platinum 8380: Approximate power consumption of 1336 Joules per run.9. Xeon 6766E 2P: Approximate power consumption of 1668 Joules per run.10. Xeon Platinum 8592+: Approximate power consumption of 1194 Joules per run.11. Xeon 6780E 2P: Approximate power consumption of 1699 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 1540 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 1799 Joules per run.14. Xeon Max 9468: Approximate power consumption of 1944 Joules per run.15. Xeon Max 9480: Approximate power consumption of 1815 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 2078 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 2353 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 2426 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 2381 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 3220 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 5029 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 4873 Joules per run.

libavif avifenc

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6, LosslessXeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8592+EPYC 9654EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9754EPYC 9754 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PEPYC 8534PNXeon Platinum 8380 2PXeon Platinum 8380Xeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P3691215SE +/- 0.031, N = 7SE +/- 0.014, N = 7SE +/- 0.025, N = 7SE +/- 0.010, N = 7SE +/- 0.020, N = 7SE +/- 0.015, N = 7SE +/- 0.022, N = 7SE +/- 0.013, N = 7SE +/- 0.033, N = 6SE +/- 0.045, N = 6SE +/- 0.007, N = 6SE +/- 0.025, N = 6SE +/- 0.035, N = 6SE +/- 0.027, N = 6SE +/- 0.009, N = 6SE +/- 0.011, N = 6SE +/- 0.027, N = 6SE +/- 0.016, N = 6SE +/- 0.010, N = 6SE +/- 0.012, N = 5SE +/- 0.038, N = 5SE +/- 0.054, N = 55.6135.7575.7845.7995.8465.9506.1726.2786.6056.8366.8536.9867.0387.1217.1827.3017.3888.2018.3599.1889.3519.9601. (CXX) g++ options: -O3 -fPIC -lm
OpenBenchmarking.orgWatts, Fewer Is Betterlibavif avifenc 1.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654EPYC 9684XXeon 6766E 2PXeon Platinum 8592+Xeon 6780E 2PXeon Platinum 8380Xeon Platinum 8490HEPYC 9754 2PXeon Max 9480Xeon Max 9468EPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P120240360480600Min: 15.05 / Avg: 53.07 / Max: 124.5Min: 15.99 / Avg: 55.18 / Max: 149.59Min: 43.56 / Avg: 59.76 / Max: 149.48Min: 43.39 / Avg: 64.09 / Max: 183.29Min: 20.4 / Avg: 80.51 / Max: 234.12Min: 27.48 / Avg: 100.34 / Max: 306.84Min: 29.45 / Avg: 115.08 / Max: 342.75Min: 53.34 / Avg: 123.17 / Max: 220.64Min: 26.64 / Avg: 128.43 / Max: 374.81Min: 106.3 / Avg: 128.53 / Max: 249.32Min: 48.9 / Avg: 132.08 / Max: 290.31Min: 61.6 / Avg: 158.79 / Max: 375.47Min: 39.73 / Avg: 165.83 / Max: 352.71Min: 69.76 / Avg: 191.83 / Max: 376.91Min: 74.59 / Avg: 193.8 / Max: 362.37Min: 51.5 / Avg: 198.44 / Max: 459.76Min: 95.62 / Avg: 213.07 / Max: 530.05Min: 61.29 / Avg: 220.4 / Max: 507.64Min: 74.34 / Avg: 248.3 / Max: 649.52Min: 143.68 / Avg: 313.6 / Max: 692.26Min: 196.47 / Avg: 378.09 / Max: 677.18Min: 197.54 / Avg: 390.59 / Max: 684.361. EPYC 8534PN: Approximate power consumption of 610 Joules per run.2. EPYC 8534P: Approximate power consumption of 662 Joules per run.3. Xeon 6766E: Approximate power consumption of 789 Joules per run.4. Xeon 6780E: Approximate power consumption of 790 Joules per run.5. EPYC 9754: Approximate power consumption of 886 Joules per run.6. EPYC 9654: Approximate power consumption of 989 Joules per run.7. EPYC 9684X: Approximate power consumption of 1118 Joules per run.8. Xeon 6766E 2P: Approximate power consumption of 1724 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 1266 Joules per run.10. Xeon 6780E 2P: Approximate power consumption of 1722 Joules per run.11. Xeon Platinum 8380: Approximate power consumption of 1629 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 1633 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 1852 Joules per run.14. Xeon Max 9480: Approximate power consumption of 2046 Joules per run.15. Xeon Max 9468: Approximate power consumption of 2099 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 1956 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 2415 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 2173 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 2448 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 3226 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 4537 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 4362 Joules per run.

ACES DGEMM

This is a multi-threaded DGEMM benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point RateEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9754Xeon Max 9480 2PXeon Max 9468 2PEPYC 9654Xeon 6780E 2PXeon 6766E 2PXeon Platinum 8592+Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480EPYC 8534PEPYC 8534PNXeon Max 9468Xeon 6780EXeon 6766EXeon Platinum 838020406080100SE +/- 0.19, N = 10SE +/- 0.39, N = 9SE +/- 0.10, N = 9SE +/- 0.11, N = 8SE +/- 0.28, N = 7SE +/- 0.40, N = 7SE +/- 0.17, N = 7SE +/- 0.04, N = 7SE +/- 0.06, N = 7SE +/- 0.22, N = 7SE +/- 0.04, N = 6SE +/- 0.03, N = 6SE +/- 0.08, N = 6SE +/- 0.09, N = 5SE +/- 0.09, N = 5SE +/- 0.09, N = 5SE +/- 0.16, N = 5SE +/- 0.10, N = 5SE +/- 0.04, N = 4SE +/- 0.01, N = 4SE +/- 0.01, N = 4SE +/- 0.01, N = 384.6978.5068.8758.2545.9745.2544.9744.6739.3539.0935.2031.4829.1424.9723.5422.5421.8221.0019.7717.8515.9413.491. (CC) gcc options: -O3 -march=native -fopenmp
OpenBenchmarking.orgGFLOP/s Per Watt, More Is BetterACES DGEMM 1.0Sustained Floating-Point RateEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 8534PNEPYC 9684X 2PEPYC 9654EPYC 8534PEPYC 9684XXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8380 2PXeon Platinum 83800.06570.13140.19710.26280.32850.2920.2520.2280.2200.2150.2140.1980.1960.1490.1210.1140.1120.1070.1050.1010.0930.0900.0810.0780.0710.0630.059
OpenBenchmarking.orgWatts, Fewer Is BetterACES DGEMM 1.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8380EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon 6766E 2PEPYC 9754 2PEPYC 9654 2PXeon 6780E 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P140280420560700Min: 16.53 / Avg: 95.47 / Max: 135.35Min: 17.88 / Avg: 109.94 / Max: 158.28Min: 43.57 / Avg: 148.35 / Max: 183.52Min: 43.36 / Avg: 170.6 / Max: 222.09Min: 22.22 / Avg: 178.2 / Max: 342.37Min: 28.2 / Avg: 182.5 / Max: 306.04Min: 52.19 / Avg: 226.98 / Max: 281.28Min: 31.49 / Avg: 230.52 / Max: 409.55Min: 23.09 / Avg: 239.87 / Max: 363.28Min: 53.98 / Avg: 252.19 / Max: 377.52Min: 75.8 / Avg: 276.9 / Max: 361.7Min: 73.75 / Avg: 277.15 / Max: 377.23Min: 104.19 / Avg: 277.33 / Max: 390.75Min: 40.76 / Avg: 290.43 / Max: 650.39Min: 56.61 / Avg: 302.67 / Max: 601.18Min: 106.31 / Avg: 312.9 / Max: 465.14Min: 63.45 / Avg: 364.55 / Max: 774.44Min: 68.08 / Avg: 390.95 / Max: 737.84Min: 99.45 / Avg: 398.61 / Max: 554.79Min: 164.24 / Avg: 453.94 / Max: 741.45Min: 194.98 / Avg: 496.59 / Max: 754.16Min: 193.63 / Avg: 507 / Max: 747.891. EPYC 8534PN: Approximate power consumption of 1432 Joules per run.2. EPYC 8534P: Approximate power consumption of 1605 Joules per run.3. Xeon 6766E: Approximate power consumption of 2782 Joules per run.4. Xeon 6780E: Approximate power consumption of 2900 Joules per run.5. EPYC 9754: Approximate power consumption of 1655 Joules per run.6. EPYC 9654: Approximate power consumption of 1851 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 4842 Joules per run.8. EPYC 9684X: Approximate power consumption of 2141 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 2918 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 3531 Joules per run.11. Xeon Max 9468: Approximate power consumption of 4430 Joules per run.12. Xeon Max 9480: Approximate power consumption of 3991 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 3189 Joules per run.14. EPYC 9754 2P: Approximate power consumption of 1975 Joules per run.15. EPYC 9654 2P: Approximate power consumption of 2220 Joules per run.16. Xeon 6780E 2P: Approximate power consumption of 3390 Joules per run.17. EPYC 9684X 2P: Approximate power consumption of 2592 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 3128 Joules per run.19. Xeon Platinum 8380 2P: Approximate power consumption of 5341 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 4280 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 4611 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 5070 Joules per run.

libavif avifenc

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 10, LosslessXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654EPYC 9654 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 8534PNEPYC 8534PEPYC 9754 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon 6780EXeon 6766EXeon 6780E 2PXeon 6766E 2P246810SE +/- 0.008, N = 8SE +/- 0.015, N = 8SE +/- 0.002, N = 8SE +/- 0.006, N = 8SE +/- 0.006, N = 8SE +/- 0.015, N = 7SE +/- 0.005, N = 7SE +/- 0.006, N = 7SE +/- 0.003, N = 7SE +/- 0.014, N = 7SE +/- 0.028, N = 7SE +/- 0.019, N = 7SE +/- 0.004, N = 7SE +/- 0.010, N = 7SE +/- 0.006, N = 7SE +/- 0.006, N = 7SE +/- 0.008, N = 7SE +/- 0.011, N = 7SE +/- 0.003, N = 6SE +/- 0.009, N = 6SE +/- 0.016, N = 6SE +/- 0.021, N = 64.4564.5794.7704.7924.8294.8674.9164.9234.9435.0745.3115.3175.6625.7345.7355.7405.9065.9196.8497.5077.6038.0941. (CXX) g++ options: -O3 -fPIC -lm
OpenBenchmarking.orgWatts, Fewer Is Betterlibavif avifenc 1.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8592+Xeon Platinum 8380Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8490HEPYC 9754 2PXeon Max 9480Xeon Max 9468EPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P100200300400500Min: 15.19 / Avg: 43.89 / Max: 93.61Min: 15.89 / Avg: 45.79 / Max: 103.55Min: 43.59 / Avg: 50.67 / Max: 89.41Min: 43.45 / Avg: 52.35 / Max: 100.96Min: 20.59 / Avg: 64.93 / Max: 140.09Min: 27.35 / Avg: 79.69 / Max: 177.97Min: 31.1 / Avg: 89.96 / Max: 203.77Min: 26.86 / Avg: 95.6 / Max: 261.18Min: 49.47 / Avg: 100.66 / Max: 234.57Min: 103.88 / Avg: 113.94 / Max: 151.55Min: 106.05 / Avg: 116.77 / Max: 170.77Min: 58.72 / Avg: 130.94 / Max: 271.24Min: 39.49 / Avg: 147.26 / Max: 254.64Min: 72.94 / Avg: 159.29 / Max: 307.76Min: 73.28 / Avg: 159.39 / Max: 303.29Min: 54.59 / Avg: 171.46 / Max: 320.72Min: 97.81 / Avg: 180.38 / Max: 349.14Min: 59.66 / Avg: 192.17 / Max: 352.61Min: 76.28 / Avg: 204.47 / Max: 438.17Min: 134.59 / Avg: 276.23 / Max: 451.3Min: 197.84 / Avg: 346.41 / Max: 545.23Min: 198.99 / Avg: 348.01 / Max: 540.221. EPYC 8534PN: Approximate power consumption of 426 Joules per run.2. EPYC 8534P: Approximate power consumption of 445 Joules per run.3. Xeon 6766E: Approximate power consumption of 583 Joules per run.4. Xeon 6780E: Approximate power consumption of 567 Joules per run.5. EPYC 9754: Approximate power consumption of 631 Joules per run.6. EPYC 9654: Approximate power consumption of 707 Joules per run.7. EPYC 9684X: Approximate power consumption of 798 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 813 Joules per run.9. Xeon Platinum 8380: Approximate power consumption of 1007 Joules per run.10. Xeon 6766E 2P: Approximate power consumption of 1386 Joules per run.11. Xeon 6780E 2P: Approximate power consumption of 1362 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 1178 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 1431 Joules per run.14. Xeon Max 9480: Approximate power consumption of 1434 Joules per run.15. Xeon Max 9468: Approximate power consumption of 1434 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 1522 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 1804 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 1730 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 1789 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 2526 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 3266 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 3281 Joules per run.

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: MG.CEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8380 2PXeon Platinum 8592+Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 8534PEPYC 8534PNXeon Platinum 838050K100K150K200K250KSE +/- 1776.37, N = 11SE +/- 7207.31, N = 15SE +/- 1422.07, N = 7SE +/- 2707.72, N = 14SE +/- 1415.96, N = 9SE +/- 1298.67, N = 9SE +/- 1262.04, N = 9SE +/- 1372.89, N = 15SE +/- 884.47, N = 9SE +/- 1153.71, N = 15SE +/- 233.83, N = 9SE +/- 406.29, N = 9SE +/- 382.59, N = 10SE +/- 436.97, N = 10SE +/- 152.92, N = 9SE +/- 167.65, N = 8SE +/- 301.54, N = 8SE +/- 53.56, N = 9245447.72244738.81220893.78194942.32172614.10171436.47163333.21134994.14125567.07116725.04110742.15107321.8986407.4685910.9583448.7063930.6462449.5557317.661. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
OpenBenchmarking.orgTotal Mop/s Per Watt, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: MG.CEPYC 9754EPYC 9684XEPYC 9654EPYC 9754 2PEPYC 8534PNEPYC 9684X 2PEPYC 8534PXeon Platinum 8592+EPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468Xeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8380 2PXeon Platinum 8380300600900120015001265.551119.201070.68988.65953.72928.22906.46858.24823.46757.48517.49499.08496.64480.22476.05454.47446.48378.76
OpenBenchmarking.orgWatts, Fewer Is BetterNAS Parallel Benchmarks 3.4CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8592+Xeon Platinum 8380Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9654 2PXeon Platinum 8380 2PEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P130260390520650Min: 16.49 / Avg: 65.48 / Max: 127.89Min: 17.11 / Avg: 70.53 / Max: 141.22Min: 21.58 / Avg: 99.22 / Max: 284.09Min: 27.57 / Avg: 109.02 / Max: 286.49Min: 29.67 / Avg: 120.62 / Max: 340.18Min: 25.53 / Avg: 125.05 / Max: 346.36Min: 52.21 / Avg: 151.33 / Max: 280.05Min: 59.14 / Avg: 161.26 / Max: 333.63Min: 72.77 / Avg: 172.14 / Max: 347.7Min: 73.21 / Avg: 179.93 / Max: 359.94Min: 55.9 / Avg: 236.74 / Max: 614.68Min: 99.93 / Avg: 248.03 / Max: 546.61Min: 40.32 / Avg: 248.27 / Max: 531.63Min: 62.46 / Avg: 263.66 / Max: 710.66Min: 70.18 / Avg: 291.62 / Max: 590.65Min: 142.29 / Avg: 328.87 / Max: 698.64Min: 183.3 / Avg: 362.6 / Max: 714.29Min: 193.92 / Avg: 377.22 / Max: 729.731. EPYC 8534PN: Approximate power consumption of 516 Joules per run.2. EPYC 8534P: Approximate power consumption of 564 Joules per run.3. EPYC 9754: Approximate power consumption of 750 Joules per run.4. EPYC 9654: Approximate power consumption of 727 Joules per run.5. EPYC 9684X: Approximate power consumption of 772 Joules per run.6. Xeon Platinum 8592+: Approximate power consumption of 917 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 1177 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 1147 Joules per run.9. Xeon Max 9468: Approximate power consumption of 1153 Joules per run.10. Xeon Max 9480: Approximate power consumption of 1242 Joules per run.11. EPYC 9654 2P: Approximate power consumption of 1894 Joules per run.12. Xeon Platinum 8380 2P: Approximate power consumption of 1709 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 3340 Joules per run.14. EPYC 9684X 2P: Approximate power consumption of 2127 Joules per run.15. Xeon Platinum 8592+ 2P: Approximate power consumption of 2958 Joules per run.16. Xeon Platinum 8490H 2P: Approximate power consumption of 2448 Joules per run.17. Xeon Max 9468 2P: Approximate power consumption of 2578 Joules per run.18. Xeon Max 9480 2P: Approximate power consumption of 2724 Joules per run.

srsRAN Project

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PDSCH Processor Benchmark, Throughput ThreadXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Max 9480Xeon Max 9468EPYC 9654EPYC 9684XXeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9684X 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 9754 2PEPYC 8534PNEPYC 8534PXeon Platinum 8380 2PXeon Platinum 8380Xeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P160320480640800SE +/- 1.89, N = 8SE +/- 1.34, N = 8SE +/- 1.27, N = 8SE +/- 1.64, N = 8SE +/- 1.71, N = 8SE +/- 3.13, N = 8SE +/- 1.17, N = 8SE +/- 2.57, N = 8SE +/- 3.72, N = 8SE +/- 5.52, N = 8SE +/- 5.02, N = 8SE +/- 3.86, N = 8SE +/- 0.80, N = 7SE +/- 4.48, N = 7SE +/- 1.24, N = 7SE +/- 3.14, N = 7SE +/- 2.08, N = 7SE +/- 3.57, N = 7SE +/- 0.24, N = 5SE +/- 0.66, N = 5SE +/- 0.32, N = 5SE +/- 0.32, N = 5755.5742.9705.5702.6684.7680.7680.2675.5673.4664.7663.8651.9596.2576.8563.6557.9490.3484.8333.2323.7299.4293.11. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -fno-trapping-math -fno-math-errno -ldl
OpenBenchmarking.orgMbps Per Watt, More Is BettersrsRAN Project 23.10.1-20240325Test: PDSCH Processor Benchmark, Throughput ThreadEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8592+EPYC 9684XXeon 6780EXeon 6766EXeon Platinum 8490HXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8380 2PXeon 6780E 2PXeon 6766E 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P4812162014.52413.54810.6759.7958.9298.6287.2496.8076.1165.8665.0854.7884.2004.1624.0743.6392.9982.9792.7262.5982.0652.035
OpenBenchmarking.orgWatts, Fewer Is BettersrsRAN Project 23.10.1-20240325CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8380Xeon Platinum 8592+Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8490HEPYC 9754 2PXeon Max 9468Xeon Max 9480EPYC 9654 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P70140210280350Min: 13.69 / Avg: 38.81 / Max: 55.52Min: 18.39 / Avg: 41.18 / Max: 58.06Min: 43.56 / Avg: 43.98 / Max: 45.49Min: 43.52 / Avg: 45.97 / Max: 48.12Min: 20.14 / Avg: 55.85 / Max: 81.57Min: 28.33 / Avg: 69.9 / Max: 103.51Min: 30.33 / Avg: 78.89 / Max: 117.61Min: 51.21 / Avg: 82.65 / Max: 104.34Min: 24.93 / Avg: 83.2 / Max: 132.66Min: 103.98 / Avg: 107.54 / Max: 109.81Min: 104.77 / Avg: 108.64 / Max: 112.06Min: 62.63 / Avg: 111.22 / Max: 152.68Min: 38.06 / Avg: 137.34 / Max: 200.95Min: 73.91 / Avg: 138.16 / Max: 195.36Min: 85.93 / Avg: 147.34 / Max: 200.38Min: 56.59 / Avg: 161.78 / Max: 243.41Min: 98.94 / Avg: 163.54 / Max: 216.84Min: 63.99 / Avg: 182.65 / Max: 268.9Min: 80.15 / Avg: 185.44 / Max: 287.05Min: 161.37 / Avg: 259.97 / Max: 337.8Min: 204.49 / Avg: 320.28 / Max: 415.75Min: 199.86 / Avg: 321.38 / Max: 411.11. EPYC 8534PN: Approximate power consumption of 360 Joules per run.2. EPYC 8534P: Approximate power consumption of 388 Joules per run.3. Xeon 6766E: Approximate power consumption of 625 Joules per run.4. Xeon 6780E: Approximate power consumption of 607 Joules per run.5. EPYC 9754: Approximate power consumption of 519 Joules per run.6. EPYC 9654: Approximate power consumption of 594 Joules per run.7. EPYC 9684X: Approximate power consumption of 680 Joules per run.8. Xeon Platinum 8380: Approximate power consumption of 838 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 676 Joules per run.10. Xeon 6766E 2P: Approximate power consumption of 1527 Joules per run.11. Xeon 6780E 2P: Approximate power consumption of 1434 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 945 Joules per run.13. EPYC 9754 2P: Approximate power consumption of 1275 Joules per run.14. Xeon Max 9468: Approximate power consumption of 1123 Joules per run.15. Xeon Max 9480: Approximate power consumption of 1197 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 1375 Joules per run.17. Xeon Platinum 8380 2P: Approximate power consumption of 1635 Joules per run.18. EPYC 9684X 2P: Approximate power consumption of 1553 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 1484 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 2210 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 2682 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 2651 Joules per run.

LAMMPS Molecular Dynamics Simulator

LAMMPS is a classical molecular dynamics code, and an acronym for Large-scale Atomic/Molecular Massively Parallel Simulator. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: Rhodopsin ProteinXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Max 9480 2PEPYC 9754 2PEPYC 9654 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Platinum 8380 2PXeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 83801224364860SE +/- 0.97, N = 15SE +/- 0.43, N = 7SE +/- 0.09, N = 8SE +/- 0.24, N = 5SE +/- 0.39, N = 7SE +/- 0.11, N = 9SE +/- 0.33, N = 8SE +/- 0.29, N = 10SE +/- 0.35, N = 15SE +/- 0.14, N = 11SE +/- 0.29, N = 15SE +/- 0.53, N = 15SE +/- 0.04, N = 11SE +/- 0.36, N = 15SE +/- 0.05, N = 11SE +/- 0.29, N = 15SE +/- 0.30, N = 15SE +/- 0.28, N = 1555.5053.7752.2451.6350.1247.5142.2840.3940.0036.1534.3033.5430.8428.7227.6324.2521.9421.161. (CXX) g++ options: -O3 -lm -ldl
OpenBenchmarking.orgns/day Per Watt, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: Rhodopsin ProteinEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8592+Xeon Max 9480Xeon Platinum 8490HEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8380Xeon Max 9468EPYC 9684X 2PXeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2P0.1040.2080.3120.4160.520.4620.4510.4510.3720.3580.3410.2090.2090.2040.1960.1890.1860.1840.1790.1480.1360.1290.119
OpenBenchmarking.orgWatts, Fewer Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8592+EPYC 9684XXeon Platinum 8380Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P120240360480600Min: 15.52 / Avg: 48.67 / Max: 132.86Min: 16.36 / Avg: 52.44 / Max: 142.05Min: 20.56 / Avg: 89.57 / Max: 288.34Min: 26.87 / Avg: 97.2 / Max: 234.7Min: 22.32 / Avg: 100.63 / Max: 327.13Min: 27.48 / Avg: 111.71 / Max: 349.02Min: 51.92 / Avg: 113.55 / Max: 290.07Min: 59.51 / Avg: 137.71 / Max: 356.46Min: 73.75 / Avg: 147.45 / Max: 350.72Min: 74.62 / Avg: 150.09 / Max: 352.27Min: 99.81 / Avg: 226.26 / Max: 547.72Min: 41.5 / Avg: 252.99 / Max: 566.7Min: 56.67 / Avg: 265.38 / Max: 605.84Min: 63.52 / Avg: 283.35 / Max: 590.85Min: 60.69 / Avg: 300.13 / Max: 690.91Min: 158.94 / Avg: 354.59 / Max: 652.14Min: 188.46 / Avg: 368.48 / Max: 640.19Min: 185.06 / Avg: 384.54 / Max: 575.711. EPYC 8534PN: Approximate power consumption of 295 Joules per run.2. EPYC 8534P: Approximate power consumption of 318 Joules per run.3. EPYC 9754: Approximate power consumption of 609 Joules per run.4. EPYC 9654: Approximate power consumption of 592 Joules per run.5. Xeon Platinum 8592+: Approximate power consumption of 644 Joules per run.6. EPYC 9684X: Approximate power consumption of 663 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 666 Joules per run.8. Xeon Platinum 8490H: Approximate power consumption of 845 Joules per run.9. Xeon Max 9480: Approximate power consumption of 871 Joules per run.10. Xeon Max 9468: Approximate power consumption of 887 Joules per run.11. Xeon Platinum 8380 2P: Approximate power consumption of 1463 Joules per run.12. EPYC 9754 2P: Approximate power consumption of 3441 Joules per run.13. EPYC 9654 2P: Approximate power consumption of 2540 Joules per run.14. Xeon Platinum 8592+ 2P: Approximate power consumption of 2739 Joules per run.15. EPYC 9684X 2P: Approximate power consumption of 2830 Joules per run.16. Xeon Platinum 8490H 2P: Approximate power consumption of 2970 Joules per run.17. Xeon Max 9468 2P: Approximate power consumption of 2702 Joules per run.18. Xeon Max 9480 2P: Approximate power consumption of 3076 Joules per run.

libavif avifenc

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8490H 2PXeon Platinum 8490HEPYC 9754EPYC 9754 2PEPYC 8534PXeon Platinum 8380 2PXeon Max 9480EPYC 8534PNXeon Max 9468Xeon Max 9480 2PXeon Max 9468 2PXeon 6780EXeon Platinum 8380Xeon 6766EXeon 6780E 2PXeon 6766E 2P1.08652.1733.25954.3465.4325SE +/- 0.005, N = 10SE +/- 0.011, N = 10SE +/- 0.009, N = 10SE +/- 0.008, N = 10SE +/- 0.005, N = 9SE +/- 0.016, N = 9SE +/- 0.008, N = 9SE +/- 0.022, N = 9SE +/- 0.002, N = 9SE +/- 0.026, N = 9SE +/- 0.016, N = 9SE +/- 0.023, N = 15SE +/- 0.011, N = 9SE +/- 0.011, N = 9SE +/- 0.017, N = 9SE +/- 0.022, N = 9SE +/- 0.029, N = 8SE +/- 0.004, N = 8SE +/- 0.010, N = 8SE +/- 0.003, N = 8SE +/- 0.034, N = 8SE +/- 0.023, N = 82.7232.7562.8052.8102.8902.9713.0443.1693.2513.3413.4843.5283.5503.6233.7303.7383.7763.8724.0934.2434.4864.8291. (CXX) g++ options: -O3 -fPIC -lm
OpenBenchmarking.orgWatts, Fewer Is Betterlibavif avifenc 1.0CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8592+Xeon 6766E 2PXeon Platinum 8380Xeon 6780E 2PEPYC 9754 2PXeon Platinum 8490HEPYC 9654 2PXeon Max 9468Xeon Max 9480EPYC 9684X 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P120240360480600Min: 15.57 / Avg: 49.3 / Max: 126.89Min: 15.86 / Avg: 54.43 / Max: 150.92Min: 43.55 / Avg: 64.88 / Max: 147.13Min: 43.39 / Avg: 69.56 / Max: 179.96Min: 18.49 / Avg: 76.34 / Max: 238.8Min: 26.55 / Avg: 92.59 / Max: 299.06Min: 29.87 / Avg: 106.31 / Max: 349.7Min: 27.77 / Avg: 125.51 / Max: 374.47Min: 103.77 / Avg: 129.25 / Max: 219.98Min: 49.52 / Avg: 131.52 / Max: 290.38Min: 106.17 / Avg: 135.03 / Max: 247.79Min: 35.83 / Avg: 144.55 / Max: 349.42Min: 59.37 / Avg: 149.47 / Max: 376.13Min: 54.93 / Avg: 178.85 / Max: 447.63Min: 73.48 / Avg: 180.42 / Max: 357.76Min: 71.59 / Avg: 183.17 / Max: 376.96Min: 59.74 / Avg: 193.24 / Max: 500.52Min: 96.12 / Avg: 215.89 / Max: 534.91Min: 66.73 / Avg: 224.06 / Max: 669.89Min: 141.74 / Avg: 294.92 / Max: 681.8Min: 196.21 / Avg: 370.24 / Max: 687.54Min: 194.63 / Avg: 375.42 / Max: 682.971. EPYC 8534PN: Approximate power consumption of 378 Joules per run.2. EPYC 8534P: Approximate power consumption of 411 Joules per run.3. Xeon 6766E: Approximate power consumption of 535 Joules per run.4. Xeon 6780E: Approximate power consumption of 556 Joules per run.5. EPYC 9754: Approximate power consumption of 551 Joules per run.6. EPYC 9654: Approximate power consumption of 630 Joules per run.7. EPYC 9684X: Approximate power consumption of 723 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 879 Joules per run.9. Xeon 6766E 2P: Approximate power consumption of 1147 Joules per run.10. Xeon Platinum 8380: Approximate power consumption of 1069 Joules per run.11. Xeon 6780E 2P: Approximate power consumption of 1148 Joules per run.12. EPYC 9754 2P: Approximate power consumption of 1060 Joules per run.13. Xeon Platinum 8490H: Approximate power consumption of 1096 Joules per run.14. EPYC 9654 2P: Approximate power consumption of 1216 Joules per run.15. Xeon Max 9468: Approximate power consumption of 1403 Joules per run.16. Xeon Max 9480: Approximate power consumption of 1364 Joules per run.17. EPYC 9684X 2P: Approximate power consumption of 1353 Joules per run.18. Xeon Platinum 8380 2P: Approximate power consumption of 1626 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 1546 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 2130 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 2880 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 2910 Joules per run.

Primesieve

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e12EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon 6780E 2PXeon 6766E 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380 2PEPYC 8534PXeon Platinum 8592+Xeon 6780EEPYC 8534PNXeon Platinum 8490HXeon 6766EXeon Max 9480Xeon Max 9468Xeon Platinum 8380246810SE +/- 0.003, N = 12SE +/- 0.005, N = 12SE +/- 0.010, N = 15SE +/- 0.002, N = 11SE +/- 0.004, N = 11SE +/- 0.003, N = 11SE +/- 0.008, N = 11SE +/- 0.006, N = 10SE +/- 0.008, N = 10SE +/- 0.012, N = 10SE +/- 0.005, N = 10SE +/- 0.004, N = 9SE +/- 0.003, N = 9SE +/- 0.006, N = 8SE +/- 0.007, N = 8SE +/- 0.003, N = 8SE +/- 0.003, N = 8SE +/- 0.019, N = 8SE +/- 0.003, N = 8SE +/- 0.010, N = 7SE +/- 0.006, N = 7SE +/- 0.006, N = 61.1991.2421.3591.9211.9842.0582.1872.3252.3372.6052.6913.1213.3663.8014.2504.3244.5454.5764.8065.3326.1606.6731. (CXX) g++ options: -O3
OpenBenchmarking.orgWatts, Fewer Is BetterPrimesieve 12.1CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PEPYC 9754Xeon 6766EEPYC 9654EPYC 9684XXeon 6780EEPYC 9754 2PXeon Platinum 8380Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9654 2PXeon 6766E 2PEPYC 9684X 2PXeon Max 9480Xeon Max 9468Xeon 6780E 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P140280420560700Min: 16.77 / Avg: 72.3 / Max: 123.74Min: 16.53 / Avg: 87.74 / Max: 161.22Min: 21.44 / Avg: 116.27 / Max: 317.57Min: 43.73 / Avg: 134.25 / Max: 215.68Min: 26.05 / Avg: 142.51 / Max: 369.88Min: 33.95 / Avg: 157.31 / Max: 410.23Min: 43.47 / Avg: 160.81 / Max: 278.45Min: 39.28 / Avg: 188.39 / Max: 630.34Min: 52.68 / Avg: 193.17 / Max: 291Min: 20.57 / Avg: 195.27 / Max: 377.63Min: 53.72 / Avg: 216.08 / Max: 377.44Min: 58.4 / Avg: 217.76 / Max: 736.92Min: 104.53 / Avg: 228.57 / Max: 454.64Min: 65.08 / Avg: 239.55 / Max: 813.29Min: 75.05 / Avg: 240.32 / Max: 376.42Min: 41.72 / Avg: 247.24 / Max: 378.01Min: 105.81 / Avg: 260.26 / Max: 569.59Min: 70.6 / Avg: 304.92 / Max: 755.57Min: 99.97 / Avg: 315.19 / Max: 581.5Min: 167.18 / Avg: 384.89 / Max: 756.1Min: 188 / Avg: 419.03 / Max: 755.09Min: 185.19 / Avg: 432.51 / Max: 754.281. EPYC 8534PN: Approximate power consumption of 624 Joules per run.2. EPYC 8534P: Approximate power consumption of 680 Joules per run.3. EPYC 9754: Approximate power consumption of 687 Joules per run.4. Xeon 6766E: Approximate power consumption of 1191 Joules per run.5. EPYC 9654: Approximate power consumption of 868 Joules per run.6. EPYC 9684X: Approximate power consumption of 944 Joules per run.7. Xeon 6780E: Approximate power consumption of 1347 Joules per run.8. EPYC 9754 2P: Approximate power consumption of 1017 Joules per run.9. Xeon Platinum 8380: Approximate power consumption of 2061 Joules per run.10. Xeon Platinum 8592+: Approximate power consumption of 1635 Joules per run.11. Xeon Platinum 8490H: Approximate power consumption of 1891 Joules per run.12. EPYC 9654 2P: Approximate power consumption of 1143 Joules per run.13. Xeon 6766E 2P: Approximate power consumption of 1531 Joules per run.14. EPYC 9684X 2P: Approximate power consumption of 1258 Joules per run.15. Xeon Max 9480: Approximate power consumption of 2266 Joules per run.16. Xeon Max 9468: Approximate power consumption of 2508 Joules per run.17. Xeon 6780E 2P: Approximate power consumption of 1666 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 1940 Joules per run.19. Xeon Platinum 8380 2P: Approximate power consumption of 2346 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 2502 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 2849 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 3028 Joules per run.

Parallel BZIP2 Compression

OpenBenchmarking.orgSeconds, Fewer Is BetterParallel BZIP2 Compression 1.1.13FreeBSD-13.0-RELEASE-amd64-memstick.img CompressionEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon 6780E 2PXeon Platinum 8592+Xeon 6766E 2PXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8380 2PEPYC 8534PXeon 6780EXeon Max 9480EPYC 8534PNXeon 6766EXeon Max 9468Xeon Platinum 83800.76351.5272.29053.0543.8175SE +/- 0.012053, N = 15SE +/- 0.015217, N = 15SE +/- 0.019468, N = 15SE +/- 0.010826, N = 15SE +/- 0.015384, N = 15SE +/- 0.014512, N = 15SE +/- 0.024402, N = 15SE +/- 0.017240, N = 15SE +/- 0.028863, N = 15SE +/- 0.015943, N = 15SE +/- 0.023842, N = 15SE +/- 0.015355, N = 15SE +/- 0.030907, N = 15SE +/- 0.007749, N = 10SE +/- 0.026496, N = 15SE +/- 0.023387, N = 15SE +/- 0.014326, N = 10SE +/- 0.020941, N = 15SE +/- 0.016947, N = 15SE +/- 0.012826, N = 10SE +/- 0.023295, N = 15SE +/- 0.048155, N = 151.0683981.1094461.1263291.3557371.3690631.4229541.4323621.4692101.7112961.7180221.8475371.8576421.9829322.1448572.1814552.2004972.2799712.2877662.3211952.5046212.6320773.3931891. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread
OpenBenchmarking.orgWatts, Fewer Is BetterParallel BZIP2 Compression 1.1.13CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PEPYC 9754Xeon 6766EXeon 6780EEPYC 9654EPYC 9684XXeon Platinum 8592+EPYC 9754 2PXeon Platinum 8380Xeon 6766E 2PXeon Platinum 8490HXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P120240360480600Min: 16.36 / Avg: 50.15 / Max: 132.7Min: 15.97 / Avg: 55.16 / Max: 153.03Min: 21.06 / Avg: 71.78 / Max: 246.91Min: 43.62 / Avg: 72.77 / Max: 199.71Min: 43.43 / Avg: 79.98 / Max: 238.53Min: 26.03 / Avg: 87.61 / Max: 297.16Min: 32.91 / Avg: 100.67 / Max: 337.76Min: 33.01 / Avg: 124.42 / Max: 372.52Min: 39.33 / Avg: 126.08 / Max: 368.96Min: 50.9 / Avg: 141.25 / Max: 290.87Min: 103.93 / Avg: 141.47 / Max: 301.99Min: 59.1 / Avg: 149.7 / Max: 374.85Min: 104.74 / Avg: 150.21 / Max: 342.71Min: 52.77 / Avg: 151.26 / Max: 452.63Min: 58 / Avg: 170.11 / Max: 493.47Min: 73.85 / Avg: 174.26 / Max: 374.82Min: 72.25 / Avg: 174.54 / Max: 371.49Min: 71.11 / Avg: 201.02 / Max: 594.06Min: 95.47 / Avg: 220.44 / Max: 552.38Min: 162.27 / Avg: 288.67 / Max: 640.02Min: 193.42 / Avg: 340.67 / Max: 703.88Min: 199.37 / Avg: 345.8 / Max: 682.951. EPYC 8534PN: Approximate power consumption of 328 Joules per run.2. EPYC 8534P: Approximate power consumption of 349 Joules per run.3. EPYC 9754: Approximate power consumption of 392 Joules per run.4. Xeon 6766E: Approximate power consumption of 480 Joules per run.5. Xeon 6780E: Approximate power consumption of 512 Joules per run.6. EPYC 9654: Approximate power consumption of 491 Joules per run.7. EPYC 9684X: Approximate power consumption of 550 Joules per run.8. Xeon Platinum 8592+: Approximate power consumption of 738 Joules per run.9. EPYC 9754 2P: Approximate power consumption of 656 Joules per run.10. Xeon Platinum 8380: Approximate power consumption of 1055 Joules per run.11. Xeon 6766E 2P: Approximate power consumption of 830 Joules per run.12. Xeon Platinum 8490H: Approximate power consumption of 943 Joules per run.13. Xeon 6780E 2P: Approximate power consumption of 871 Joules per run.14. EPYC 9654 2P: Approximate power consumption of 776 Joules per run.15. EPYC 9684X 2P: Approximate power consumption of 873 Joules per run.16. Xeon Max 9480: Approximate power consumption of 1115 Joules per run.17. Xeon Max 9468: Approximate power consumption of 1164 Joules per run.18. Xeon Platinum 8592+ 2P: Approximate power consumption of 1112 Joules per run.19. Xeon Platinum 8380 2P: Approximate power consumption of 1381 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 1655 Joules per run.21. Xeon Max 9480 2P: Approximate power consumption of 1999 Joules per run.22. Xeon Max 9468 2P: Approximate power consumption of 2098 Joules per run.

oneDNN

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_3d - Engine: CPUXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754 2PXeon Max 9480 2PXeon Platinum 8380 2PXeon Platinum 8592+EPYC 9754Xeon Max 9468 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490HEPYC 9684XEPYC 9654Xeon Max 9480Xeon Max 9468Xeon Platinum 8380EPYC 8534PEPYC 8534PNXeon 6780EXeon 6780E 2PXeon 6766EXeon 6766E 2P0.56191.12381.68572.24762.8095SE +/- 0.000902, N = 9SE +/- 0.001274, N = 9SE +/- 0.003127, N = 9SE +/- 0.001240, N = 9SE +/- 0.001091, N = 9SE +/- 0.000392, N = 9SE +/- 0.001089, N = 9SE +/- 0.000806, N = 9SE +/- 0.002070, N = 9SE +/- 0.001921, N = 9SE +/- 0.000805, N = 9SE +/- 0.001272, N = 9SE +/- 0.001484, N = 9SE +/- 0.000927, N = 9SE +/- 0.000508, N = 9SE +/- 0.006599, N = 9SE +/- 0.000791, N = 9SE +/- 0.001685, N = 9SE +/- 0.002181, N = 9SE +/- 0.001365, N = 9SE +/- 0.001097, N = 9SE +/- 0.001467, N = 90.6242500.7361700.8296530.8643580.8670650.9071610.9436210.9450751.0019141.0094731.0774301.1192301.1548701.1964301.2640701.4221301.4983501.7974902.0491002.2452602.2971202.4973401. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.4CPU Power Consumption MonitorEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754EPYC 9654Xeon Platinum 8380EPYC 9684XXeon Platinum 8592+Xeon Platinum 8490HXeon 6766E 2PXeon Max 9468Xeon Max 9480Xeon 6780E 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P130260390520650Min: 15.81 / Avg: 62.56 / Max: 121.69Min: 16.93 / Avg: 70.08 / Max: 140.81Min: 43.57 / Avg: 98.35 / Max: 172.87Min: 43.45 / Avg: 112.89 / Max: 208.27Min: 20.19 / Avg: 122.35 / Max: 259.22Min: 26.3 / Avg: 135.34 / Max: 274.99Min: 48.87 / Avg: 151.05 / Max: 290.31Min: 32.75 / Avg: 155.62 / Max: 314.15Min: 23.58 / Avg: 173.49 / Max: 373.63Min: 51.81 / Avg: 187.58 / Max: 359.76Min: 103.52 / Avg: 196.1 / Max: 321.17Min: 73.57 / Avg: 201.22 / Max: 367.75Min: 69.85 / Avg: 202.05 / Max: 376Min: 105.63 / Avg: 213.96 / Max: 368.1Min: 40.43 / Avg: 245.22 / Max: 491.94Min: 53.59 / Avg: 275.56 / Max: 567.73Min: 62.97 / Avg: 300.29 / Max: 621Min: 98.61 / Avg: 304.22 / Max: 566.32Min: 70.82 / Avg: 355.72 / Max: 740.88Min: 169.45 / Avg: 409.27 / Max: 716.88Min: 194.92 / Avg: 425.54 / Max: 706.02Min: 187.54 / Avg: 431.59 / Max: 733.221. EPYC 8534PN: Approximate power consumption of 445 Joules per run.2. EPYC 8534P: Approximate power consumption of 498 Joules per run.3. Xeon 6766E: Approximate power consumption of 688 Joules per run.4. Xeon 6780E: Approximate power consumption of 803 Joules per run.5. EPYC 9754: Approximate power consumption of 870 Joules per run.6. EPYC 9654: Approximate power consumption of 962 Joules per run.7. Xeon Platinum 8380: Approximate power consumption of 1057 Joules per run.8. EPYC 9684X: Approximate power consumption of 1107 Joules per run.9. Xeon Platinum 8592+: Approximate power consumption of 1234 Joules per run.10. Xeon Platinum 8490H: Approximate power consumption of 1334 Joules per run.11. Xeon 6766E 2P: Approximate power consumption of 1416 Joules per run.12. Xeon Max 9468: Approximate power consumption of 1409 Joules per run.13. Xeon Max 9480: Approximate power consumption of 1414 Joules per run.14. Xeon 6780E 2P: Approximate power consumption of 1521 Joules per run.15. EPYC 9754 2P: Approximate power consumption of 1771 Joules per run.16. EPYC 9654 2P: Approximate power consumption of 1960 Joules per run.17. EPYC 9684X 2P: Approximate power consumption of 2135 Joules per run.18. Xeon Platinum 8380 2P: Approximate power consumption of 2163 Joules per run.19. Xeon Platinum 8592+ 2P: Approximate power consumption of 2569 Joules per run.20. Xeon Platinum 8490H 2P: Approximate power consumption of 2956 Joules per run.21. Xeon Max 9468 2P: Approximate power consumption of 3026 Joules per run.22. Xeon Max 9480 2P: Approximate power consumption of 3069 Joules per run.

CPU Power Consumption Monitor

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringEPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EEPYC 9754Xeon Platinum 8380EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9684XXeon 6766E 2PXeon Max 9468Xeon Max 9480Xeon 6780E 2PEPYC 9754 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Max 9468 2PXeon Max 9480 2P170340510680850Min: 9.26 / Avg: 114.13 / Max: 155.71Min: 8.43 / Avg: 128.7 / Max: 184.62Min: 21.86 / Avg: 142.1 / Max: 271.22Min: 21.7 / Avg: 169.1 / Max: 357.69Min: 10.09 / Avg: 225.05 / Max: 397.44Min: 26.31 / Avg: 237.91 / Max: 292.14Min: 14.69 / Avg: 244.69 / Max: 373.1Min: 17.77 / Avg: 260.08 / Max: 405.42Min: 30.38 / Avg: 278.1 / Max: 383.24Min: 17.06 / Avg: 290.08 / Max: 413.51Min: 52.85 / Avg: 291.05 / Max: 542.48Min: 38.11 / Avg: 291.53 / Max: 379.76Min: 38.16 / Avg: 295.53 / Max: 384.53Min: 53.44 / Avg: 321.01 / Max: 713.33Min: 20.22 / Avg: 375.51 / Max: 735.74Min: 51.38 / Avg: 437.37 / Max: 583.47Min: 39.72 / Avg: 455.07 / Max: 946.96Min: 35.7 / Avg: 464.49 / Max: 751.79Min: 87.48 / Avg: 517.33 / Max: 758.17Min: 33.66 / Avg: 525.49 / Max: 837.69Min: 102.49 / Avg: 566.6 / Max: 756.48Min: 95.52 / Avg: 569.8 / Max: 760.61

264 Results Shown

WRF
OpenVKL
RELION
NWChem
High Performance Conjugate Gradient
TensorFlow
BRL-CAD
Xcompact3d Incompact3d
CloverLeaf
ASKAP:
  tConvolve MT - Gridding
  tConvolve MT - Degridding
PyTorch
PostgreSQL:
  100 - 1000 - Read Only - Average Latency
  100 - 1000 - Read Only
TensorFlow
OpenSSL:
  RSA4096:
    verify/s
    sign/s
Timed Linux Kernel Compilation
Stockfish
Apache IoTDB:
  800 - 100 - 800 - 100:
    Average Latency
    point/sec
PyTorch:
  CPU - 512 - ResNet-152
  CPU - 64 - ResNet-152
SecureMark
ClickHouse:
  100M Rows Hits Dataset, Third Run
  100M Rows Hits Dataset, Second Run
  100M Rows Hits Dataset, First Run / Cold Cache
Apache IoTDB:
  500 - 100 - 800 - 400:
    Average Latency
    point/sec
OpenRadioss
NAMD
Timed Gem5 Compilation
LAMMPS Molecular Dynamics Simulator
Timed Node.js Compilation
OpenSSL
TensorFlow
FFmpeg:
  libx265 - Platform
  libx265 - Video On Demand
ONNX Runtime:
  fcn-resnet101-11 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
FFmpeg
PostgreSQL:
  100 - 1000 - Read Write - Average Latency
  100 - 1000 - Read Write
Blender
Numpy Benchmark
LuxCoreRender
OpenSSL:
  AES-128-GCM
  AES-256-GCM
  ChaCha20
  SHA512
  ChaCha20-Poly1305
PyTorch
LuxCoreRender
PyTorch
Xmrig
LuxCoreRender
OSPRay
RocksDB
ONNX Runtime:
  Faster R-CNN R-50-FPN-int8 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
OpenFOAM:
  drivaerFastback, Medium Mesh Size - Execution Time
  drivaerFastback, Medium Mesh Size - Mesh Time
Timed LLVM Compilation
Memcached
ONNX Runtime:
  ResNet50 v1-12-int8 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
NAMD
Speedb
PyTorch
ONNX Runtime:
  ArcFace ResNet-100 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
  bertsquad-12 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
  CaffeNet 12-int8 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
Llamafile
Timed Godot Game Engine Compilation
PyTorch
OpenRadioss
QMCPACK
ONNX Runtime:
  fcn-resnet101-11 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
  CaffeNet 12-int8 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
  T5 Encoder - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
OpenVINO:
  Person Detection FP16 - CPU:
    ms
    FPS
ONNX Runtime:
  GPT-2 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
TensorFlow
OSPRay
ONNX Runtime:
  yolov4 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
  super-resolution-10 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
OSPRay Studio:
  1 - 4K - 32 - Path Tracer - CPU
  3 - 4K - 32 - Path Tracer - CPU
Zstd Compression:
  19 - Decompression Speed
  19 - Compression Speed
Speedb
VVenC
Zstd Compression:
  19, Long Mode - Decompression Speed
  19, Long Mode - Compression Speed
OpenVINO:
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU:
    ms
    FPS
OSPRay Studio
TensorFlow:
  CPU - 1 - ResNet-50
  CPU - 64 - ResNet-50
OpenVINO:
  Machine Translation EN To DE FP16 - CPU:
    ms
    FPS
ONNX Runtime:
  ResNet50 v1-12-int8 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
OpenVINO:
  Noise Suppression Poconet-Like FP16 - CPU:
    ms
    FPS
libavif avifenc
ONNX Runtime:
  T5 Encoder - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
ASKAP:
  tConvolve MPI - Gridding
  tConvolve MPI - Degridding
Helsing
OSPRay Studio:
  1 - 4K - 16 - Path Tracer - CPU
  3 - 4K - 16 - Path Tracer - CPU
CloverLeaf
OSPRay Studio
OpenVINO:
  Road Segmentation ADAS FP16-INT8 - CPU:
    ms
    FPS
ONNX Runtime:
  ArcFace ResNet-100 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
OpenVINO:
  Handwritten English Recognition FP16-INT8 - CPU:
    ms
    FPS
  Vehicle Detection FP16-INT8 - CPU:
    ms
    FPS
ONNX Runtime:
  Faster R-CNN R-50-FPN-int8 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
TensorFlow
QuantLib
OpenVINO:
  Face Detection FP16-INT8 - CPU:
    ms
    FPS
OSPRay
Blender
OpenVINO:
  Person Vehicle Bike Detection FP16 - CPU:
    ms
    FPS
ONNX Runtime:
  bertsquad-12 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
OpenVINO:
  Person Re-Identification Retail FP16 - CPU:
    ms
    FPS
PyTorch
OpenVINO:
  Weld Porosity Detection FP16-INT8 - CPU:
    ms
    FPS
ONNX Runtime:
  GPT-2 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
OpenVINO:
  Face Detection Retail FP16-INT8 - CPU:
    ms
    FPS
ONNX Runtime:
  yolov4 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
GraphicsMagick
GPAW
GraphicsMagick
Timed Linux Kernel Compilation
GraphicsMagick
ONNX Runtime:
  super-resolution-10 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
GraphicsMagick
RocksDB
miniBUDE:
  OpenMP - BM2:
    Billion Interactions/s
    GFInst/s
Coremark
srsRAN Project
Blender
Aircrack-ng
WebP Image Encode
libavif avifenc
srsRAN Project
Llamafile
LULESH
7-Zip Compression:
  Decompression Rating
  Compression Rating
Algebraic Multi-Grid Benchmark
Liquid-DSP
NAS Parallel Benchmarks
ASTC Encoder
TensorFlow
miniFE
OpenRadioss
VVenC
Primesieve
GROMACS
ASTC Encoder
uvg266
John The Ripper
TensorFlow
Liquid-DSP
QuantLib
Liquid-DSP
SVT-AV1
uvg266
Liquid-DSP
TensorFlow
Liquid-DSP:
  64 - 256 - 57
  128 - 256 - 512
  256 - 256 - 512
John The Ripper
Liquid-DSP
SVT-AV1
Embree
John The Ripper
Liquid-DSP:
  256 - 256 - 57
  256 - 256 - 32
  128 - 256 - 32
Google SynthMark
Liquid-DSP
uvg266
Blender:
  Junkshop - CPU-Only
  Fishy Cat - CPU-Only
Appleseed
TensorFlow
Kvazaar
Pennant
Kvazaar
srsRAN Project
Kvazaar
OpenFOAM:
  drivaerFastback, Small Mesh Size - Execution Time
  drivaerFastback, Small Mesh Size - Mesh Time
SVT-AV1
Intel Open Image Denoise
Blender
miniBUDE:
  OpenMP - BM1:
    Billion Interactions/s
    GFInst/s
x265
Timed FFmpeg Compilation
Pennant
TensorFlow
NAS Parallel Benchmarks
PyBench
NAS Parallel Benchmarks
ASTC Encoder
NAS Parallel Benchmarks
Timed Mesa Compilation
Xcompact3d Incompact3d
Y-Cruncher
Timed ImageMagick Compilation
m-queens
Intel Open Image Denoise:
  RT.ldr_alb_nrm.3840x2160 - CPU-Only
  RT.hdr_alb_nrm.3840x2160 - CPU-Only
NAS Parallel Benchmarks
GNU Octave Benchmark
Y-Cruncher
Embree
WebP Image Encode
Embree
ASTC Encoder
SVT-AV1
libavif avifenc
ACES DGEMM
libavif avifenc
NAS Parallel Benchmarks
srsRAN Project
LAMMPS Molecular Dynamics Simulator
libavif avifenc
Primesieve
Parallel BZIP2 Compression
oneDNN
CPU Power Consumption Monitor

Xeon Platinum 8490H

Processor: Intel Xeon Platinum 8490H @ 3.50GHz (60 Cores / 120 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 512GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 16 April 2024 00:42 by user phoronix.

Xeon Platinum 8490H 2P

Processor: 2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 17 April 2024 09:38 by user phoronix.

Xeon Platinum 8592+

Processor: INTEL XEON PLATINUM 8592+ @ 3.90GHz (64 Cores / 128 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 512GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 11 April 2024 18:15 by user phoronix.

Xeon Platinum 8592+ 2P

Processor: 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 8 April 2024 10:49 by user phoronix.

Xeon Max 9468

Processor: Intel Xeon Max 9468 @ 3.50GHz (48 Cores / 96 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 576GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 21 April 2024 09:58 by user phoronix.

Xeon Max 9468 2P

Processor: 2 x Intel Xeon Max 9468 @ 3.50GHz (96 Cores / 192 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1136GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 22 April 2024 15:30 by user phoronix.

Xeon Max 9480

Processor: Intel Xeon Max 9480 @ 3.50GHz (56 Cores / 112 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 576GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 26 April 2024 09:38 by user phoronix.

Xeon Max 9480 2P

Processor: 2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1136GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 27 April 2024 16:18 by user phoronix.

Xeon Platinum 8380 2P

Processor: 2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads), Motherboard: Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS), Chipset: Intel Ice Lake IEH, Memory: 512GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1080

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd0003d1
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Mitigation of Microcode + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 7 May 2024 16:33 by user phoronix.

Xeon Platinum 8380

Processor: Intel Xeon Platinum 8380 @ 3.40GHz (40 Cores / 80 Threads), Motherboard: Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS), Chipset: Intel Ice Lake IEH, Memory: 256GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1080

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd0003d1
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Mitigation of Microcode + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 9 May 2024 13:53 by user phoronix.

EPYC 9684X 2P

Processor: 2 x AMD EPYC 9684X 96-Core @ 2.55GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 11 May 2024 02:04 by user phoronix.

EPYC 9684X

Processor: AMD EPYC 9684X 96-Core @ 2.55GHz (96 Cores / 192 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEG, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 12 May 2024 12:29 by user phoronix.

EPYC 9654

Processor: AMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEG, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 13 May 2024 14:14 by user phoronix.

EPYC 9654 2P

Processor: 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 14 May 2024 15:08 by user phoronix.

EPYC 9754

Processor: AMD EPYC 9754 128-Core @ 2.25GHz (128 Cores / 256 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEG, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00116
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 15 May 2024 21:09 by user phoronix.

EPYC 9754 2P

Processor: 2 x AMD EPYC 9754 128-Core @ 2.25GHz (256 Cores / 512 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00116
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 17 May 2024 00:34 by user phoronix.

EPYC 8534P

Processor: AMD EPYC 8534P 64-Core @ 2.30GHz (64 Cores / 128 Threads), Motherboard: AMD Cinnabar (RCB1009C BIOS), Chipset: AMD Device 14a4, Memory: 6 x 32GB DDR5-4800MT/s Samsung M321R4GA0BB0-CQKMG, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92 + 2000GB Corsair MP700 PRO, Graphics: ASPEED, Network: 2 x Broadcom NetXtreme BCM5720 PCIe

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00213
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 18 May 2024 13:07 by user phoronix.

EPYC 8534PN

Processor: AMD EPYC 8534PN 64-Core @ 2.00GHz (64 Cores / 128 Threads), Motherboard: AMD Cinnabar (RCB1009C BIOS), Chipset: AMD Device 14a4, Memory: 6 x 32GB DDR5-4800MT/s Samsung M321R4GA0BB0-CQKMG, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: 2 x Broadcom NetXtreme BCM5720 PCIe

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00213
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 19 May 2024 17:06 by user phoronix.

Xeon 6766E 2P

Processor: 2 x Intel Xeon 6766E @ 2.70GHz (288 Cores), Motherboard: Quanta Cloud QuantaGrid D55Q-2U S7Q-MB-MPS-MDP (2A05.QCT001 BIOS), Chipset: Intel Ice Lake IEH, Memory: 512GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS + 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: 2 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 24 May 2024 12:45 by user phoronix.

Xeon 6766E

Processor: Intel Xeon 6766E @ 2.70GHz (144 Cores), Motherboard: Quanta Cloud QuantaGrid D55Q-2U S7Q-MB-MPS-MDP (2A05.QCT001 BIOS), Chipset: Intel Ice Lake IEH, Memory: 256GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92 + 3201GB Micron_7450_MTFDKCB3T2TFS, Graphics: ASPEED, Network: 2 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 25 May 2024 14:43 by user phoronix.

Xeon 6780E

Processor: Intel Xeon 6780E @ 3.00GHz (144 Cores), Motherboard: Quanta Cloud QuantaGrid D55Q-2U S7Q-MB-MPS-MDP (2A05.QCT001 BIOS), Chipset: Intel Ice Lake IEH, Memory: 256GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS + 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: 2 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 26 May 2024 18:38 by user phoronix.

Xeon 6780E 2P

Processor: 2 x Intel Xeon 6780E @ 3.00GHz (288 Cores), Motherboard: Quanta Cloud QuantaGrid D55Q-2U S7Q-MB-MPS-MDP (2A05.QCT001 BIOS), Chipset: Intel Ice Lake IEH, Memory: 512GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS + 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: 2 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA

OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131
Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)
Python Notes: Python 3.12.2
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 27 May 2024 18:06 by user phoronix.