Ampere Altra versus Intel Sierra Forest benchmarks by Michael Larabel for a future article.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2406055-NE-INTELSRFA82 Intel Xeon 6700E Sierra Forest vs. Ampere Altra vs. AMD EPYC - Phoronix Test Suite Intel Xeon 6700E Sierra Forest vs. Ampere Altra vs. AMD EPYC Ampere Altra versus Intel Sierra Forest benchmarks by Michael Larabel for a future article.
HTML result view exported from: https://openbenchmarking.org/result/2406055-NE-INTELSRFA82&grw&sro .
Intel Xeon 6700E Sierra Forest vs. Ampere Altra vs. AMD EPYC Processor Motherboard Chipset Memory Disk Graphics Network Monitor OS Kernel Compiler File-System Screen Resolution EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 Xeon Max 9480 Ampere Altra Max M128-30 AMD EPYC 8534P 64-Core @ 2.30GHz (64 Cores / 128 Threads) AMD Cinnabar (RCB1009C BIOS) AMD Device 14a4 6 x 32GB DDR5-4800MT/s Samsung M321R4GA0BB0-CQKMG 2 x 1920GB KIOXIA KCD8XPUG1T92 + 2000GB Corsair MP700 PRO ASPEED 2 x Broadcom NetXtreme BCM5720 PCIe Ubuntu 24.04 6.9.0-060900rc3-generic (x86_64) GCC 13.2.0 ext4 1920x1200 AMD EPYC 8534PN 64-Core @ 2.00GHz (64 Cores / 128 Threads) 2 x 1920GB KIOXIA KCD8XPUG1T92 AMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads) AMD Titanite_4G (RTI1007B BIOS) 12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEG Broadcom NetXtreme BCM5720 PCIe AMD EPYC 9684X 96-Core @ 2.55GHz (96 Cores / 192 Threads) AMD EPYC 9754 128-Core @ 2.25GHz (128 Cores / 256 Threads) Intel Xeon 6766E @ 2.70GHz (144 Cores) Quanta Cloud QuantaGrid D55Q-2U S7Q-MB-MPS-MDP (2A05.QCT001 BIOS) Intel Ice Lake IEH 256GB 2 x 1920GB KIOXIA KCD8XPUG1T92 + 3201GB Micron_7450_MTFDKCB3T2TFS 2 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA Intel Xeon 6780E @ 3.00GHz (144 Cores) 3201GB Micron_7450_MTFDKCB3T2TFS + 2 x 1920GB KIOXIA KCD8XPUG1T92 Intel Xeon Platinum 8380 @ 3.40GHz (40 Cores / 80 Threads) Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS) 2 x 1920GB KIOXIA KCD8XPUG1T92 VE228 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP 1920x1080 Intel Xeon Platinum 8490H @ 3.50GHz (60 Cores / 120 Threads) Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS) Intel Device 1bce 512GB 1920x1200 INTEL XEON PLATINUM 8592+ @ 3.90GHz (64 Cores / 128 Threads) Intel Xeon Max 9468 @ 3.50GHz (48 Cores / 96 Threads) 576GB Intel Xeon Max 9480 @ 3.50GHz (56 Cores / 112 Threads) ARMv8 Neoverse-N1 @ 3.00GHz (128 Cores) GIGABYTE G242-P36-00 MP32-AR2-00 v01000100 (F31k SCP: 2.10.20220531 BIOS) Ampere Computing LLC Altra PCI Root Complex A 16 x 32GB DDR4-3200MT/s Samsung M393A4K40DB3-CWE 800GB Micron_7450_MTFDKBA800TFS + 2 x 1920GB KIOXIA KCD8XPUG1T92 2 x Intel I350 6.9.0-060900-generic (aarch64) 1024x768 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - EPYC 8534P: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - EPYC 8534PN: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - EPYC 9654: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - EPYC 9684X: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - EPYC 9754: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Xeon 6766E: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Xeon 6780E: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Xeon Platinum 8380: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Xeon Platinum 8490H: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Xeon Platinum 8592+: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Xeon Max 9468: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Xeon Max 9480: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Ampere Altra Max M128-30: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-faVlZy/gcc-13-13.2.0/debian/tmp-nvptx/usr --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto --without-cuda-driver -v Processor Details - EPYC 8534P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00213 - EPYC 8534PN: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00213 - EPYC 9654: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144 - EPYC 9684X: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144 - EPYC 9754: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00116 - Xeon 6766E: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131 - Xeon 6780E: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131 - Xeon Platinum 8380: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd0003d1 - Xeon Platinum 8490H: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590 - Xeon Platinum 8592+: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200 - Xeon Max 9468: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290 - Xeon Max 9480: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290 - Ampere Altra Max M128-30: Scaling Governor: cppc_cpufreq performance (Boost: Disabled) Java Details - EPYC 8534P: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - EPYC 8534PN: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - EPYC 9654: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - EPYC 9684X: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - EPYC 9754: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - Xeon 6766E: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - Xeon 6780E: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - Xeon Platinum 8380: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - Xeon Platinum 8490H: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - Xeon Platinum 8592+: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - Xeon Max 9468: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - Xeon Max 9480: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - Ampere Altra Max M128-30: OpenJDK Runtime Environment (build 21.0.3+9-Ubuntu-1ubuntu1) Python Details - Python 3.12.2 Security Details - EPYC 8534P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 8534PN: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 9654: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 9684X: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 9754: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Xeon 6766E: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Xeon 6780E: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Xeon Platinum 8380: gather_data_sampling: Mitigation of Microcode + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon Platinum 8490H: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon Platinum 8592+: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon Max 9468: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon Max 9480: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Ampere Altra Max M128-30: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected
Intel Xeon 6700E Sierra Forest vs. Ampere Altra vs. AMD EPYC xmrig: GhostRider - 1M quantlib: Multi-Threaded cloverleaf: clover_bm64_short cloverleaf: clover_bm16 pytorch: CPU - 64 - ResNet-50 pytorch: CPU - 256 - ResNet-50 pytorch: CPU - 512 - ResNet-50 llamafile: llava-v1.5-7b-q4 - CPU llamafile: wizardcoder-python-34b-v1.0.Q6_K - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU mt-dgemm: Sustained Floating-Point Rate minife: Small coremark: CoreMark Size 666 - Iterations Per Second stockfish: Chess Benchmark compress-7zip: Compression Rating compress-7zip: Decompression Rating john-the-ripper: Blowfish john-the-ripper: bcrypt build-llvm: Ninja m-queens: Time To Solve build-linux-kernel: allmodconfig graphics-magick: Enhanced x265: Bosphorus 4K avifenc: 0 avifenc: 2 avifenc: 6 avifenc: 6, Lossless avifenc: 10, Lossless build-nodejs: Time To Compile liquid-dsp: 128 - 256 - 57 liquid-dsp: 128 - 256 - 512 liquid-dsp: 256 - 256 - 57 liquid-dsp: 256 - 256 - 512 srsran: PDSCH Processor Benchmark, Throughput Total speedb: Rand Read speedb: Read While Writing openssl: SHA256 openssl: SHA512 clickhouse: 100M Rows Hits Dataset, First Run / Cold Cache clickhouse: 100M Rows Hits Dataset, Second Run clickhouse: 100M Rows Hits Dataset, Third Run rocksdb: Rand Read rocksdb: Read While Writing pgbench: 100 - 1000 - Read Write pgbench: 100 - 1000 - Read Write - Average Latency pgbench: 100 - 1000 - Read Only pgbench: 100 - 1000 - Read Only - Average Latency EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 Xeon Max 9480 Ampere Altra Max M128-30 4660.0 172566.8 57.38 495.25 33.49 33.68 33.76 21.00 5.16 317.38 100.67 1542.61 41.38 21.817577 24526.0 2274636.131544 99198144 331357 367989 102198 102222 205.014 13.250 406.414 172 28.13 75.864 41.657 3.484 7.182 5.735 277.525 2982800000 809916667 3116933333 821013333 19375.9 274091778 12053901 74584721007 24378460820 323.59 337.32 338.84 266186537 9333645 61272 16.321 2606500 0.384 4564.3 153920.8 57.54 498.22 33.23 33.30 33.18 20.65 5.11 293.07 109.00 1396.78 45.71 20.997732 24548.8 2069432.528093 90658156 319094 338355 93473 93472 215.925 14.493 438.168 163 27.74 78.241 42.605 3.623 7.301 5.734 288.118 2687066667 731756667 2793700000 741740000 19485.8 242940110 11882103 67806730387 22194470973 322.69 337.44 335.46 234992636 8934176 55395 18.053 2416375 0.414 14207.7 294183.2 46.50 334.30 35.01 34.90 34.65 25.75 8.35 525.88 91.16 2739.01 34.92 39.086262 50909.6 3926265.277120 197708350 549500 642626 166541 166541 135.666 7.738 311.825 264 31.72 61.992 34.148 2.756 5.799 4.792 164.021 4256300000 1158166667 5266466667 1362166667 27695.2 428557054 18024993 126475137690 39627575497 536.82 562.50 559.55 409272949 14608544 79987 12.502 3603261 0.278 15786.6 319827.2 42.17 245.82 34.71 34.90 34.69 25.38 8.48 576.98 83.11 2986.33 32.00 45.245794 53167.8 4152864.875380 214524659 579112 716065 192574 192898 124.455 6.950 290.341 300 32.12 61.629 34.044 2.723 5.757 4.770 147.837 4755333333 1368733333 5811900000 1570400000 29384.9 537633034 19595777 138409588983 45865131913 566.31 597.73 595.19 523310091 14158419 79492 12.580 3989358 0.251 9320.5 374413.5 48.36 400.52 27.68 27.78 27.53 20.64 7.47 621.42 102.84 3280.25 38.85 44.970826 50139.9 4525288.003014 189763799 575440 780871 220188 220188 146.761 6.350 337.685 304 28.16 73.271 40.351 3.251 6.853 5.662 186.103 4714500000 1369800000 6401366667 1744700000 25194.6 589951070 22829426 161269162280 52746634113 433.79 450.12 458.96 573235452 15776186 72244 13.843 3422492 0.292 5315.7 233836.3 38.01 314.88 26.89 26.82 26.91 8.56 5.39 138.53 259.66 832.29 172.72 15.941604 40441.0 2915609.747368 122794246 413851 421063 190209 190058 184.202 11.479 274.855 270 20.22 140.859 76.474 4.243 9.188 7.507 246.848 3736300000 719626667 4259433333 848376667 27281.9 596955494 17548934 129975994733 40605137923 365.62 381.05 379.92 574749552 11340389 79191 12.628 1748658 0.572 5753.9 262432.6 38.01 313.50 30.69 30.86 30.87 9.60 5.58 149.63 240.38 934.97 153.76 17.853682 40626.4 3340274.034309 125194066 438048 463768 211449 211311 169.447 10.301 251.195 299 21.30 126.966 69.343 3.872 8.359 6.849 228.571 4136766667 796340000 4714700000 940270000 29804.4 673159217 17945745 144163027280 45088755640 388.29 403.96 400.52 645309483 11864815 86677 11.537 1846080 0.542 2593.2 91036.5 60.89 512.36 48.99 48.89 48.99 19.11 4.41 156.13 127.89 637.76 62.64 13.494557 22957.3 1218453.342873 51099545 243732 188345 56939 56939 298.409 24.175 612.782 123 29.76 100.461 52.227 4.093 8.201 5.906 423.626 1554666667 539226667 1610466667 542606667 13537.7 130359145 7147120 27858504490 10980940093 326.65 339.67 342.99 125584953 5539870 61233 16.341 1720762 0.581 5808.8 179647.5 39.48 328.47 56.01 54.84 56.44 20.95 5.85 477.77 62.46 1643.43 36.20 23.543705 35230.1 2194630.600449 96887479 388190 287862 94513 94551 187.017 15.211 362.454 216 37.86 69.931 37.752 3.169 6.278 4.923 254.003 3181266667 918566667 3500833333 1020833333 24688.5 276179617 10695360 61806994523 22219927723 465.50 486.05 481.66 265366170 7841738 71227 14.040 1748146 0.572 8378.3 195648.8 39.38 410.59 63.06 63.60 63.30 16.61 4.08 592.20 26.85 2924.66 21.87 29.141078 31830.2 2369998.356940 109766345 441636 338146 105831 105781 165.048 14.257 316.902 228 38.93 64.475 34.791 2.971 5.784 4.456 214.431 3503200000 1152933333 3806833333 1178766667 26378.1 315178381 12168413 66573957920 23886054770 437.20 455.79 458.23 297517946 8926893 75396 13.264 1699046 0.589 5446.8 143755.3 41.43 351.29 51.55 52.97 51.05 7.67 1.47 415.96 28.73 2074.30 23.12 19.768930 20091.1 1614763.703237 68019088 314716 207738 67893 67875 212.482 21.030 428.387 160 29.05 76.915 41.125 3.730 6.836 4.916 270.380 2670033333 800186667 2848933333 838530000 21286.6 211457048 8795408 44439185187 16199261277 446.40 465.06 470.02 205346154 7439663 69969 14.292 1792636 0.559 6122.3 162727.4 42.22 357.57 51.35 51.56 51.86 8.13 1.54 467.08 38.50 2243.84 24.94 22.539990 18621.2 1855135.326098 73592230 342363 243347 79152 79144 197.844 18.102 384.063 181 31.40 73.060 39.876 3.550 6.605 4.867 252.648 2972400000 882200000 3222533333 944550000 15081.0 244070674 9988176 51840436763 18893980783 461.62 474.68 476.91 234469939 7366500 72225 13.845 1607424 0.622 2514.1 251819.4 63.16 564.86 24.51 24.24 23.83 0.99 0.59 40.05 795.07 146.26 218.35 17.925396 24015.5 2823599.455709 59497098 319039 539366 108532 108723 293.185 8.423 366.867 266 17.45 211.954 134.170 3.816 7.091 5.521 676.786 2825033333 365283333 2839066667 367020000 13714.6 452482473 10457238 99240430433 34282834893 243.61 244.83 247.83 399277797 9445415 57787 17.310 1725175 0.580 OpenBenchmarking.org
Xmrig Variant: GhostRider - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.21 Variant: GhostRider - Hash Count: 1M Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 3K 6K 9K 12K 15K SE +/- 9.27, N = 3 SE +/- 30.53, N = 3 SE +/- 41.94, N = 3 SE +/- 117.32, N = 3 SE +/- 10.36, N = 3 SE +/- 61.27, N = 3 SE +/- 19.74, N = 3 SE +/- 43.00, N = 3 SE +/- 12.93, N = 3 SE +/- 14.78, N = 3 SE +/- 32.20, N = 2 SE +/- 23.16, N = 3 SE +/- 44.68, N = 3 2514.1 4660.0 4564.3 14207.7 15786.6 9320.5 5315.7 5753.9 5446.8 6122.3 2593.2 5808.8 8378.3 -maes -maes -maes -maes -maes -maes -maes -maes -maes -maes -maes -maes 1. (CXX) g++ options: -fexceptions -fno-rtti -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
QuantLib Configuration: Multi-Threaded OpenBenchmarking.org MFLOPS, More Is Better QuantLib 1.32 Configuration: Multi-Threaded Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 80K 160K 240K 320K 400K SE +/- 458.48, N = 3 SE +/- 82.80, N = 3 SE +/- 86.28, N = 3 SE +/- 86.78, N = 3 SE +/- 412.72, N = 3 SE +/- 156.35, N = 3 SE +/- 306.14, N = 3 SE +/- 846.02, N = 3 SE +/- 155.19, N = 3 SE +/- 40.48, N = 3 SE +/- 395.04, N = 3 SE +/- 105.60, N = 3 SE +/- 63.14, N = 3 251819.4 172566.8 153920.8 294183.2 319827.2 374413.5 233836.3 262432.6 143755.3 162727.4 91036.5 179647.5 195648.8 1. (CXX) g++ options: -O3 -march=native -fPIE -pie
CloverLeaf Input: clover_bm64_short OpenBenchmarking.org Seconds, Fewer Is Better CloverLeaf 1.3 Input: clover_bm64_short Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 14 28 42 56 70 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 2.15, N = 15 SE +/- 1.81, N = 15 SE +/- 2.07, N = 12 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.15, N = 3 SE +/- 0.17, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 63.16 57.38 57.54 46.50 42.17 48.36 38.01 38.01 41.43 42.22 60.89 39.48 39.38 1. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
CloverLeaf Input: clover_bm16 OpenBenchmarking.org Seconds, Fewer Is Better CloverLeaf 1.3 Input: clover_bm16 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 120 240 360 480 600 SE +/- 0.16, N = 3 SE +/- 0.79, N = 3 SE +/- 1.08, N = 3 SE +/- 3.79, N = 9 SE +/- 2.24, N = 3 SE +/- 4.99, N = 9 SE +/- 0.11, N = 3 SE +/- 0.00, N = 3 SE +/- 1.43, N = 3 SE +/- 2.03, N = 3 SE +/- 1.58, N = 3 SE +/- 0.13, N = 3 SE +/- 0.54, N = 3 564.86 495.25 498.22 334.30 245.82 400.52 314.88 313.50 351.29 357.57 512.36 328.47 410.59 1. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
PyTorch Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 14 28 42 56 70 SE +/- 0.15, N = 3 SE +/- 0.06, N = 3 SE +/- 0.18, N = 3 SE +/- 0.26, N = 3 SE +/- 0.10, N = 3 SE +/- 0.10, N = 3 SE +/- 0.14, N = 3 SE +/- 0.33, N = 5 SE +/- 0.71, N = 3 SE +/- 0.62, N = 3 SE +/- 0.14, N = 3 SE +/- 0.24, N = 3 SE +/- 0.12, N = 3 24.51 33.49 33.23 35.01 34.71 27.68 26.89 30.69 51.55 51.35 48.99 56.01 63.06 MIN: 22.33 / MAX: 24.82 MIN: 32.03 / MAX: 34.13 MIN: 31.97 / MAX: 33.93 MIN: 33.84 / MAX: 36.39 MIN: 33.58 / MAX: 35.7 MIN: 26.61 / MAX: 28.44 MIN: 24.84 / MAX: 27.54 MIN: 27.43 / MAX: 32.15 MIN: 37.49 / MAX: 54.33 MIN: 41.6 / MAX: 53.81 MIN: 47.13 / MAX: 49.74 MIN: 51.84 / MAX: 59.12 MIN: 33.2 / MAX: 65.54
PyTorch Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 14 28 42 56 70 SE +/- 0.09, N = 3 SE +/- 0.18, N = 3 SE +/- 0.13, N = 3 SE +/- 0.21, N = 3 SE +/- 0.09, N = 3 SE +/- 0.08, N = 3 SE +/- 0.12, N = 3 SE +/- 0.13, N = 3 SE +/- 0.76, N = 3 SE +/- 0.62, N = 3 SE +/- 0.04, N = 3 SE +/- 0.52, N = 3 SE +/- 0.64, N = 3 24.24 33.68 33.30 34.90 34.90 27.78 26.82 30.86 52.97 51.56 48.89 54.84 63.60 MIN: 21.29 / MAX: 24.51 MIN: 31.27 / MAX: 34.43 MIN: 32.26 / MAX: 33.94 MIN: 33.85 / MAX: 35.99 MIN: 34.15 / MAX: 35.71 MIN: 26.81 / MAX: 28.37 MIN: 10.77 / MAX: 27.82 MIN: 28.02 / MAX: 31.65 MIN: 33.28 / MAX: 55.78 MIN: 30.49 / MAX: 54.7 MIN: 45.35 / MAX: 49.3 MIN: 46.5 / MAX: 58.5 MIN: 37.79 / MAX: 65.67
PyTorch Device: CPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 14 28 42 56 70 SE +/- 0.24, N = 5 SE +/- 0.08, N = 3 SE +/- 0.11, N = 3 SE +/- 0.10, N = 3 SE +/- 0.19, N = 3 SE +/- 0.04, N = 3 SE +/- 0.24, N = 3 SE +/- 0.02, N = 3 SE +/- 0.72, N = 3 SE +/- 0.43, N = 15 SE +/- 0.17, N = 3 SE +/- 0.12, N = 3 SE +/- 0.19, N = 3 23.83 33.76 33.18 34.65 34.69 27.53 26.91 30.87 51.05 51.86 48.99 56.44 63.30 MIN: 12.48 / MAX: 24.59 MIN: 31.39 / MAX: 34.3 MIN: 32.26 / MAX: 33.81 MIN: 33.72 / MAX: 35.48 MIN: 33.34 / MAX: 35.97 MIN: 26.63 / MAX: 28.06 MIN: 25.38 / MAX: 27.92 MIN: 27.91 / MAX: 31.42 MIN: 40.71 / MAX: 53.89 MIN: 30.55 / MAX: 55.87 MIN: 47.82 / MAX: 49.69 MIN: 48.09 / MAX: 58.6 MIN: 48.94 / MAX: 65.25
Llamafile Test: llava-v1.5-7b-q4 - Acceleration: CPU OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.7 Test: llava-v1.5-7b-q4 - Acceleration: CPU Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 6 12 18 24 30 SE +/- 0.09, N = 12 SE +/- 0.11, N = 4 SE +/- 0.07, N = 4 SE +/- 0.02, N = 5 SE +/- 0.10, N = 5 SE +/- 0.05, N = 4 SE +/- 0.08, N = 3 SE +/- 0.30, N = 15 SE +/- 0.10, N = 3 SE +/- 0.02, N = 3 SE +/- 0.11, N = 3 SE +/- 0.15, N = 4 SE +/- 0.17, N = 4 0.99 21.00 20.65 25.75 25.38 20.64 8.56 9.60 7.67 8.13 19.11 20.95 16.61
Llamafile Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.7 Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 2 4 6 8 10 SE +/- 0.08, N = 8 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 0.59 5.16 5.11 8.35 8.48 7.47 5.39 5.58 1.47 1.54 4.41 5.85 4.08
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 130 260 390 520 650 SE +/- 0.04, N = 3 SE +/- 0.39, N = 3 SE +/- 0.13, N = 3 SE +/- 4.59, N = 7 SE +/- 4.29, N = 11 SE +/- 6.34, N = 5 SE +/- 0.25, N = 3 SE +/- 0.03, N = 3 SE +/- 1.21, N = 3 SE +/- 4.09, N = 3 SE +/- 0.45, N = 3 SE +/- 0.17, N = 3 SE +/- 0.54, N = 3 40.05 317.38 293.07 525.88 576.98 621.42 138.53 149.63 415.96 467.08 156.13 477.77 592.20 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 200 400 600 800 1000 SE +/- 0.82, N = 3 SE +/- 0.13, N = 3 SE +/- 0.05, N = 3 SE +/- 0.77, N = 7 SE +/- 0.60, N = 11 SE +/- 1.05, N = 5 SE +/- 0.48, N = 3 SE +/- 0.06, N = 3 SE +/- 0.12, N = 3 SE +/- 0.34, N = 3 SE +/- 0.39, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 795.07 100.67 109.00 91.16 83.11 102.84 259.66 240.38 28.73 38.50 127.89 62.46 26.85 MIN: 583.77 / MAX: 1627.8 MIN: 233.78 / MAX: 289.08 MIN: 218.44 / MAX: 254.1 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 700 1400 2100 2800 3500 SE +/- 0.76, N = 3 SE +/- 3.51, N = 3 SE +/- 0.47, N = 3 SE +/- 4.84, N = 3 SE +/- 4.06, N = 3 SE +/- 7.27, N = 3 SE +/- 1.73, N = 3 SE +/- 0.61, N = 3 SE +/- 3.41, N = 3 SE +/- 4.55, N = 3 SE +/- 4.60, N = 3 SE +/- 1.46, N = 3 SE +/- 0.73, N = 3 146.26 1542.61 1396.78 2739.01 2986.33 3280.25 832.29 934.97 2074.30 2243.84 637.76 1643.43 2924.66 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 50 100 150 200 250 SE +/- 1.16, N = 3 SE +/- 0.09, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.34, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.46, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 218.35 41.38 45.71 34.92 32.00 38.85 172.72 153.76 23.12 24.94 62.64 36.20 21.87 MIN: 206.82 / MAX: 376.74 MIN: 25.29 / MAX: 59.37 MIN: 31.06 / MAX: 64.63 MIN: 22.04 / MAX: 54.74 MIN: 21.72 / MAX: 52.65 MIN: 23.02 / MAX: 69.97 MIN: 157.02 / MAX: 193.61 MIN: 141.2 / MAX: 169.62 MIN: 40.14 / MAX: 79.92 MIN: 20.73 / MAX: 45.28 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
ACES DGEMM Sustained Floating-Point Rate OpenBenchmarking.org GFLOP/s, More Is Better ACES DGEMM 1.0 Sustained Floating-Point Rate Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 10 20 30 40 50 SE +/- 0.07, N = 4 SE +/- 0.16, N = 5 SE +/- 0.10, N = 5 SE +/- 0.22, N = 7 SE +/- 0.40, N = 7 SE +/- 0.17, N = 7 SE +/- 0.01, N = 4 SE +/- 0.01, N = 4 SE +/- 0.04, N = 4 SE +/- 0.09, N = 5 SE +/- 0.01, N = 3 SE +/- 0.09, N = 5 SE +/- 0.08, N = 6 17.93 21.82 21.00 39.09 45.25 44.97 15.94 17.85 19.77 22.54 13.49 23.54 29.14 1. (CC) gcc options: -O3 -march=native -fopenmp
miniFE Problem Size: Small OpenBenchmarking.org CG Mflops, More Is Better miniFE 2.2 Problem Size: Small Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 11K 22K 33K 44K 55K SE +/- 8.98, N = 4 SE +/- 49.20, N = 4 SE +/- 42.17, N = 4 SE +/- 42.89, N = 5 SE +/- 92.04, N = 5 SE +/- 53.07, N = 5 SE +/- 19.87, N = 4 SE +/- 8.42, N = 4 SE +/- 601.03, N = 12 SE +/- 572.00, N = 12 SE +/- 54.57, N = 4 SE +/- 11.14, N = 4 SE +/- 135.77, N = 4 24015.5 24526.0 24548.8 50909.6 53167.8 50139.9 40441.0 40626.4 20091.1 18621.2 22957.3 35230.1 31830.2 1. (CXX) g++ options: -O3 -fopenmp -lmpi_cxx -lmpi
Coremark CoreMark Size 666 - Iterations Per Second OpenBenchmarking.org Iterations/Sec, More Is Better Coremark 1.0 CoreMark Size 666 - Iterations Per Second Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 1000K 2000K 3000K 4000K 5000K SE +/- 1087.84, N = 3 SE +/- 1374.66, N = 3 SE +/- 11678.22, N = 3 SE +/- 10132.66, N = 3 SE +/- 54326.71, N = 3 SE +/- 4775.53, N = 3 SE +/- 10294.77, N = 3 SE +/- 40214.40, N = 15 SE +/- 1747.99, N = 3 SE +/- 5202.86, N = 3 SE +/- 927.64, N = 3 SE +/- 9256.47, N = 3 SE +/- 4635.95, N = 3 2823599.46 2274636.13 2069432.53 3926265.28 4152864.88 4525288.00 2915609.75 3340274.03 1614763.70 1855135.33 1218453.34 2194630.60 2369998.36 1. (CC) gcc options: -O2 -lrt" -lrt
Stockfish Chess Benchmark OpenBenchmarking.org Nodes Per Second, More Is Better Stockfish 16.1 Chess Benchmark Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 50M 100M 150M 200M 250M SE +/- 1966844.31, N = 12 SE +/- 2397455.91, N = 12 SE +/- 2147688.02, N = 12 SE +/- 3170744.86, N = 15 SE +/- 2268830.04, N = 3 SE +/- 4652276.19, N = 12 SE +/- 3565305.92, N = 15 SE +/- 1441726.26, N = 3 SE +/- 1751369.24, N = 12 SE +/- 629927.17, N = 3 SE +/- 1466028.98, N = 9 SE +/- 1304590.97, N = 3 SE +/- 2966712.90, N = 9 59497098 99198144 90658156 197708350 214524659 189763799 122794246 125194066 68019088 73592230 51099545 96887479 109766345 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -msse4.1 -mssse3 -msse2 -mbmi2 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -msse4.1 -mssse3 -msse2 -mbmi2 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 1. (CXX) g++ options: -lgcov -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -flto -flto-partition=one -flto=jobserver
7-Zip Compression Test: Compression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Compression Rating Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 120K 240K 360K 480K 600K SE +/- 1146.13, N = 3 SE +/- 268.94, N = 3 SE +/- 206.69, N = 3 SE +/- 719.89, N = 3 SE +/- 1520.59, N = 3 SE +/- 1188.96, N = 3 SE +/- 610.46, N = 3 SE +/- 933.46, N = 3 SE +/- 1836.55, N = 3 SE +/- 2258.81, N = 3 SE +/- 248.73, N = 3 SE +/- 1535.53, N = 3 SE +/- 1982.97, N = 3 319039 331357 319094 549500 579112 575440 413851 438048 314716 342363 243732 388190 441636 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
7-Zip Compression Test: Decompression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Decompression Rating Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 200K 400K 600K 800K 1000K SE +/- 128.55, N = 3 SE +/- 120.28, N = 3 SE +/- 81.21, N = 3 SE +/- 111.53, N = 3 SE +/- 1085.99, N = 3 SE +/- 291.68, N = 3 SE +/- 343.82, N = 3 SE +/- 258.19, N = 3 SE +/- 916.22, N = 3 SE +/- 374.59, N = 3 SE +/- 309.57, N = 3 SE +/- 61.74, N = 3 SE +/- 119.21, N = 3 539366 367989 338355 642626 716065 780871 421063 463768 207738 243347 188345 287862 338146 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
John The Ripper Test: Blowfish OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: Blowfish Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 50K 100K 150K 200K 250K SE +/- 191.33, N = 3 SE +/- 13.72, N = 3 SE +/- 20.54, N = 3 SE +/- 38.33, N = 3 SE +/- 98.33, N = 3 SE +/- 1.33, N = 3 SE +/- 174.44, N = 3 SE +/- 14.67, N = 3 SE +/- 17.33, N = 3 SE +/- 8.67, N = 3 SE +/- 6.33, N = 3 SE +/- 11.39, N = 3 SE +/- 79.75, N = 3 108532 102198 93473 166541 192574 220188 190209 211449 67893 79152 56939 94513 105831 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 1. (CC) gcc options: -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
John The Ripper Test: bcrypt OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: bcrypt Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 50K 100K 150K 200K 250K SE +/- 14.72, N = 3 SE +/- 22.28, N = 3 SE +/- 0.00, N = 3 SE +/- 20.00, N = 3 SE +/- 154.46, N = 3 SE +/- 1.33, N = 3 SE +/- 32.84, N = 3 SE +/- 87.49, N = 3 SE +/- 8.84, N = 3 SE +/- 8.67, N = 3 SE +/- 6.33, N = 3 SE +/- 10.67, N = 3 SE +/- 46.28, N = 3 108723 102222 93472 166541 192898 220188 190058 211311 67875 79144 56939 94551 105781 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 1. (CC) gcc options: -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
Timed LLVM Compilation Build System: Ninja OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 16.0 Build System: Ninja Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 60 120 180 240 300 SE +/- 0.96, N = 3 SE +/- 0.20, N = 3 SE +/- 0.10, N = 3 SE +/- 0.31, N = 3 SE +/- 0.27, N = 3 SE +/- 0.74, N = 3 SE +/- 0.20, N = 3 SE +/- 0.06, N = 3 SE +/- 0.19, N = 3 SE +/- 0.36, N = 3 SE +/- 1.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 293.19 205.01 215.93 135.67 124.46 146.76 184.20 169.45 212.48 197.84 298.41 187.02 165.05
m-queens Time To Solve OpenBenchmarking.org Seconds, Fewer Is Better m-queens 1.2 Time To Solve Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 6 12 18 24 30 SE +/- 0.002, N = 5 SE +/- 0.019, N = 4 SE +/- 0.029, N = 4 SE +/- 0.019, N = 6 SE +/- 0.025, N = 6 SE +/- 0.021, N = 6 SE +/- 0.039, N = 5 SE +/- 0.032, N = 5 SE +/- 0.031, N = 3 SE +/- 0.035, N = 3 SE +/- 0.023, N = 3 SE +/- 0.025, N = 4 SE +/- 0.030, N = 4 8.423 13.250 14.493 7.738 6.950 6.350 11.479 10.301 21.030 18.102 24.175 15.211 14.257 1. (CXX) g++ options: -fopenmp -O2 -march=native
Timed Linux Kernel Compilation Build: allmodconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.8 Build: allmodconfig Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 130 260 390 520 650 SE +/- 1.15, N = 3 SE +/- 0.91, N = 3 SE +/- 0.78, N = 3 SE +/- 0.49, N = 3 SE +/- 0.37, N = 3 SE +/- 1.05, N = 3 SE +/- 0.76, N = 3 SE +/- 0.67, N = 3 SE +/- 0.61, N = 3 SE +/- 0.67, N = 3 SE +/- 0.35, N = 3 SE +/- 0.80, N = 3 SE +/- 0.72, N = 3 366.87 406.41 438.17 311.83 290.34 337.69 274.86 251.20 428.39 384.06 612.78 362.45 316.90
GraphicsMagick Operation: Enhanced OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Enhanced Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 SE +/- 0.67, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.67, N = 3 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 266 172 163 264 300 304 270 299 160 181 123 216 228 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
x265 Video Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better x265 3.6 Video Input: Bosphorus 4K Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 9 18 27 36 45 SE +/- 0.14, N = 9 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.08, N = 3 SE +/- 0.11, N = 3 SE +/- 0.02, N = 3 SE +/- 0.11, N = 3 SE +/- 0.13, N = 3 SE +/- 0.08, N = 3 SE +/- 0.39, N = 3 SE +/- 0.13, N = 3 SE +/- 0.11, N = 4 SE +/- 0.06, N = 4 17.45 28.13 27.74 31.72 32.12 28.16 20.22 21.30 29.05 31.40 29.76 37.86 38.93 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
libavif avifenc Encoder Speed: 0 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 0 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 50 100 150 200 250 SE +/- 0.09, N = 3 SE +/- 0.19, N = 3 SE +/- 0.18, N = 3 SE +/- 0.01, N = 3 SE +/- 0.12, N = 3 SE +/- 0.13, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.15, N = 3 SE +/- 0.22, N = 3 SE +/- 0.52, N = 3 SE +/- 0.32, N = 3 SE +/- 0.08, N = 3 211.95 75.86 78.24 61.99 61.63 73.27 140.86 126.97 76.92 73.06 100.46 69.93 64.48 1. (CXX) g++ options: -O3 -fPIC -lm
libavif avifenc Encoder Speed: 2 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 2 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 30 60 90 120 150 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.41, N = 3 SE +/- 0.21, N = 3 SE +/- 0.31, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 134.17 41.66 42.61 34.15 34.04 40.35 76.47 69.34 41.13 39.88 52.23 37.75 34.79 1. (CXX) g++ options: -O3 -fPIC -lm
libavif avifenc Encoder Speed: 6 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 6 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 0.9547 1.9094 2.8641 3.8188 4.7735 SE +/- 0.007, N = 8 SE +/- 0.016, N = 9 SE +/- 0.011, N = 9 SE +/- 0.011, N = 10 SE +/- 0.005, N = 10 SE +/- 0.002, N = 9 SE +/- 0.003, N = 8 SE +/- 0.004, N = 8 SE +/- 0.017, N = 9 SE +/- 0.011, N = 9 SE +/- 0.010, N = 8 SE +/- 0.022, N = 9 SE +/- 0.016, N = 9 3.816 3.484 3.623 2.756 2.723 3.251 4.243 3.872 3.730 3.550 4.093 3.169 2.971 1. (CXX) g++ options: -O3 -fPIC -lm
libavif avifenc Encoder Speed: 6, Lossless OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 6, Lossless Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 3 6 9 12 15 SE +/- 0.009, N = 6 SE +/- 0.009, N = 6 SE +/- 0.011, N = 6 SE +/- 0.010, N = 7 SE +/- 0.014, N = 7 SE +/- 0.007, N = 6 SE +/- 0.012, N = 5 SE +/- 0.010, N = 6 SE +/- 0.045, N = 6 SE +/- 0.033, N = 6 SE +/- 0.016, N = 6 SE +/- 0.013, N = 7 SE +/- 0.025, N = 7 7.091 7.182 7.301 5.799 5.757 6.853 9.188 8.359 6.836 6.605 8.201 6.278 5.784 1. (CXX) g++ options: -O3 -fPIC -lm
libavif avifenc Encoder Speed: 10, Lossless OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 10, Lossless Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 2 4 6 8 10 SE +/- 0.003, N = 7 SE +/- 0.006, N = 7 SE +/- 0.010, N = 7 SE +/- 0.006, N = 8 SE +/- 0.002, N = 8 SE +/- 0.004, N = 7 SE +/- 0.009, N = 6 SE +/- 0.003, N = 6 SE +/- 0.005, N = 7 SE +/- 0.015, N = 7 SE +/- 0.008, N = 7 SE +/- 0.006, N = 7 SE +/- 0.008, N = 8 5.521 5.735 5.734 4.792 4.770 5.662 7.507 6.849 4.916 4.867 5.906 4.923 4.456 1. (CXX) g++ options: -O3 -fPIC -lm
Timed Node.js Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Node.js Compilation 21.7.2 Time To Compile Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 150 300 450 600 750 SE +/- 1.19, N = 3 SE +/- 0.17, N = 3 SE +/- 0.19, N = 3 SE +/- 0.59, N = 3 SE +/- 0.50, N = 3 SE +/- 0.72, N = 3 SE +/- 0.15, N = 3 SE +/- 0.51, N = 3 SE +/- 0.53, N = 3 SE +/- 0.74, N = 3 SE +/- 0.22, N = 3 SE +/- 0.71, N = 3 SE +/- 0.52, N = 3 676.79 277.53 288.12 164.02 147.84 186.10 246.85 228.57 270.38 252.65 423.63 254.00 214.43
Liquid-DSP Threads: 128 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 57 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 1000M 2000M 3000M 4000M 5000M SE +/- 484194.63, N = 3 SE +/- 3527510.93, N = 3 SE +/- 6398003.16, N = 3 SE +/- 20120967.50, N = 3 SE +/- 6778479.02, N = 3 SE +/- 18691531.06, N = 3 SE +/- 6887912.12, N = 3 SE +/- 1909915.65, N = 3 SE +/- 2030052.00, N = 3 SE +/- 3119294.79, N = 3 SE +/- 1549551.91, N = 3 SE +/- 3116800.35, N = 3 SE +/- 5260228.13, N = 3 2825033333 2982800000 2687066667 4256300000 4755333333 4714500000 3736300000 4136766667 2670033333 2972400000 1554666667 3181266667 3503200000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 128 - Buffer Length: 256 - Filter Length: 512 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 512 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 300M 600M 900M 1200M 1500M SE +/- 17638.34, N = 3 SE +/- 390953.25, N = 3 SE +/- 431058.13, N = 3 SE +/- 1047748.91, N = 3 SE +/- 2412697.89, N = 3 SE +/- 814452.78, N = 3 SE +/- 305632.31, N = 3 SE +/- 287923.60, N = 3 SE +/- 681281.47, N = 3 SE +/- 1345523.44, N = 3 SE +/- 912164.70, N = 3 SE +/- 1740596.96, N = 3 SE +/- 2313246.88, N = 3 365283333 809916667 731756667 1158166667 1368733333 1369800000 719626667 796340000 800186667 882200000 539226667 918566667 1152933333 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 256 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 57 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 1400M 2800M 4200M 5600M 7000M SE +/- 868587.61, N = 3 SE +/- 1959875.28, N = 3 SE +/- 4481443.22, N = 3 SE +/- 2618735.91, N = 3 SE +/- 8144527.82, N = 3 SE +/- 12739745.33, N = 3 SE +/- 8015887.00, N = 3 SE +/- 6906036.01, N = 3 SE +/- 4088330.28, N = 3 SE +/- 1976810.00, N = 3 SE +/- 2935605.18, N = 3 SE +/- 5292237.50, N = 3 SE +/- 3555434.03, N = 3 2839066667 3116933333 2793700000 5266466667 5811900000 6401366667 4259433333 4714700000 2848933333 3222533333 1610466667 3500833333 3806833333 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 256 - Buffer Length: 256 - Filter Length: 512 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 512 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 400M 800M 1200M 1600M 2000M SE +/- 128970.28, N = 3 SE +/- 776881.23, N = 3 SE +/- 170391.71, N = 3 SE +/- 520683.31, N = 3 SE +/- 2676440.42, N = 3 SE +/- 1300000.00, N = 3 SE +/- 320537.74, N = 3 SE +/- 409267.64, N = 3 SE +/- 569766.03, N = 3 SE +/- 740202.67, N = 3 SE +/- 4629652.01, N = 3 SE +/- 1722723.94, N = 3 SE +/- 240370.09, N = 3 367020000 821013333 741740000 1362166667 1570400000 1744700000 848376667 940270000 838530000 944550000 542606667 1020833333 1178766667 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
srsRAN Project Test: PDSCH Processor Benchmark, Throughput Total OpenBenchmarking.org Mbps, More Is Better srsRAN Project 23.10.1-20240325 Test: PDSCH Processor Benchmark, Throughput Total Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 6K 12K 18K 24K 30K SE +/- 12.21, N = 3 SE +/- 207.19, N = 5 SE +/- 58.21, N = 3 SE +/- 357.13, N = 12 SE +/- 348.28, N = 4 SE +/- 237.63, N = 3 SE +/- 150.02, N = 4 SE +/- 134.28, N = 4 SE +/- 938.95, N = 15 SE +/- 281.72, N = 15 SE +/- 44.42, N = 3 SE +/- 236.27, N = 4 SE +/- 298.34, N = 15 13714.6 19375.9 19485.8 27695.2 29384.9 25194.6 27281.9 29804.4 21286.6 15081.0 13537.7 24688.5 26378.1 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -march=native -mavx2 -mavx -msse4.1 -mfma -march=native -mavx2 -mavx -msse4.1 -mfma -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq 1. (CXX) g++ options: -O3 -fno-trapping-math -fno-math-errno -ldl
Speedb Test: Random Read OpenBenchmarking.org Op/s, More Is Better Speedb 2.7 Test: Random Read Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 140M 280M 420M 560M 700M SE +/- 5737147.53, N = 3 SE +/- 109015.29, N = 3 SE +/- 70537.88, N = 3 SE +/- 66268.38, N = 3 SE +/- 205170.43, N = 3 SE +/- 1606748.01, N = 3 SE +/- 998087.60, N = 3 SE +/- 1322733.50, N = 3 SE +/- 3698537.65, N = 15 SE +/- 2763560.64, N = 13 SE +/- 232538.80, N = 3 SE +/- 168680.90, N = 3 SE +/- 242146.75, N = 3 452482473 274091778 242940110 428557054 537633034 589951070 596955494 673159217 211457048 244070674 130359145 276179617 315178381 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Speedb Test: Read While Writing OpenBenchmarking.org Op/s, More Is Better Speedb 2.7 Test: Read While Writing Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 5M 10M 15M 20M 25M SE +/- 123169.00, N = 15 SE +/- 88013.69, N = 15 SE +/- 86788.79, N = 3 SE +/- 170909.18, N = 3 SE +/- 118870.12, N = 3 SE +/- 172052.60, N = 3 SE +/- 45758.35, N = 3 SE +/- 75416.94, N = 3 SE +/- 88257.34, N = 3 SE +/- 93731.24, N = 7 SE +/- 48302.92, N = 15 SE +/- 62510.72, N = 3 SE +/- 143570.67, N = 4 10457238 12053901 11882103 18024993 19595777 22829426 17548934 17945745 8795408 9988176 7147120 10695360 12168413 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenSSL Algorithm: SHA256 OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: SHA256 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 30000M 60000M 90000M 120000M 150000M SE +/- 164160900.82, N = 3 SE +/- 10642001.84, N = 3 SE +/- 64797308.82, N = 3 SE +/- 38601729.93, N = 3 SE +/- 146384349.91, N = 3 SE +/- 34182873.86, N = 3 SE +/- 34216643.88, N = 3 SE +/- 242095363.59, N = 3 SE +/- 27466135.54, N = 3 SE +/- 33334799.97, N = 3 SE +/- 8534071.27, N = 3 SE +/- 159515825.53, N = 3 SE +/- 23323764.84, N = 3 99240430433 74584721007 67806730387 126475137690 138409588983 161269162280 129975994733 144163027280 44439185187 51840436763 27858504490 61806994523 66573957920 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 1. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl
OpenSSL Algorithm: SHA512 OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: SHA512 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 11000M 22000M 33000M 44000M 55000M SE +/- 7598758.15, N = 3 SE +/- 15082903.45, N = 3 SE +/- 9990938.84, N = 3 SE +/- 6285194.15, N = 3 SE +/- 55712209.05, N = 3 SE +/- 5822493.86, N = 3 SE +/- 14430784.68, N = 3 SE +/- 24045021.87, N = 3 SE +/- 500176.69, N = 3 SE +/- 1250834.62, N = 3 SE +/- 6313493.56, N = 3 SE +/- 203213936.42, N = 3 SE +/- 37654528.63, N = 3 34282834893 24378460820 22194470973 39627575497 45865131913 52746634113 40605137923 45088755640 16199261277 18893980783 10980940093 22219927723 23886054770 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 1. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl
ClickHouse 100M Rows Hits Dataset, First Run / Cold Cache OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 120 240 360 480 600 SE +/- 2.04, N = 3 SE +/- 1.57, N = 3 SE +/- 1.88, N = 3 SE +/- 5.33, N = 3 SE +/- 7.88, N = 3 SE +/- 2.78, N = 3 SE +/- 2.21, N = 3 SE +/- 1.12, N = 3 SE +/- 2.85, N = 3 SE +/- 5.88, N = 3 SE +/- 1.56, N = 3 SE +/- 3.41, N = 3 SE +/- 4.18, N = 6 243.61 323.59 322.69 536.82 566.31 433.79 365.62 388.29 446.40 461.62 326.65 465.50 437.20 MIN: 31.19 / MAX: 3333.33 MIN: 35.69 / MAX: 3750 MIN: 32.99 / MAX: 4000 MIN: 56.6 / MAX: 6666.67 MIN: 59.64 / MAX: 5454.55 MIN: 54.1 / MAX: 4285.71 MIN: 47.81 / MAX: 4000 MIN: 53.81 / MAX: 5454.55 MIN: 32.64 / MAX: 4615.38 MIN: 35.59 / MAX: 5454.55 MIN: 20.85 / MAX: 5000 MIN: 40.93 / MAX: 5454.55 MIN: 41.7 / MAX: 5454.55
ClickHouse 100M Rows Hits Dataset, Second Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 130 260 390 520 650 SE +/- 3.08, N = 3 SE +/- 2.99, N = 3 SE +/- 5.72, N = 3 SE +/- 3.14, N = 3 SE +/- 0.42, N = 3 SE +/- 9.26, N = 3 SE +/- 3.34, N = 3 SE +/- 2.12, N = 3 SE +/- 1.94, N = 3 SE +/- 4.95, N = 3 SE +/- 0.73, N = 3 SE +/- 2.93, N = 3 SE +/- 2.86, N = 6 244.83 337.32 337.44 562.50 597.73 450.12 381.05 403.96 465.06 474.68 339.67 486.05 455.79 MIN: 28.33 / MAX: 2608.7 MIN: 35.76 / MAX: 4000 MIN: 33.44 / MAX: 4615.38 MIN: 57.47 / MAX: 6666.67 MIN: 61.41 / MAX: 5454.55 MIN: 66.15 / MAX: 5454.55 MIN: 48.39 / MAX: 5000 MIN: 54.35 / MAX: 5000 MIN: 32.59 / MAX: 5000 MIN: 36.43 / MAX: 6000 MIN: 21.1 / MAX: 4285.71 MIN: 40.43 / MAX: 6666.67 MIN: 42.19 / MAX: 6666.67
ClickHouse 100M Rows Hits Dataset, Third Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 130 260 390 520 650 SE +/- 1.87, N = 3 SE +/- 1.77, N = 3 SE +/- 5.23, N = 3 SE +/- 4.03, N = 3 SE +/- 4.34, N = 3 SE +/- 3.32, N = 3 SE +/- 2.14, N = 3 SE +/- 1.22, N = 3 SE +/- 6.03, N = 3 SE +/- 3.60, N = 3 SE +/- 4.79, N = 3 SE +/- 3.45, N = 3 SE +/- 3.62, N = 6 247.83 338.84 335.46 559.55 595.19 458.96 379.92 400.52 470.02 476.91 342.99 481.66 458.23 MIN: 26.58 / MAX: 2857.14 MIN: 35.76 / MAX: 4000 MIN: 32.86 / MAX: 5454.55 MIN: 57.03 / MAX: 5000 MIN: 62.05 / MAX: 5000 MIN: 68.65 / MAX: 4000 MIN: 48.98 / MAX: 4000 MIN: 54.15 / MAX: 5000 MIN: 32.59 / MAX: 5454.55 MIN: 36.01 / MAX: 5000 MIN: 20.7 / MAX: 5000 MIN: 40.16 / MAX: 5454.55 MIN: 42.16 / MAX: 6000
RocksDB Test: Random Read OpenBenchmarking.org Op/s, More Is Better RocksDB 9.0 Test: Random Read Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 140M 280M 420M 560M 700M SE +/- 3900100.47, N = 6 SE +/- 206014.27, N = 3 SE +/- 211259.57, N = 3 SE +/- 610621.13, N = 3 SE +/- 326038.01, N = 3 SE +/- 153963.59, N = 3 SE +/- 1336933.52, N = 3 SE +/- 2130676.22, N = 3 SE +/- 81327.78, N = 3 SE +/- 86315.43, N = 3 SE +/- 744772.41, N = 3 SE +/- 3338569.32, N = 3 SE +/- 1119855.47, N = 3 399277797 266186537 234992636 409272949 523310091 573235452 574749552 645309483 205346154 234469939 125584953 265366170 297517946 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
RocksDB Test: Read While Writing OpenBenchmarking.org Op/s, More Is Better RocksDB 9.0 Test: Read While Writing Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 3M 6M 9M 12M 15M SE +/- 88887.11, N = 3 SE +/- 28098.62, N = 3 SE +/- 81998.56, N = 3 SE +/- 36524.26, N = 3 SE +/- 93669.97, N = 15 SE +/- 109424.14, N = 3 SE +/- 45015.86, N = 3 SE +/- 136761.19, N = 4 SE +/- 83772.27, N = 13 SE +/- 26369.56, N = 3 SE +/- 23120.76, N = 3 SE +/- 61518.27, N = 10 SE +/- 28201.44, N = 3 9445415 9333645 8934176 14608544 14158419 15776186 11340389 11864815 7439663 7366500 5539870 7841738 8926893 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 20K 40K 60K 80K 100K SE +/- 714.02, N = 3 SE +/- 175.33, N = 3 SE +/- 299.71, N = 3 SE +/- 232.97, N = 3 SE +/- 87.23, N = 3 SE +/- 242.45, N = 3 SE +/- 186.80, N = 3 SE +/- 232.81, N = 3 SE +/- 95.84, N = 3 SE +/- 143.25, N = 3 SE +/- 434.11, N = 12 SE +/- 78.02, N = 3 SE +/- 198.41, N = 3 57787 61272 55395 79987 79492 72244 79191 86677 69969 72225 61233 71227 75396 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 4 8 12 16 20 SE +/- 0.21, N = 3 SE +/- 0.05, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 12 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 17.31 16.32 18.05 12.50 12.58 13.84 12.63 11.54 14.29 13.85 16.34 14.04 13.26 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 900K 1800K 2700K 3600K 4500K SE +/- 4953.93, N = 3 SE +/- 11512.67, N = 3 SE +/- 4774.62, N = 3 SE +/- 39970.22, N = 3 SE +/- 27594.68, N = 3 SE +/- 15503.17, N = 3 SE +/- 20221.52, N = 3 SE +/- 19583.16, N = 5 SE +/- 24978.23, N = 12 SE +/- 17697.00, N = 3 SE +/- 13469.59, N = 3 SE +/- 20350.34, N = 3 SE +/- 13863.97, N = 12 1725175 2606500 2416375 3603261 3989358 3422492 1748658 1846080 1792636 1607424 1720762 1748146 1699046 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 0.14 0.28 0.42 0.56 0.7 SE +/- 0.002, N = 3 SE +/- 0.002, N = 3 SE +/- 0.001, N = 3 SE +/- 0.003, N = 3 SE +/- 0.002, N = 3 SE +/- 0.001, N = 3 SE +/- 0.007, N = 3 SE +/- 0.006, N = 5 SE +/- 0.008, N = 12 SE +/- 0.007, N = 3 SE +/- 0.005, N = 3 SE +/- 0.007, N = 3 SE +/- 0.005, N = 12 0.580 0.384 0.414 0.278 0.251 0.292 0.572 0.542 0.559 0.622 0.581 0.572 0.589 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
Timed Linux Kernel Compilation CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Timed Linux Kernel Compilation 6.8 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.21 / Avg: 170.41 / Max: 199.77 Min: 16.91 / Avg: 150.79 / Max: 171.19 Min: 16.08 / Avg: 129.6 / Max: 144.82 Min: 27.23 / Avg: 282.28 / Max: 331.17 Min: 34.02 / Avg: 348.42 / Max: 413.49 Min: 19.75 / Avg: 262.8 / Max: 335.9 Min: 43.57 / Avg: 201.59 / Max: 252.67 Min: 43.47 / Avg: 255.14 / Max: 329.17 Min: 70.17 / Avg: 330.93 / Max: 375.87 Min: 81.1 / Avg: 330.36 / Max: 377.46 Min: 50.2 / Avg: 256.23 / Max: 291.69 Min: 56.91 / Avg: 323.36 / Max: 378.1 Min: 25.82 / Avg: 317.64 / Max: 378.37
Timed Node.js Compilation CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Timed Node.js Compilation 21.7.2 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.63 / Avg: 129.27 / Max: 187.24 Min: 18.11 / Avg: 134.67 / Max: 172.23 Min: 16.32 / Avg: 118.09 / Max: 147.17 Min: 29.13 / Avg: 242.47 / Max: 351.76 Min: 30.95 / Avg: 289.15 / Max: 411.31 Min: 21.84 / Avg: 210.13 / Max: 338.39 Min: 43.59 / Avg: 148.97 / Max: 246.66 Min: 43.35 / Avg: 170.44 / Max: 300.92 Min: 74.34 / Avg: 318.88 / Max: 376.31 Min: 84.71 / Avg: 317.34 / Max: 376.11 Min: 50.7 / Avg: 248.06 / Max: 290.96 Min: 56.59 / Avg: 305.63 / Max: 376.82 Min: 33.43 / Avg: 295.74 / Max: 377.74
Timed LLVM Compilation CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Timed LLVM Compilation 16.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.71 / Avg: 122.91 / Max: 185.98 Min: 16.99 / Avg: 134 / Max: 170.95 Min: 15.37 / Avg: 117.14 / Max: 147.36 Min: 28.01 / Avg: 241.32 / Max: 332.83 Min: 33.31 / Avg: 289.22 / Max: 411.83 Min: 21.92 / Avg: 221.05 / Max: 334.41 Min: 43.51 / Avg: 148.04 / Max: 239.55 Min: 43.38 / Avg: 172.6 / Max: 293.27 Min: 74.97 / Avg: 314.74 / Max: 377.51 Min: 83.29 / Avg: 311.03 / Max: 377.86 Min: 51.36 / Avg: 243.86 / Max: 291.49 Min: 58.01 / Avg: 298.24 / Max: 377.21 Min: 33.37 / Avg: 291.41 / Max: 377.45
OpenSSL Algorithm: SHA256 OpenBenchmarking.org byte/s Per Watt, More Is Better OpenSSL 3.3 Algorithm: SHA256 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 130M 260M 390M 520M 650M 545938643.43 469088919.27 511227929.81 386445411.79 345260515.93 481947170.76 611047359.48 516781889.88 157500377.52 167457577.18 105324899.05 189585676.93 195213927.96
OpenSSL CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenSSL 3.3 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.41 / Avg: 181.78 / Max: 216.97 Min: 18.27 / Avg: 159 / Max: 170.75 Min: 17.53 / Avg: 132.64 / Max: 140.44 Min: 29.19 / Avg: 327.28 / Max: 361.5 Min: 34.63 / Avg: 400.88 / Max: 411.05 Min: 22.61 / Avg: 334.62 / Max: 353.13 Min: 43.63 / Avg: 212.71 / Max: 270.71 Min: 43.49 / Avg: 278.96 / Max: 357.32 Min: 75.75 / Avg: 282.15 / Max: 323.37 Min: 82.11 / Avg: 309.57 / Max: 363.52 Min: 52.69 / Avg: 264.5 / Max: 291.33 Min: 57.24 / Avg: 326.01 / Max: 380.05 Min: 32.34 / Avg: 341.03 / Max: 377.49
OpenSSL Algorithm: SHA512 OpenBenchmarking.org byte/s Per Watt, More Is Better OpenSSL 3.3 Algorithm: SHA512 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 40M 80M 120M 160M 200M 186801619.46 154425638.15 165874523.26 128564080.98 114623223.18 157697655.07 165922834.04 139323873.72 54000562.67 57121711.23 41470367.43 65144677.30 69884736.57
OpenSSL CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenSSL 3.3 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.95 / Avg: 183.53 / Max: 198.79 Min: 18.44 / Avg: 157.87 / Max: 169.7 Min: 15.55 / Avg: 133.8 / Max: 143.63 Min: 28.99 / Avg: 308.23 / Max: 338.17 Min: 34.64 / Avg: 400.14 / Max: 413.51 Min: 21.49 / Avg: 334.48 / Max: 349.67 Min: 43.65 / Avg: 244.72 / Max: 270.07 Min: 43.5 / Avg: 323.63 / Max: 356.46 Min: 71.29 / Avg: 299.98 / Max: 317.48 Min: 74.41 / Avg: 330.77 / Max: 354.3 Min: 53.35 / Avg: 264.79 / Max: 291.44 Min: 56.54 / Avg: 341.09 / Max: 377.07 Min: 23.35 / Avg: 341.79 / Max: 377.28
John The Ripper Test: Blowfish OpenBenchmarking.org Real C/S Per Watt, More Is Better John The Ripper 2023.03.14 Test: Blowfish Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 200 400 600 800 1000 696.76 753.26 805.43 605.49 531.08 757.83 885.52 747.26 257.14 274.74 233.58 305.95 339.84
John The Ripper CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better John The Ripper 2023.03.14 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6766E 2P Full Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 90 180 270 360 450 Min: 23.1 / Avg: 155.77 / Max: 182.84 Min: 18.33 / Avg: 135.67 / Max: 154.48 Min: 15.84 / Avg: 101.56 / Max: 134.16 Min: 28.03 / Avg: 274.61 / Max: 310.69 Min: 32.66 / Avg: 362.61 / Max: 410.64 Min: 22.18 / Avg: 290.55 / Max: 334.66 Min: 43.56 / Avg: 214.8 / Max: 240.98 Min: 107.82 / Avg: 445 / Max: 497.2 Min: 43.52 / Avg: 282.96 / Max: 321.53 Min: 71.89 / Avg: 264.78 / Max: 291.9 Min: 71.44 / Avg: 288.1 / Max: 318.09 Min: 52.63 / Avg: 243.63 / Max: 290.65 Min: 54.97 / Avg: 308.91 / Max: 345.11 Min: 23.7 / Avg: 308.68 / Max: 376.19
John The Ripper Test: bcrypt OpenBenchmarking.org Real C/S Per Watt, More Is Better John The Ripper 2023.03.14 Test: bcrypt Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 200 400 600 800 1000 693.95 749.17 920.41 606.47 531.63 759.60 885.93 746.76 256.35 273.70 233.71 305.82 342.68
ClickHouse 100M Rows Hits Dataset, Third Run OpenBenchmarking.org Queries Per Minute, Geo Mean Per Watt, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 1.1063 2.2126 3.3189 4.4252 5.5315 3.662 4.085 4.366 4.053 3.709 4.182 4.917 4.737 1.967 1.974 1.966 2.341 2.599
ClickHouse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ClickHouse 22.12.3.5 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 21.77 / Avg: 67.67 / Max: 170.47 Min: 18.06 / Avg: 82.96 / Max: 166.09 Min: 15.83 / Avg: 76.83 / Max: 137.9 Min: 28.3 / Avg: 138.04 / Max: 305.03 Min: 29.83 / Avg: 160.48 / Max: 343.21 Min: 20.77 / Avg: 109.76 / Max: 265.96 Min: 43.57 / Avg: 77.27 / Max: 231.46 Min: 43.42 / Avg: 84.55 / Max: 263.64 Min: 70.28 / Avg: 238.9 / Max: 367.38 Min: 77.89 / Avg: 241.61 / Max: 372.85 Min: 52.36 / Avg: 174.43 / Max: 288.3 Min: 52.84 / Avg: 205.71 / Max: 375.59 Min: 26.54 / Avg: 176.29 / Max: 377.99
PostgreSQL CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better PostgreSQL 16 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 60 120 180 240 300 Min: 23.02 / Avg: 123.24 / Max: 157.33 Min: 16.91 / Avg: 135.16 / Max: 158.27 Min: 15.4 / Avg: 110.68 / Max: 134.33 Min: 19.41 / Avg: 254.31 / Max: 305.58 Min: 32.63 / Avg: 299.03 / Max: 361.05 Min: 21.27 / Avg: 207.74 / Max: 251.71 Min: 43.52 / Avg: 150.61 / Max: 191.14 Min: 43.39 / Avg: 172.92 / Max: 212.03 Min: 69.55 / Avg: 311.42 / Max: 350.84 Min: 86.13 / Avg: 315.59 / Max: 351.55 Min: 54.49 / Avg: 239.87 / Max: 290.09 Min: 54.62 / Avg: 299.36 / Max: 354.29 Min: 31.89 / Avg: 275.46 / Max: 347.94
PostgreSQL CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better PostgreSQL 16 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.16 / Avg: 151.18 / Max: 181.47 Min: 18.63 / Avg: 138.72 / Max: 161.44 Min: 15.23 / Avg: 121.21 / Max: 140.08 Min: 27.65 / Avg: 271.07 / Max: 317.83 Min: 33.83 / Avg: 355.49 / Max: 410.22 Min: 21.35 / Avg: 253.4 / Max: 320.46 Min: 43.55 / Avg: 127.3 / Max: 157.98 Min: 43.45 / Avg: 153.46 / Max: 193.17 Min: 71.87 / Avg: 311.81 / Max: 377.7 Min: 78.53 / Avg: 316.32 / Max: 367.54 Min: 54.25 / Avg: 239.92 / Max: 291.32 Min: 56.77 / Avg: 302.76 / Max: 366.57 Min: 31.51 / Avg: 271.55 / Max: 343.13
RocksDB Test: Random Read OpenBenchmarking.org Op/s Per Watt, More Is Better RocksDB 9.0 Test: Random Read Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 500K 1000K 1500K 2000K 2500K 2094589.03 1780768.80 1972313.57 1523041.95 1362651.04 1957165.94 2436056.02 2069916.27 663946.02 704496.50 490897.23 802721.25 904750.01
RocksDB CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better RocksDB 9.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.05 / Avg: 190.62 / Max: 206.24 Min: 19.07 / Avg: 149.48 / Max: 159.86 Min: 18.15 / Avg: 119.15 / Max: 127.37 Min: 24.72 / Avg: 268.72 / Max: 291.05 Min: 33.04 / Avg: 384.04 / Max: 411.06 Min: 21.45 / Avg: 292.89 / Max: 315.65 Min: 43.66 / Avg: 235.93 / Max: 270.68 Min: 43.52 / Avg: 311.76 / Max: 357.69 Min: 73.12 / Avg: 309.28 / Max: 327.48 Min: 77.85 / Avg: 332.82 / Max: 365.47 Min: 53.91 / Avg: 255.83 / Max: 291.63 Min: 54.21 / Avg: 330.58 / Max: 378.42 Min: 25.38 / Avg: 328.84 / Max: 377.98
RocksDB Test: Read While Writing OpenBenchmarking.org Op/s Per Watt, More Is Better RocksDB 9.0 Test: Read While Writing Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 14K 28K 42K 56K 70K 52800.80 60067.21 66672.70 48605.69 36906.83 52342.46 63183.03 56900.62 22369.26 22200.62 21648.99 23723.76 27560.28
RocksDB CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better RocksDB 9.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.94 / Avg: 178.89 / Max: 204.7 Min: 17.34 / Avg: 155.39 / Max: 168.8 Min: 17.36 / Avg: 134 / Max: 149.2 Min: 24.6 / Avg: 300.55 / Max: 337.2 Min: 34.3 / Avg: 383.63 / Max: 411.02 Min: 22 / Avg: 301.4 / Max: 339.84 Min: 43.66 / Avg: 179.48 / Max: 270.38 Min: 43.57 / Avg: 208.52 / Max: 356.32 Min: 72.31 / Avg: 332.58 / Max: 376.04 Min: 74.89 / Avg: 331.82 / Max: 375.82 Min: 55.14 / Avg: 255.9 / Max: 290.56 Min: 52.65 / Avg: 330.54 / Max: 376.66 Min: 33.11 / Avg: 323.9 / Max: 378.14
Speedb Test: Random Read OpenBenchmarking.org Op/s Per Watt, More Is Better Speedb 2.7 Test: Random Read Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 500K 1000K 1500K 2000K 2500K 2278519.61 1818446.43 2023204.53 1563545.14 1404496.49 1991742.68 2531402.05 2159153.28 680456.82 744809.12 509439.26 834970.47 962315.70
Speedb CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Speedb 2.7 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.98 / Avg: 198.59 / Max: 217.68 Min: 18.42 / Avg: 150.73 / Max: 161.26 Min: 18.13 / Avg: 120.08 / Max: 129.07 Min: 29.2 / Avg: 274.09 / Max: 293.61 Min: 33.89 / Avg: 382.79 / Max: 411.07 Min: 22.11 / Avg: 296.2 / Max: 318.84 Min: 43.69 / Avg: 235.82 / Max: 270.43 Min: 43.47 / Avg: 311.77 / Max: 356.67 Min: 71.79 / Avg: 310.76 / Max: 333.42 Min: 70.78 / Avg: 327.7 / Max: 377.13 Min: 54.55 / Avg: 255.89 / Max: 290.77 Min: 54.25 / Avg: 330.77 / Max: 378.66 Min: 27.16 / Avg: 327.52 / Max: 377.21
Speedb Test: Read While Writing OpenBenchmarking.org Op/s Per Watt, More Is Better Speedb 2.7 Test: Read While Writing Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 20K 40K 60K 80K 100K 68649.72 79851.05 97163.65 63472.87 57032.77 93506.84 103697.42 90565.21 26509.91 29984.58 27890.69 32356.04 37383.41
Speedb CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Speedb 2.7 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.12 / Avg: 152.33 / Max: 178.15 Min: 17.32 / Avg: 150.95 / Max: 163.43 Min: 17.9 / Avg: 122.29 / Max: 139.21 Min: 26.3 / Avg: 283.98 / Max: 305.25 Min: 32.81 / Avg: 343.59 / Max: 411.18 Min: 22.4 / Avg: 244.15 / Max: 314.31 Min: 43.64 / Avg: 169.23 / Max: 238.92 Min: 43.55 / Avg: 198.15 / Max: 300.83 Min: 78.68 / Avg: 331.78 / Max: 377.28 Min: 74.62 / Avg: 333.11 / Max: 375.39 Min: 52.53 / Avg: 256.25 / Max: 291.99 Min: 52.35 / Avg: 330.55 / Max: 376.19 Min: 34.03 / Avg: 325.5 / Max: 377.13
Coremark CoreMark Size 666 - Iterations Per Second OpenBenchmarking.org Iterations/Sec Per Watt, More Is Better Coremark 1.0 CoreMark Size 666 - Iterations Per Second Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 6K 12K 18K 24K 30K 27062.21 15712.09 16836.69 13254.14 12144.31 16764.47 18400.49 15612.90 6163.40 6571.62 5016.56 7477.77 7555.56
Coremark CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Coremark 1.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.98 / Avg: 104.34 / Max: 164.47 Min: 16.44 / Avg: 144.77 / Max: 164.64 Min: 14.91 / Avg: 122.91 / Max: 138.78 Min: 26.88 / Avg: 296.23 / Max: 351.89 Min: 32.2 / Avg: 341.96 / Max: 411.86 Min: 21.14 / Avg: 269.93 / Max: 353.42 Min: 43.57 / Avg: 158.45 / Max: 217.13 Min: 21.83 / Avg: 213.94 / Max: 282.7 Min: 76.41 / Avg: 261.99 / Max: 288.93 Min: 77.43 / Avg: 282.3 / Max: 314.07 Min: 50.82 / Avg: 242.89 / Max: 290.97 Min: 54.25 / Avg: 293.49 / Max: 341.26 Min: 34.34 / Avg: 313.68 / Max: 378.24
ACES DGEMM Sustained Floating-Point Rate OpenBenchmarking.org GFLOP/s Per Watt, More Is Better ACES DGEMM 1.0 Sustained Floating-Point Rate Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 0.0567 0.1134 0.1701 0.2268 0.2835 0.127 0.198 0.220 0.214 0.196 0.252 0.107 0.105 0.071 0.081 0.059 0.093 0.121
ACES DGEMM CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ACES DGEMM 1.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.24 / Avg: 140.74 / Max: 194.16 Min: 17.88 / Avg: 109.94 / Max: 158.28 Min: 16.53 / Avg: 95.47 / Max: 135.35 Min: 28.2 / Avg: 182.5 / Max: 306.04 Min: 31.49 / Avg: 230.52 / Max: 409.55 Min: 22.22 / Avg: 178.2 / Max: 342.37 Min: 43.57 / Avg: 148.35 / Max: 183.52 Min: 43.36 / Avg: 170.6 / Max: 222.09 Min: 75.8 / Avg: 276.9 / Max: 361.7 Min: 73.75 / Avg: 277.15 / Max: 377.23 Min: 52.19 / Avg: 226.98 / Max: 281.28 Min: 53.98 / Avg: 252.19 / Max: 377.52 Min: 23.09 / Avg: 239.87 / Max: 363.28
m-queens CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better m-queens 1.2 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.95 / Avg: 117.71 / Max: 177.59 Min: 19.39 / Avg: 122.5 / Max: 158.25 Min: 15.51 / Avg: 106.99 / Max: 136.77 Min: 28.35 / Avg: 221.83 / Max: 330.6 Min: 31.01 / Avg: 267.9 / Max: 411.07 Min: 20.79 / Avg: 202.95 / Max: 326.11 Min: 43.69 / Avg: 180.19 / Max: 242.1 Min: 43.54 / Avg: 226.9 / Max: 315.05 Min: 75.51 / Avg: 241.11 / Max: 276.68 Min: 77.06 / Avg: 260.39 / Max: 302.34 Min: 54.03 / Avg: 238.8 / Max: 290.84 Min: 62.12 / Avg: 266.4 / Max: 324.62 Min: 32.66 / Avg: 278.57 / Max: 374.34
miniFE Problem Size: Small OpenBenchmarking.org CG Mflops Per Watt, More Is Better miniFE 2.2 Problem Size: Small Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 90 180 270 360 450 238.55 254.52 282.72 334.41 298.90 392.87 373.28 340.56 79.24 71.52 120.52 156.59 160.18
miniFE CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better miniFE 2.2 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.45 / Avg: 100.67 / Max: 175.45 Min: 19.07 / Avg: 96.36 / Max: 147.72 Min: 15.16 / Avg: 86.83 / Max: 132.07 Min: 28.79 / Avg: 152.24 / Max: 300.13 Min: 33.7 / Avg: 177.88 / Max: 364.34 Min: 21.36 / Avg: 127.63 / Max: 261.53 Min: 43.59 / Avg: 108.34 / Max: 211.25 Min: 43.53 / Avg: 119.29 / Max: 232.16 Min: 75.77 / Avg: 253.53 / Max: 365.64 Min: 73.91 / Avg: 260.35 / Max: 366.7 Min: 53.33 / Avg: 190.48 / Max: 282.32 Min: 61.92 / Avg: 224.98 / Max: 377.92 Min: 31.62 / Avg: 198.71 / Max: 331.13
CloverLeaf CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better CloverLeaf 1.3 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.22 / Avg: 155.97 / Max: 178.63 Min: 19.22 / Avg: 132.55 / Max: 146.42 Min: 17.1 / Avg: 122.03 / Max: 133.14 Min: 25.91 / Avg: 223.18 / Max: 288.87 Min: 33.05 / Avg: 264.63 / Max: 353.22 Min: 19.77 / Avg: 183.89 / Max: 245.13 Min: 43.65 / Avg: 168.7 / Max: 186.26 Min: 43.45 / Avg: 184.14 / Max: 204.33 Min: 76.4 / Avg: 324.2 / Max: 367.03 Min: 74.72 / Avg: 323.64 / Max: 372.82 Min: 53.35 / Avg: 254.93 / Max: 281.37 Min: 57.26 / Avg: 320.54 / Max: 366.56 Min: 32.08 / Avg: 299.62 / Max: 336.85
CloverLeaf CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better CloverLeaf 1.3 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.28 / Avg: 159.57 / Max: 178.94 Min: 18.26 / Avg: 143.82 / Max: 147.88 Min: 18.03 / Avg: 132.66 / Max: 136.36 Min: 28.5 / Avg: 250.17 / Max: 287.09 Min: 34.9 / Avg: 301.76 / Max: 361.01 Min: 19.15 / Avg: 200.7 / Max: 237.69 Min: 43.58 / Avg: 186.46 / Max: 191.98 Min: 43.52 / Avg: 205.96 / Max: 212.24 Min: 71.71 / Avg: 345.92 / Max: 368.64 Min: 75.8 / Avg: 346.15 / Max: 373.49 Min: 48.92 / Avg: 267.62 / Max: 276.86 Min: 57.58 / Avg: 346.05 / Max: 371.34 Min: 33.19 / Avg: 289.13 / Max: 310.83
QuantLib Configuration: Multi-Threaded OpenBenchmarking.org MFLOPS Per Watt, More Is Better QuantLib 1.32 Configuration: Multi-Threaded Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 300 600 900 1200 1500 1293.70 1092.36 1202.80 930.70 864.58 1200.71 1113.28 960.37 447.64 495.61 358.69 552.74 605.78
QuantLib CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better QuantLib 1.32 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.19 / Avg: 194.65 / Max: 253.21 Min: 17.59 / Avg: 157.98 / Max: 175.08 Min: 16.19 / Avg: 127.97 / Max: 140.32 Min: 28.93 / Avg: 316.09 / Max: 352.6 Min: 33.64 / Avg: 369.92 / Max: 411.04 Min: 21.13 / Avg: 311.83 / Max: 350.73 Min: 43.59 / Avg: 210.04 / Max: 270.15 Min: 43.42 / Avg: 273.26 / Max: 357.57 Min: 72.72 / Avg: 321.14 / Max: 375.61 Min: 83.08 / Avg: 328.34 / Max: 376.88 Min: 49.64 / Avg: 253.81 / Max: 290.36 Min: 58.59 / Avg: 325.01 / Max: 377.73 Min: 31.57 / Avg: 322.97 / Max: 378.63
7-Zip Compression Test: Decompression Rating OpenBenchmarking.org MIPS Per Watt, More Is Better 7-Zip Compression 22.01 Test: Decompression Rating Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 800 1600 2400 3200 4000 3953.03 2768.54 2828.90 2434.84 2281.23 3140.68 2265.09 2052.50 663.36 773.01 775.27 934.34 1119.86
7-Zip Compression CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better 7-Zip Compression 22.01 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.13 / Avg: 136.44 / Max: 185.42 Min: 19.72 / Avg: 132.92 / Max: 171.37 Min: 18.26 / Avg: 119.61 / Max: 153.19 Min: 27.34 / Avg: 263.93 / Max: 352.58 Min: 33.61 / Avg: 313.89 / Max: 411.35 Min: 22.44 / Avg: 248.63 / Max: 349.11 Min: 43.69 / Avg: 185.89 / Max: 235.27 Min: 43.58 / Avg: 225.95 / Max: 302.95 Min: 70.41 / Avg: 313.16 / Max: 376.07 Min: 74.78 / Avg: 314.81 / Max: 375.55 Min: 52.56 / Avg: 242.94 / Max: 291.38 Min: 60.14 / Avg: 308.09 / Max: 375.76 Min: 34.7 / Avg: 301.96 / Max: 375.99
x265 Video Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second Per Watt, More Is Better x265 3.6 Video Input: Bosphorus 4K Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 0.0765 0.153 0.2295 0.306 0.3825 0.250 0.318 0.340 0.218 0.195 0.250 0.251 0.242 0.113 0.120 0.146 0.161 0.178
x265 CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better x265 3.6 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 60 120 180 240 300 Min: 21.74 / Avg: 69.84 / Max: 83.64 Min: 17.3 / Avg: 88.38 / Max: 113.06 Min: 15.46 / Avg: 81.58 / Max: 101.27 Min: 28.94 / Avg: 145.28 / Max: 189.25 Min: 32.43 / Avg: 164.71 / Max: 212.57 Min: 20.91 / Avg: 112.7 / Max: 141.97 Min: 43.65 / Avg: 80.41 / Max: 103.35 Min: 43.45 / Avg: 88.07 / Max: 115.63 Min: 75.63 / Avg: 256.33 / Max: 294.6 Min: 72.13 / Avg: 261.62 / Max: 312.67 Min: 52.94 / Avg: 203.52 / Max: 247.27 Min: 59.53 / Avg: 234.38 / Max: 293.23 Min: 34.21 / Avg: 219.3 / Max: 292.58
libavif avifenc CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better libavif avifenc 1.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 21.77 / Avg: 52.05 / Max: 123.81 Min: 17.01 / Avg: 85.23 / Max: 156.74 Min: 16.02 / Avg: 77.61 / Max: 131.52 Min: 29.48 / Avg: 156.52 / Max: 318.36 Min: 30.24 / Avg: 180.87 / Max: 389.03 Min: 19.55 / Avg: 121.7 / Max: 248.44 Min: 43.56 / Avg: 65.01 / Max: 148.96 Min: 43.39 / Avg: 72.37 / Max: 182.54 Min: 75.95 / Avg: 254.61 / Max: 372.81 Min: 69.59 / Avg: 253.47 / Max: 376.81 Min: 49.17 / Avg: 165.96 / Max: 290.88 Min: 61.27 / Avg: 218.41 / Max: 375.95 Min: 34.78 / Avg: 197.77 / Max: 373.2
libavif avifenc CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better libavif avifenc 1.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 21.96 / Avg: 47.12 / Max: 124.16 Min: 16.88 / Avg: 75.22 / Max: 155.11 Min: 14.11 / Avg: 69.45 / Max: 130.44 Min: 28.7 / Avg: 137.31 / Max: 316.42 Min: 32.31 / Avg: 157.68 / Max: 383.9 Min: 20.27 / Avg: 107.23 / Max: 247.8 Min: 43.58 / Avg: 59.56 / Max: 150.24 Min: 43.42 / Avg: 65.19 / Max: 183.13 Min: 71.37 / Avg: 235.53 / Max: 369.9 Min: 80.19 / Avg: 235.72 / Max: 375.98 Min: 50.37 / Avg: 150.68 / Max: 290.84 Min: 58.97 / Avg: 196.29 / Max: 374.92 Min: 34.19 / Avg: 161.32 / Max: 375.73
libavif avifenc CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better libavif avifenc 1.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 21.98 / Avg: 49.78 / Max: 68.22 Min: 15.86 / Avg: 54.43 / Max: 150.92 Min: 15.57 / Avg: 49.3 / Max: 126.89 Min: 26.55 / Avg: 92.59 / Max: 299.06 Min: 29.87 / Avg: 106.31 / Max: 349.7 Min: 18.49 / Avg: 76.34 / Max: 238.8 Min: 43.55 / Avg: 64.88 / Max: 147.13 Min: 43.39 / Avg: 69.56 / Max: 179.96 Min: 73.48 / Avg: 180.42 / Max: 357.76 Min: 71.59 / Avg: 183.17 / Max: 376.96 Min: 49.52 / Avg: 131.52 / Max: 290.38 Min: 59.37 / Avg: 149.47 / Max: 376.13 Min: 27.77 / Avg: 125.51 / Max: 374.47
libavif avifenc CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better libavif avifenc 1.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.66 / Avg: 50.74 / Max: 74.51 Min: 15.99 / Avg: 55.18 / Max: 149.59 Min: 15.05 / Avg: 53.07 / Max: 124.5 Min: 27.48 / Avg: 100.34 / Max: 306.84 Min: 29.45 / Avg: 115.08 / Max: 342.75 Min: 20.4 / Avg: 80.51 / Max: 234.12 Min: 43.56 / Avg: 59.76 / Max: 149.48 Min: 43.39 / Avg: 64.09 / Max: 183.29 Min: 74.59 / Avg: 193.8 / Max: 362.37 Min: 69.76 / Avg: 191.83 / Max: 376.91 Min: 48.9 / Avg: 132.08 / Max: 290.31 Min: 61.6 / Avg: 158.79 / Max: 375.47 Min: 26.64 / Avg: 128.43 / Max: 374.81
libavif avifenc CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better libavif avifenc 1.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 60 120 180 240 300 Min: 22.09 / Avg: 39.67 / Max: 52.08 Min: 15.89 / Avg: 45.79 / Max: 103.55 Min: 15.19 / Avg: 43.89 / Max: 93.61 Min: 27.35 / Avg: 79.69 / Max: 177.97 Min: 31.1 / Avg: 89.96 / Max: 203.77 Min: 20.59 / Avg: 64.93 / Max: 140.09 Min: 43.59 / Avg: 50.67 / Max: 89.41 Min: 43.45 / Avg: 52.35 / Max: 100.96 Min: 73.28 / Avg: 159.39 / Max: 303.29 Min: 72.94 / Avg: 159.29 / Max: 307.76 Min: 49.47 / Avg: 100.66 / Max: 234.57 Min: 58.72 / Avg: 130.94 / Max: 271.24 Min: 26.86 / Avg: 95.6 / Max: 261.18
GraphicsMagick Operation: Enhanced OpenBenchmarking.org Iterations Per Minute Per Watt, More Is Better GraphicsMagick 1.3.43 Operation: Enhanced Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 0.4399 0.8798 1.3197 1.7596 2.1995 1.955 1.348 1.470 1.067 0.935 1.342 1.391 1.211 0.484 0.549 0.484 0.656 0.696
GraphicsMagick CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better GraphicsMagick 1.3.43 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 60 120 180 240 300 Min: 23.46 / Avg: 136.08 / Max: 163.63 Min: 18.4 / Avg: 127.55 / Max: 140 Min: 16.93 / Avg: 110.88 / Max: 122.16 Min: 26.64 / Avg: 247.53 / Max: 267.87 Min: 33.82 / Avg: 320.71 / Max: 343.53 Min: 20.16 / Avg: 226.47 / Max: 243.63 Min: 43.58 / Avg: 194.07 / Max: 209.22 Min: 43.55 / Avg: 246.9 / Max: 265.73 Min: 73.74 / Avg: 330.74 / Max: 355.56 Min: 75.94 / Avg: 329.68 / Max: 362.6 Min: 52.22 / Avg: 254.21 / Max: 282.55 Min: 61.03 / Avg: 329.43 / Max: 359.83 Min: 28.79 / Avg: 327.64 / Max: 359.97
Liquid-DSP Threads: 128 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s Per Watt, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 57 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 5M 10M 15M 20M 25M 15940557.00 20620501.38 22733164.52 14722432.57 13085490.53 16705633.01 17916149.91 15275772.40 8437038.99 9312055.82 6364402.84 10089438.81 11273487.11
Liquid-DSP CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Liquid-DSP 1.6 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.87 / Avg: 177.22 / Max: 229.74 Min: 17.85 / Avg: 144.65 / Max: 162.72 Min: 17.47 / Avg: 118.2 / Max: 136.58 Min: 29.04 / Avg: 289.1 / Max: 326.36 Min: 35.08 / Avg: 363.41 / Max: 409.45 Min: 21.64 / Avg: 282.21 / Max: 320.93 Min: 43.75 / Avg: 208.54 / Max: 241.22 Min: 43.58 / Avg: 270.81 / Max: 310.28 Min: 75.83 / Avg: 316.47 / Max: 376.18 Min: 79.18 / Avg: 319.2 / Max: 376.38 Min: 51.05 / Avg: 244.28 / Max: 290.35 Min: 32.16 / Avg: 315.31 / Max: 376.7 Min: 24.5 / Avg: 310.75 / Max: 376.14
Liquid-DSP Threads: 128 - Buffer Length: 256 - Filter Length: 512 OpenBenchmarking.org samples/s Per Watt, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 512 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 1.4M 2.8M 4.2M 5.6M 7M 1983409.23 5867538.62 6364836.35 4367851.07 3778092.65 5183635.11 3673478.12 3117578.50 2528910.04 2800439.16 2212405.84 2929507.99 3740373.11
Liquid-DSP CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Liquid-DSP 1.6 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.51 / Avg: 184.17 / Max: 220.45 Min: 18.57 / Avg: 138.03 / Max: 156.97 Min: 16.09 / Avg: 114.97 / Max: 130.99 Min: 26.08 / Avg: 265.16 / Max: 303.52 Min: 32.21 / Avg: 362.28 / Max: 409.42 Min: 21.47 / Avg: 264.25 / Max: 302.73 Min: 43.64 / Avg: 195.9 / Max: 223.9 Min: 43.62 / Avg: 255.44 / Max: 293.66 Min: 77.21 / Avg: 316.42 / Max: 377.29 Min: 75.73 / Avg: 315.02 / Max: 376.2 Min: 52.09 / Avg: 243.73 / Max: 291.23 Min: 60 / Avg: 313.56 / Max: 376 Min: 27.09 / Avg: 308.24 / Max: 376.57
Liquid-DSP Threads: 256 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s Per Watt, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 57 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 5M 10M 15M 20M 25M 14308369.45 21345877.02 23457026.73 17475938.77 16030850.56 22424548.82 18991058.67 15942975.31 8954185.90 10156047.28 6601048.41 11085612.93 12268330.08
Liquid-DSP CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Liquid-DSP 1.6 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.42 / Avg: 198.42 / Max: 233.67 Min: 17.88 / Avg: 146.02 / Max: 166.38 Min: 18.06 / Avg: 119.1 / Max: 135.86 Min: 30.72 / Avg: 301.36 / Max: 345.8 Min: 35.02 / Avg: 362.54 / Max: 411.45 Min: 22.44 / Avg: 285.46 / Max: 328.97 Min: 43.61 / Avg: 224.29 / Max: 267.77 Min: 43.65 / Avg: 295.72 / Max: 355.96 Min: 75.93 / Avg: 318.17 / Max: 376.27 Min: 75.49 / Avg: 317.3 / Max: 376.02 Min: 52.71 / Avg: 243.97 / Max: 290.99 Min: 58.98 / Avg: 315.8 / Max: 377.13 Min: 24.86 / Avg: 310.3 / Max: 377.83
Liquid-DSP Threads: 256 - Buffer Length: 256 - Filter Length: 512 OpenBenchmarking.org samples/s Per Watt, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 512 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 1.4M 2.8M 4.2M 5.6M 7M 2000457.64 5998206.24 6532499.05 4853033.94 4387111.54 6413920.52 3974344.33 3349035.56 2666847.49 2982249.17 2257184.32 3267678.46 3805850.46
Liquid-DSP CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Liquid-DSP 1.6 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.87 / Avg: 183.47 / Max: 221.38 Min: 17.86 / Avg: 136.88 / Max: 157.55 Min: 17.93 / Avg: 113.55 / Max: 130.59 Min: 29.69 / Avg: 280.68 / Max: 320.8 Min: 35.59 / Avg: 357.96 / Max: 411.45 Min: 20.69 / Avg: 272.02 / Max: 314.58 Min: 43.63 / Avg: 213.46 / Max: 250.49 Min: 43.73 / Avg: 280.76 / Max: 332.63 Min: 74.44 / Avg: 314.43 / Max: 376.72 Min: 77.34 / Avg: 316.72 / Max: 376.86 Min: 53.55 / Avg: 240.39 / Max: 291.06 Min: 60.01 / Avg: 312.4 / Max: 376.93 Min: 25.3 / Avg: 309.72 / Max: 376.79
srsRAN Project Test: PDSCH Processor Benchmark, Throughput Total OpenBenchmarking.org Mbps Per Watt, More Is Better srsRAN Project 23.10.1-20240325 Test: PDSCH Processor Benchmark, Throughput Total Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 40 80 120 160 200 84.68 141.87 165.23 100.26 91.42 96.52 133.01 121.16 75.68 52.16 58.87 87.21 98.83
srsRAN Project CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better srsRAN Project 23.10.1-20240325 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.59 / Avg: 161.97 / Max: 211.95 Min: 17.85 / Avg: 136.58 / Max: 166.81 Min: 16.71 / Avg: 117.93 / Max: 142.26 Min: 28.12 / Avg: 276.24 / Max: 341.73 Min: 32.26 / Avg: 321.41 / Max: 408.75 Min: 21.57 / Avg: 261.04 / Max: 306.84 Min: 43.55 / Avg: 205.11 / Max: 263.97 Min: 43.52 / Avg: 245.99 / Max: 312.37 Min: 74.5 / Avg: 281.29 / Max: 379.76 Min: 74.87 / Avg: 289.12 / Max: 373.87 Min: 51.25 / Avg: 229.96 / Max: 288.72 Min: 60.24 / Avg: 283.1 / Max: 369.61 Min: 25.9 / Avg: 266.9 / Max: 379.06
PyTorch Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org batches/sec Per Watt, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 0.0761 0.1522 0.2283 0.3044 0.3805 0.125 0.308 0.338 0.179 0.150 0.175 0.194 0.193 0.193 0.186 0.236 0.223 0.258
PyTorch CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better PyTorch 2.2.1 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 60 120 180 240 300 Min: 23.65 / Avg: 196.43 / Max: 220.94 Min: 19.48 / Avg: 108.57 / Max: 123.57 Min: 15.03 / Avg: 98.23 / Max: 110.34 Min: 28.44 / Avg: 195.3 / Max: 220.5 Min: 35.79 / Avg: 231.06 / Max: 261.25 Min: 21.23 / Avg: 158.01 / Max: 176.03 Min: 43.6 / Avg: 138.69 / Max: 152.97 Min: 43.46 / Avg: 159.15 / Max: 179.26 Min: 73.38 / Avg: 266.73 / Max: 308.34 Min: 76.06 / Avg: 275.89 / Max: 319.9 Min: 53.3 / Avg: 207.69 / Max: 238.28 Min: 60.41 / Avg: 250.31 / Max: 298.35 Min: 35.31 / Avg: 244 / Max: 293.19
PyTorch Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org batches/sec Per Watt, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 0.0752 0.1504 0.2256 0.3008 0.376 0.123 0.305 0.334 0.179 0.150 0.176 0.194 0.194 0.197 0.189 0.235 0.218 0.293
PyTorch CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better PyTorch 2.2.1 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 60 120 180 240 300 Min: 23.05 / Avg: 197.5 / Max: 220.26 Min: 19.91 / Avg: 110.56 / Max: 125.45 Min: 17.28 / Avg: 99.64 / Max: 110.85 Min: 30.18 / Avg: 194.95 / Max: 219.41 Min: 32.73 / Avg: 232.73 / Max: 262.5 Min: 21.47 / Avg: 157.48 / Max: 175.9 Min: 43.68 / Avg: 138.47 / Max: 152.75 Min: 43.38 / Avg: 159.18 / Max: 178.76 Min: 75.38 / Avg: 268.45 / Max: 310.8 Min: 89.32 / Avg: 273.3 / Max: 321.11 Min: 55.01 / Avg: 207.81 / Max: 238.76 Min: 61.04 / Avg: 251.84 / Max: 296.62 Min: 18.63 / Avg: 215.65 / Max: 294.3
PyTorch Device: CPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org batches/sec Per Watt, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 0.0747 0.1494 0.2241 0.2988 0.3735 0.121 0.305 0.332 0.178 0.149 0.175 0.194 0.194 0.192 0.188 0.236 0.225 0.258
PyTorch CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better PyTorch 2.2.1 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 60 120 180 240 300 Min: 23.05 / Avg: 197.12 / Max: 221.88 Min: 18.44 / Avg: 110.66 / Max: 125.07 Min: 17.13 / Avg: 99.8 / Max: 111.33 Min: 30.14 / Avg: 194.55 / Max: 219.58 Min: 35.86 / Avg: 232.68 / Max: 261.18 Min: 21.06 / Avg: 157.61 / Max: 175.55 Min: 43.57 / Avg: 138.61 / Max: 153.19 Min: 43.48 / Avg: 159.18 / Max: 178.15 Min: 74.44 / Avg: 265.6 / Max: 309.82 Min: 70.81 / Avg: 276.02 / Max: 323.04 Min: 56.55 / Avg: 207.89 / Max: 238.03 Min: 59.74 / Avg: 250.75 / Max: 298.2 Min: 34.92 / Avg: 245.26 / Max: 293.93
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.11 / Avg: 87.36 / Max: 98.41 Min: 18.55 / Avg: 159.63 / Max: 174.23 Min: 17.99 / Avg: 135.1 / Max: 150.13 Min: 29.13 / Avg: 323.9 / Max: 362.47 Min: 31.03 / Avg: 374.75 / Max: 410.94 Min: 20.94 / Avg: 299.63 / Max: 344.93 Min: 43.66 / Avg: 230.17 / Max: 253.31 Min: 43.55 / Avg: 296.98 / Max: 325.95 Min: 70.61 / Avg: 331.05 / Max: 366.72 Min: 74.79 / Avg: 330.98 / Max: 373.36 Min: 50.83 / Avg: 254.14 / Max: 284.65 Min: 59.14 / Avg: 321.95 / Max: 371.05 Min: 34.43 / Avg: 325.81 / Max: 362.26
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.39 / Avg: 224.63 / Max: 249.42 Min: 17.94 / Avg: 165.08 / Max: 177.71 Min: 16.48 / Avg: 135.3 / Max: 146.77 Min: 30.45 / Avg: 333.47 / Max: 360.29 Min: 31.71 / Avg: 382.65 / Max: 411.13 Min: 23.52 / Avg: 323.53 / Max: 352.29 Min: 43.65 / Avg: 235.17 / Max: 270.9 Min: 43.62 / Avg: 308.92 / Max: 356.46 Min: 75.49 / Avg: 331.88 / Max: 373.56 Min: 87.21 / Avg: 332.74 / Max: 375.71 Min: 49.49 / Avg: 255.74 / Max: 292.14 Min: 59.81 / Avg: 328.72 / Max: 377.28 Min: 24.83 / Avg: 318.97 / Max: 381.52
Llamafile Test: llava-v1.5-7b-q4 - Acceleration: CPU OpenBenchmarking.org Tokens Per Second Per Watt, More Is Better Llamafile 0.7 Test: llava-v1.5-7b-q4 - Acceleration: CPU Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 0.0502 0.1004 0.1506 0.2008 0.251 0.006 0.202 0.223 0.138 0.110 0.126 0.061 0.056 0.027 0.028 0.089 0.080 0.068
Llamafile CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Llamafile 0.7 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.64 / Avg: 161.56 / Max: 217.37 Min: 17.78 / Avg: 104.22 / Max: 157.47 Min: 14.6 / Avg: 92.71 / Max: 131.37 Min: 28.61 / Avg: 186.7 / Max: 318.2 Min: 32.28 / Avg: 231.13 / Max: 402.04 Min: 20.15 / Avg: 163.65 / Max: 315.47 Min: 43.72 / Avg: 139.67 / Max: 256.22 Min: 43.49 / Avg: 172.82 / Max: 332.78 Min: 72.53 / Avg: 283.07 / Max: 370.83 Min: 72.54 / Avg: 288.22 / Max: 376.39 Min: 51.28 / Avg: 215.58 / Max: 284.94 Min: 56.03 / Avg: 262.55 / Max: 376.09 Min: 34.18 / Avg: 244.07 / Max: 354.9
Llamafile Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU OpenBenchmarking.org Tokens Per Second Per Watt, More Is Better Llamafile 0.7 Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 0.0099 0.0198 0.0297 0.0396 0.0495 0.004 0.038 0.044 0.034 0.029 0.037 0.031 0.028 0.005 0.005 0.018 0.018 0.013
Llamafile CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Llamafile 0.7 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 28.66 / Avg: 161.17 / Max: 199.77 Min: 17.14 / Avg: 135.55 / Max: 164.93 Min: 16.37 / Avg: 115.77 / Max: 139.52 Min: 30.07 / Avg: 245.28 / Max: 317.66 Min: 29.28 / Avg: 296.68 / Max: 399.75 Min: 21.63 / Avg: 203.84 / Max: 298.7 Min: 43.73 / Avg: 175.78 / Max: 254.24 Min: 43.53 / Avg: 201.04 / Max: 326.57 Min: 72.56 / Avg: 306.79 / Max: 356.97 Min: 86.22 / Avg: 325.29 / Max: 362.03 Min: 51.16 / Avg: 250.18 / Max: 288.75 Min: 53.92 / Avg: 317.1 / Max: 376.78 Min: 33.89 / Avg: 307.46 / Max: 338.87
Xmrig Variant: GhostRider - Hash Count: 1M OpenBenchmarking.org H/s Per Watt, More Is Better Xmrig 6.21 Variant: GhostRider - Hash Count: 1M Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 11 22 33 44 55 18.777 33.466 36.236 46.688 42.004 40.166 30.621 29.190 16.636 17.929 9.798 17.114 25.015
Xmrig CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Xmrig 6.21 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 43.17 / Avg: 133.89 / Max: 136.96 Min: 17.62 / Avg: 139.24 / Max: 143.75 Min: 15.67 / Avg: 125.96 / Max: 131.33 Min: 30.21 / Avg: 304.31 / Max: 328.13 Min: 36 / Avg: 375.84 / Max: 410.13 Min: 21.91 / Avg: 232.05 / Max: 250.74 Min: 43.68 / Avg: 173.6 / Max: 178.87 Min: 43.43 / Avg: 197.12 / Max: 203.16 Min: 73.18 / Avg: 327.41 / Max: 335.76 Min: 75.82 / Avg: 341.47 / Max: 356.09 Min: 53.3 / Avg: 264.66 / Max: 271.14 Min: 55.89 / Avg: 339.42 / Max: 349.66 Min: 24.38 / Avg: 334.94 / Max: 357.54
Stockfish Chess Benchmark OpenBenchmarking.org Nodes Per Second Per Watt, More Is Better Stockfish 16.1 Chess Benchmark Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 130K 260K 390K 520K 650K 258486.45 568916.36 621037.11 569277.48 555213.84 571475.98 509643.71 403742.35 199243.06 215737.78 193986.52 285328.34 325017.74
Stockfish CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Stockfish 16.1 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 45.16 / Avg: 230.17 / Max: 249.49 Min: 17.26 / Avg: 174.36 / Max: 184.62 Min: 16.19 / Avg: 145.98 / Max: 155.71 Min: 30.05 / Avg: 347.3 / Max: 373.1 Min: 35.5 / Avg: 386.38 / Max: 410.66 Min: 21.51 / Avg: 332.06 / Max: 363.69 Min: 43.78 / Avg: 240.94 / Max: 270.17 Min: 43.61 / Avg: 310.08 / Max: 337.09 Min: 71.31 / Avg: 341.39 / Max: 379.06 Min: 74.29 / Avg: 341.12 / Max: 366.15 Min: 53.05 / Avg: 263.42 / Max: 290.77 Min: 56.83 / Avg: 339.56 / Max: 379.91 Min: 22.35 / Avg: 337.72 / Max: 370.84
CPU Power Consumption Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Watts CPU Power Consumption Monitor Phoronix Test Suite System Monitoring Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 21.38 / Avg: 126.62 / Max: 253.21 Min: 8.43 / Avg: 128.7 / Max: 184.62 Min: 9.26 / Avg: 114.13 / Max: 155.71 Min: 14.69 / Avg: 244.69 / Max: 373.1 Min: 17.06 / Avg: 290.08 / Max: 413.51 Min: 10.09 / Avg: 225.05 / Max: 397.44 Min: 21.86 / Avg: 142.1 / Max: 271.22 Min: 21.7 / Avg: 169.1 / Max: 357.69 Min: 38.11 / Avg: 291.53 / Max: 379.76 Min: 38.16 / Avg: 295.53 / Max: 384.53 Min: 26.31 / Avg: 237.91 / Max: 292.14 Min: 30.38 / Avg: 278.1 / Max: 383.24 Min: 17.77 / Avg: 260.08 / Max: 405.42
Phoronix Test Suite v10.8.4