Ampere Altra versus Intel Sierra Forest benchmarks by Michael Larabel for a future article.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2406055-NE-INTELSRFA82 Intel Xeon 6700E Sierra Forest vs. Ampere Altra vs. AMD EPYC - Phoronix Test Suite Intel Xeon 6700E Sierra Forest vs. Ampere Altra vs. AMD EPYC Ampere Altra versus Intel Sierra Forest benchmarks by Michael Larabel for a future article.
HTML result view exported from: https://openbenchmarking.org/result/2406055-NE-INTELSRFA82&grs&export=txt&sro .
Intel Xeon 6700E Sierra Forest vs. Ampere Altra vs. AMD EPYC Processor Motherboard Chipset Memory Disk Graphics Network Monitor OS Kernel Compiler File-System Screen Resolution EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 Xeon Max 9480 Ampere Altra Max M128-30 AMD EPYC 8534P 64-Core @ 2.30GHz (64 Cores / 128 Threads) AMD Cinnabar (RCB1009C BIOS) AMD Device 14a4 6 x 32GB DDR5-4800MT/s Samsung M321R4GA0BB0-CQKMG 2 x 1920GB KIOXIA KCD8XPUG1T92 + 2000GB Corsair MP700 PRO ASPEED 2 x Broadcom NetXtreme BCM5720 PCIe Ubuntu 24.04 6.9.0-060900rc3-generic (x86_64) GCC 13.2.0 ext4 1920x1200 AMD EPYC 8534PN 64-Core @ 2.00GHz (64 Cores / 128 Threads) 2 x 1920GB KIOXIA KCD8XPUG1T92 AMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads) AMD Titanite_4G (RTI1007B BIOS) 12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEG Broadcom NetXtreme BCM5720 PCIe AMD EPYC 9684X 96-Core @ 2.55GHz (96 Cores / 192 Threads) AMD EPYC 9754 128-Core @ 2.25GHz (128 Cores / 256 Threads) Intel Xeon 6766E @ 2.70GHz (144 Cores) Quanta Cloud QuantaGrid D55Q-2U S7Q-MB-MPS-MDP (2A05.QCT001 BIOS) Intel Ice Lake IEH 256GB 2 x 1920GB KIOXIA KCD8XPUG1T92 + 3201GB Micron_7450_MTFDKCB3T2TFS 2 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA Intel Xeon 6780E @ 3.00GHz (144 Cores) 3201GB Micron_7450_MTFDKCB3T2TFS + 2 x 1920GB KIOXIA KCD8XPUG1T92 Intel Xeon Platinum 8380 @ 3.40GHz (40 Cores / 80 Threads) Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS) 2 x 1920GB KIOXIA KCD8XPUG1T92 VE228 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP 1920x1080 Intel Xeon Platinum 8490H @ 3.50GHz (60 Cores / 120 Threads) Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS) Intel Device 1bce 512GB 1920x1200 INTEL XEON PLATINUM 8592+ @ 3.90GHz (64 Cores / 128 Threads) Intel Xeon Max 9468 @ 3.50GHz (48 Cores / 96 Threads) 576GB Intel Xeon Max 9480 @ 3.50GHz (56 Cores / 112 Threads) ARMv8 Neoverse-N1 @ 3.00GHz (128 Cores) GIGABYTE G242-P36-00 MP32-AR2-00 v01000100 (F31k SCP: 2.10.20220531 BIOS) Ampere Computing LLC Altra PCI Root Complex A 16 x 32GB DDR4-3200MT/s Samsung M393A4K40DB3-CWE 800GB Micron_7450_MTFDKBA800TFS + 2 x 1920GB KIOXIA KCD8XPUG1T92 2 x Intel I350 6.9.0-060900-generic (aarch64) 1024x768 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - EPYC 8534P: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - EPYC 8534PN: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - EPYC 9654: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - EPYC 9684X: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - EPYC 9754: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Xeon 6766E: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Xeon 6780E: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Xeon Platinum 8380: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Xeon Platinum 8490H: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Xeon Platinum 8592+: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Xeon Max 9468: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Xeon Max 9480: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Ampere Altra Max M128-30: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-faVlZy/gcc-13-13.2.0/debian/tmp-nvptx/usr --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto --without-cuda-driver -v Processor Details - EPYC 8534P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00213 - EPYC 8534PN: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00213 - EPYC 9654: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144 - EPYC 9684X: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144 - EPYC 9754: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00116 - Xeon 6766E: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131 - Xeon 6780E: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131 - Xeon Platinum 8380: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd0003d1 - Xeon Platinum 8490H: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590 - Xeon Platinum 8592+: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200 - Xeon Max 9468: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290 - Xeon Max 9480: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290 - Ampere Altra Max M128-30: Scaling Governor: cppc_cpufreq performance (Boost: Disabled) Java Details - EPYC 8534P: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - EPYC 8534PN: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - EPYC 9654: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - EPYC 9684X: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - EPYC 9754: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - Xeon 6766E: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - Xeon 6780E: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - Xeon Platinum 8380: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - Xeon Platinum 8490H: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - Xeon Platinum 8592+: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - Xeon Max 9468: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - Xeon Max 9480: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) - Ampere Altra Max M128-30: OpenJDK Runtime Environment (build 21.0.3+9-Ubuntu-1ubuntu1) Python Details - Python 3.12.2 Security Details - EPYC 8534P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 8534PN: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 9654: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 9684X: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - EPYC 9754: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Xeon 6766E: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Xeon 6780E: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Xeon Platinum 8380: gather_data_sampling: Mitigation of Microcode + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon Platinum 8490H: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon Platinum 8592+: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon Max 9468: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon Max 9480: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Ampere Altra Max M128-30: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected
Intel Xeon 6700E Sierra Forest vs. Ampere Altra vs. AMD EPYC openvino: Handwritten English Recognition FP16-INT8 - CPU xmrig: GhostRider - 1M openssl: SHA256 speedb: Rand Read rocksdb: Rand Read openssl: SHA512 liquid-dsp: 256 - 256 - 512 build-nodejs: Time To Compile compress-7zip: Decompression Rating quantlib: Multi-Threaded liquid-dsp: 256 - 256 - 57 avifenc: 2 john-the-ripper: bcrypt john-the-ripper: Blowfish m-queens: Time To Solve liquid-dsp: 128 - 256 - 512 coremark: CoreMark Size 666 - Iterations Per Second avifenc: 0 mt-dgemm: Sustained Floating-Point Rate speedb: Read While Writing liquid-dsp: 128 - 256 - 57 openvino: Machine Translation EN To DE FP16 - CPU llamafile: llava-v1.5-7b-q4 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU minife: Small rocksdb: Read While Writing pytorch: CPU - 512 - ResNet-50 pytorch: CPU - 256 - ResNet-50 pytorch: CPU - 64 - ResNet-50 pgbench: 100 - 1000 - Read Only pgbench: 100 - 1000 - Read Only - Average Latency graphics-magick: Enhanced clickhouse: 100M Rows Hits Dataset, Second Run build-linux-kernel: allmodconfig clickhouse: 100M Rows Hits Dataset, Third Run build-llvm: Ninja compress-7zip: Compression Rating clickhouse: 100M Rows Hits Dataset, First Run / Cold Cache cloverleaf: clover_bm16 x265: Bosphorus 4K srsran: PDSCH Processor Benchmark, Throughput Total openvino: Machine Translation EN To DE FP16 - CPU llamafile: wizardcoder-python-34b-v1.0.Q6_K - CPU avifenc: 10, Lossless cloverleaf: clover_bm64_short avifenc: 6, Lossless pgbench: 100 - 1000 - Read Write - Average Latency pgbench: 100 - 1000 - Read Write avifenc: 6 stockfish: Chess Benchmark EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 Xeon Max 9480 Ampere Altra Max M128-30 41.38 4660.0 74584721007 274091778 266186537 24378460820 821013333 277.525 367989 172566.8 3116933333 41.657 102222 102198 13.250 809916667 2274636.131544 75.864 21.817577 12053901 2982800000 100.67 21.00 1542.61 24526.0 9333645 33.76 33.68 33.49 2606500 0.384 172 337.32 406.414 338.84 205.014 331357 323.59 495.25 28.13 19375.9 317.38 5.16 5.735 57.38 7.182 16.321 61272 3.484 99198144 45.71 4564.3 67806730387 242940110 234992636 22194470973 741740000 288.118 338355 153920.8 2793700000 42.605 93472 93473 14.493 731756667 2069432.528093 78.241 20.997732 11882103 2687066667 109.00 20.65 1396.78 24548.8 8934176 33.18 33.30 33.23 2416375 0.414 163 337.44 438.168 335.46 215.925 319094 322.69 498.22 27.74 19485.8 293.07 5.11 5.734 57.54 7.301 18.053 55395 3.623 90658156 34.92 14207.7 126475137690 428557054 409272949 39627575497 1362166667 164.021 642626 294183.2 5266466667 34.148 166541 166541 7.738 1158166667 3926265.277120 61.992 39.086262 18024993 4256300000 91.16 25.75 2739.01 50909.6 14608544 34.65 34.90 35.01 3603261 0.278 264 562.50 311.825 559.55 135.666 549500 536.82 334.30 31.72 27695.2 525.88 8.35 4.792 46.50 5.799 12.502 79987 2.756 197708350 32.00 15786.6 138409588983 537633034 523310091 45865131913 1570400000 147.837 716065 319827.2 5811900000 34.044 192898 192574 6.950 1368733333 4152864.875380 61.629 45.245794 19595777 4755333333 83.11 25.38 2986.33 53167.8 14158419 34.69 34.90 34.71 3989358 0.251 300 597.73 290.341 595.19 124.455 579112 566.31 245.82 32.12 29384.9 576.98 8.48 4.770 42.17 5.757 12.580 79492 2.723 214524659 38.85 9320.5 161269162280 589951070 573235452 52746634113 1744700000 186.103 780871 374413.5 6401366667 40.351 220188 220188 6.350 1369800000 4525288.003014 73.271 44.970826 22829426 4714500000 102.84 20.64 3280.25 50139.9 15776186 27.53 27.78 27.68 3422492 0.292 304 450.12 337.685 458.96 146.761 575440 433.79 400.52 28.16 25194.6 621.42 7.47 5.662 48.36 6.853 13.843 72244 3.251 189763799 172.72 5315.7 129975994733 596955494 574749552 40605137923 848376667 246.848 421063 233836.3 4259433333 76.474 190058 190209 11.479 719626667 2915609.747368 140.859 15.941604 17548934 3736300000 259.66 8.56 832.29 40441.0 11340389 26.91 26.82 26.89 1748658 0.572 270 381.05 274.855 379.92 184.202 413851 365.62 314.88 20.22 27281.9 138.53 5.39 7.507 38.01 9.188 12.628 79191 4.243 122794246 153.76 5753.9 144163027280 673159217 645309483 45088755640 940270000 228.571 463768 262432.6 4714700000 69.343 211311 211449 10.301 796340000 3340274.034309 126.966 17.853682 17945745 4136766667 240.38 9.60 934.97 40626.4 11864815 30.87 30.86 30.69 1846080 0.542 299 403.96 251.195 400.52 169.447 438048 388.29 313.50 21.30 29804.4 149.63 5.58 6.849 38.01 8.359 11.537 86677 3.872 125194066 62.64 2593.2 27858504490 130359145 125584953 10980940093 542606667 423.626 188345 91036.5 1610466667 52.227 56939 56939 24.175 539226667 1218453.342873 100.461 13.494557 7147120 1554666667 127.89 19.11 637.76 22957.3 5539870 48.99 48.89 48.99 1720762 0.581 123 339.67 612.782 342.99 298.409 243732 326.65 512.36 29.76 13537.7 156.13 4.41 5.906 60.89 8.201 16.341 61233 4.093 51099545 36.20 5808.8 61806994523 276179617 265366170 22219927723 1020833333 254.003 287862 179647.5 3500833333 37.752 94551 94513 15.211 918566667 2194630.600449 69.931 23.543705 10695360 3181266667 62.46 20.95 1643.43 35230.1 7841738 56.44 54.84 56.01 1748146 0.572 216 486.05 362.454 481.66 187.017 388190 465.50 328.47 37.86 24688.5 477.77 5.85 4.923 39.48 6.278 14.040 71227 3.169 96887479 21.87 8378.3 66573957920 315178381 297517946 23886054770 1178766667 214.431 338146 195648.8 3806833333 34.791 105781 105831 14.257 1152933333 2369998.356940 64.475 29.141078 12168413 3503200000 26.85 16.61 2924.66 31830.2 8926893 63.30 63.60 63.06 1699046 0.589 228 455.79 316.902 458.23 165.048 441636 437.20 410.59 38.93 26378.1 592.20 4.08 4.456 39.38 5.784 13.264 75396 2.971 109766345 23.12 5446.8 44439185187 211457048 205346154 16199261277 838530000 270.380 207738 143755.3 2848933333 41.125 67875 67893 21.030 800186667 1614763.703237 76.915 19.768930 8795408 2670033333 28.73 7.67 2074.30 20091.1 7439663 51.05 52.97 51.55 1792636 0.559 160 465.06 428.387 470.02 212.482 314716 446.40 351.29 29.05 21286.6 415.96 1.47 4.916 41.43 6.836 14.292 69969 3.730 68019088 24.94 6122.3 51840436763 244070674 234469939 18893980783 944550000 252.648 243347 162727.4 3222533333 39.876 79144 79152 18.102 882200000 1855135.326098 73.060 22.539990 9988176 2972400000 38.50 8.13 2243.84 18621.2 7366500 51.86 51.56 51.35 1607424 0.622 181 474.68 384.063 476.91 197.844 342363 461.62 357.57 31.40 15081.0 467.08 1.54 4.867 42.22 6.605 13.845 72225 3.550 73592230 218.35 2514.1 99240430433 452482473 399277797 34282834893 367020000 676.786 539366 251819.4 2839066667 134.170 108723 108532 8.423 365283333 2823599.455709 211.954 17.925396 10457238 2825033333 795.07 0.99 146.26 24015.5 9445415 23.83 24.24 24.51 1725175 0.580 266 244.83 366.867 247.83 293.185 319039 243.61 564.86 17.45 13714.6 40.05 0.59 5.521 63.16 7.091 17.310 57787 3.816 59497098 OpenBenchmarking.org
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 50 100 150 200 250 SE +/- 1.16, N = 3 SE +/- 0.09, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.34, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.46, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 218.35 41.38 45.71 34.92 32.00 38.85 172.72 153.76 23.12 24.94 62.64 36.20 21.87 MIN: 206.82 / MAX: 376.74 MIN: 25.29 / MAX: 59.37 MIN: 31.06 / MAX: 64.63 MIN: 22.04 / MAX: 54.74 MIN: 21.72 / MAX: 52.65 MIN: 23.02 / MAX: 69.97 MIN: 157.02 / MAX: 193.61 MIN: 141.2 / MAX: 169.62 MIN: 40.14 / MAX: 79.92 MIN: 20.73 / MAX: 45.28 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Xmrig Variant: GhostRider - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.21 Variant: GhostRider - Hash Count: 1M Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 3K 6K 9K 12K 15K SE +/- 9.27, N = 3 SE +/- 30.53, N = 3 SE +/- 41.94, N = 3 SE +/- 117.32, N = 3 SE +/- 10.36, N = 3 SE +/- 61.27, N = 3 SE +/- 19.74, N = 3 SE +/- 43.00, N = 3 SE +/- 12.93, N = 3 SE +/- 14.78, N = 3 SE +/- 32.20, N = 2 SE +/- 23.16, N = 3 SE +/- 44.68, N = 3 2514.1 4660.0 4564.3 14207.7 15786.6 9320.5 5315.7 5753.9 5446.8 6122.3 2593.2 5808.8 8378.3 -maes -maes -maes -maes -maes -maes -maes -maes -maes -maes -maes -maes 1. (CXX) g++ options: -fexceptions -fno-rtti -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
OpenSSL Algorithm: SHA256 OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: SHA256 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 30000M 60000M 90000M 120000M 150000M SE +/- 164160900.82, N = 3 SE +/- 10642001.84, N = 3 SE +/- 64797308.82, N = 3 SE +/- 38601729.93, N = 3 SE +/- 146384349.91, N = 3 SE +/- 34182873.86, N = 3 SE +/- 34216643.88, N = 3 SE +/- 242095363.59, N = 3 SE +/- 27466135.54, N = 3 SE +/- 33334799.97, N = 3 SE +/- 8534071.27, N = 3 SE +/- 159515825.53, N = 3 SE +/- 23323764.84, N = 3 99240430433 74584721007 67806730387 126475137690 138409588983 161269162280 129975994733 144163027280 44439185187 51840436763 27858504490 61806994523 66573957920 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 1. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl
Speedb Test: Random Read OpenBenchmarking.org Op/s, More Is Better Speedb 2.7 Test: Random Read Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 140M 280M 420M 560M 700M SE +/- 5737147.53, N = 3 SE +/- 109015.29, N = 3 SE +/- 70537.88, N = 3 SE +/- 66268.38, N = 3 SE +/- 205170.43, N = 3 SE +/- 1606748.01, N = 3 SE +/- 998087.60, N = 3 SE +/- 1322733.50, N = 3 SE +/- 3698537.65, N = 15 SE +/- 2763560.64, N = 13 SE +/- 232538.80, N = 3 SE +/- 168680.90, N = 3 SE +/- 242146.75, N = 3 452482473 274091778 242940110 428557054 537633034 589951070 596955494 673159217 211457048 244070674 130359145 276179617 315178381 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
RocksDB Test: Random Read OpenBenchmarking.org Op/s, More Is Better RocksDB 9.0 Test: Random Read Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 140M 280M 420M 560M 700M SE +/- 3900100.47, N = 6 SE +/- 206014.27, N = 3 SE +/- 211259.57, N = 3 SE +/- 610621.13, N = 3 SE +/- 326038.01, N = 3 SE +/- 153963.59, N = 3 SE +/- 1336933.52, N = 3 SE +/- 2130676.22, N = 3 SE +/- 81327.78, N = 3 SE +/- 86315.43, N = 3 SE +/- 744772.41, N = 3 SE +/- 3338569.32, N = 3 SE +/- 1119855.47, N = 3 399277797 266186537 234992636 409272949 523310091 573235452 574749552 645309483 205346154 234469939 125584953 265366170 297517946 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenSSL Algorithm: SHA512 OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: SHA512 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 11000M 22000M 33000M 44000M 55000M SE +/- 7598758.15, N = 3 SE +/- 15082903.45, N = 3 SE +/- 9990938.84, N = 3 SE +/- 6285194.15, N = 3 SE +/- 55712209.05, N = 3 SE +/- 5822493.86, N = 3 SE +/- 14430784.68, N = 3 SE +/- 24045021.87, N = 3 SE +/- 500176.69, N = 3 SE +/- 1250834.62, N = 3 SE +/- 6313493.56, N = 3 SE +/- 203213936.42, N = 3 SE +/- 37654528.63, N = 3 34282834893 24378460820 22194470973 39627575497 45865131913 52746634113 40605137923 45088755640 16199261277 18893980783 10980940093 22219927723 23886054770 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 1. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl
Liquid-DSP Threads: 256 - Buffer Length: 256 - Filter Length: 512 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 512 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 400M 800M 1200M 1600M 2000M SE +/- 128970.28, N = 3 SE +/- 776881.23, N = 3 SE +/- 170391.71, N = 3 SE +/- 520683.31, N = 3 SE +/- 2676440.42, N = 3 SE +/- 1300000.00, N = 3 SE +/- 320537.74, N = 3 SE +/- 409267.64, N = 3 SE +/- 569766.03, N = 3 SE +/- 740202.67, N = 3 SE +/- 4629652.01, N = 3 SE +/- 1722723.94, N = 3 SE +/- 240370.09, N = 3 367020000 821013333 741740000 1362166667 1570400000 1744700000 848376667 940270000 838530000 944550000 542606667 1020833333 1178766667 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Timed Node.js Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Node.js Compilation 21.7.2 Time To Compile Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 150 300 450 600 750 SE +/- 1.19, N = 3 SE +/- 0.17, N = 3 SE +/- 0.19, N = 3 SE +/- 0.59, N = 3 SE +/- 0.50, N = 3 SE +/- 0.72, N = 3 SE +/- 0.15, N = 3 SE +/- 0.51, N = 3 SE +/- 0.53, N = 3 SE +/- 0.74, N = 3 SE +/- 0.22, N = 3 SE +/- 0.71, N = 3 SE +/- 0.52, N = 3 676.79 277.53 288.12 164.02 147.84 186.10 246.85 228.57 270.38 252.65 423.63 254.00 214.43
7-Zip Compression Test: Decompression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Decompression Rating Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 200K 400K 600K 800K 1000K SE +/- 128.55, N = 3 SE +/- 120.28, N = 3 SE +/- 81.21, N = 3 SE +/- 111.53, N = 3 SE +/- 1085.99, N = 3 SE +/- 291.68, N = 3 SE +/- 343.82, N = 3 SE +/- 258.19, N = 3 SE +/- 916.22, N = 3 SE +/- 374.59, N = 3 SE +/- 309.57, N = 3 SE +/- 61.74, N = 3 SE +/- 119.21, N = 3 539366 367989 338355 642626 716065 780871 421063 463768 207738 243347 188345 287862 338146 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
QuantLib Configuration: Multi-Threaded OpenBenchmarking.org MFLOPS, More Is Better QuantLib 1.32 Configuration: Multi-Threaded Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 80K 160K 240K 320K 400K SE +/- 458.48, N = 3 SE +/- 82.80, N = 3 SE +/- 86.28, N = 3 SE +/- 86.78, N = 3 SE +/- 412.72, N = 3 SE +/- 156.35, N = 3 SE +/- 306.14, N = 3 SE +/- 846.02, N = 3 SE +/- 155.19, N = 3 SE +/- 40.48, N = 3 SE +/- 395.04, N = 3 SE +/- 105.60, N = 3 SE +/- 63.14, N = 3 251819.4 172566.8 153920.8 294183.2 319827.2 374413.5 233836.3 262432.6 143755.3 162727.4 91036.5 179647.5 195648.8 1. (CXX) g++ options: -O3 -march=native -fPIE -pie
Liquid-DSP Threads: 256 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 57 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 1400M 2800M 4200M 5600M 7000M SE +/- 868587.61, N = 3 SE +/- 1959875.28, N = 3 SE +/- 4481443.22, N = 3 SE +/- 2618735.91, N = 3 SE +/- 8144527.82, N = 3 SE +/- 12739745.33, N = 3 SE +/- 8015887.00, N = 3 SE +/- 6906036.01, N = 3 SE +/- 4088330.28, N = 3 SE +/- 1976810.00, N = 3 SE +/- 2935605.18, N = 3 SE +/- 5292237.50, N = 3 SE +/- 3555434.03, N = 3 2839066667 3116933333 2793700000 5266466667 5811900000 6401366667 4259433333 4714700000 2848933333 3222533333 1610466667 3500833333 3806833333 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
libavif avifenc Encoder Speed: 2 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 2 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 30 60 90 120 150 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.41, N = 3 SE +/- 0.21, N = 3 SE +/- 0.31, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 134.17 41.66 42.61 34.15 34.04 40.35 76.47 69.34 41.13 39.88 52.23 37.75 34.79 1. (CXX) g++ options: -O3 -fPIC -lm
John The Ripper Test: bcrypt OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: bcrypt Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 50K 100K 150K 200K 250K SE +/- 14.72, N = 3 SE +/- 22.28, N = 3 SE +/- 0.00, N = 3 SE +/- 20.00, N = 3 SE +/- 154.46, N = 3 SE +/- 1.33, N = 3 SE +/- 32.84, N = 3 SE +/- 87.49, N = 3 SE +/- 8.84, N = 3 SE +/- 8.67, N = 3 SE +/- 6.33, N = 3 SE +/- 10.67, N = 3 SE +/- 46.28, N = 3 108723 102222 93472 166541 192898 220188 190058 211311 67875 79144 56939 94551 105781 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 1. (CC) gcc options: -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
John The Ripper Test: Blowfish OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: Blowfish Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 50K 100K 150K 200K 250K SE +/- 191.33, N = 3 SE +/- 13.72, N = 3 SE +/- 20.54, N = 3 SE +/- 38.33, N = 3 SE +/- 98.33, N = 3 SE +/- 1.33, N = 3 SE +/- 174.44, N = 3 SE +/- 14.67, N = 3 SE +/- 17.33, N = 3 SE +/- 8.67, N = 3 SE +/- 6.33, N = 3 SE +/- 11.39, N = 3 SE +/- 79.75, N = 3 108532 102198 93473 166541 192574 220188 190209 211449 67893 79152 56939 94513 105831 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 -m64 1. (CC) gcc options: -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
m-queens Time To Solve OpenBenchmarking.org Seconds, Fewer Is Better m-queens 1.2 Time To Solve Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 6 12 18 24 30 SE +/- 0.002, N = 5 SE +/- 0.019, N = 4 SE +/- 0.029, N = 4 SE +/- 0.019, N = 6 SE +/- 0.025, N = 6 SE +/- 0.021, N = 6 SE +/- 0.039, N = 5 SE +/- 0.032, N = 5 SE +/- 0.031, N = 3 SE +/- 0.035, N = 3 SE +/- 0.023, N = 3 SE +/- 0.025, N = 4 SE +/- 0.030, N = 4 8.423 13.250 14.493 7.738 6.950 6.350 11.479 10.301 21.030 18.102 24.175 15.211 14.257 1. (CXX) g++ options: -fopenmp -O2 -march=native
Liquid-DSP Threads: 128 - Buffer Length: 256 - Filter Length: 512 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 512 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 300M 600M 900M 1200M 1500M SE +/- 17638.34, N = 3 SE +/- 390953.25, N = 3 SE +/- 431058.13, N = 3 SE +/- 1047748.91, N = 3 SE +/- 2412697.89, N = 3 SE +/- 814452.78, N = 3 SE +/- 305632.31, N = 3 SE +/- 287923.60, N = 3 SE +/- 681281.47, N = 3 SE +/- 1345523.44, N = 3 SE +/- 912164.70, N = 3 SE +/- 1740596.96, N = 3 SE +/- 2313246.88, N = 3 365283333 809916667 731756667 1158166667 1368733333 1369800000 719626667 796340000 800186667 882200000 539226667 918566667 1152933333 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Coremark CoreMark Size 666 - Iterations Per Second OpenBenchmarking.org Iterations/Sec, More Is Better Coremark 1.0 CoreMark Size 666 - Iterations Per Second Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 1000K 2000K 3000K 4000K 5000K SE +/- 1087.84, N = 3 SE +/- 1374.66, N = 3 SE +/- 11678.22, N = 3 SE +/- 10132.66, N = 3 SE +/- 54326.71, N = 3 SE +/- 4775.53, N = 3 SE +/- 10294.77, N = 3 SE +/- 40214.40, N = 15 SE +/- 1747.99, N = 3 SE +/- 5202.86, N = 3 SE +/- 927.64, N = 3 SE +/- 9256.47, N = 3 SE +/- 4635.95, N = 3 2823599.46 2274636.13 2069432.53 3926265.28 4152864.88 4525288.00 2915609.75 3340274.03 1614763.70 1855135.33 1218453.34 2194630.60 2369998.36 1. (CC) gcc options: -O2 -lrt" -lrt
libavif avifenc Encoder Speed: 0 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 0 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 50 100 150 200 250 SE +/- 0.09, N = 3 SE +/- 0.19, N = 3 SE +/- 0.18, N = 3 SE +/- 0.01, N = 3 SE +/- 0.12, N = 3 SE +/- 0.13, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.15, N = 3 SE +/- 0.22, N = 3 SE +/- 0.52, N = 3 SE +/- 0.32, N = 3 SE +/- 0.08, N = 3 211.95 75.86 78.24 61.99 61.63 73.27 140.86 126.97 76.92 73.06 100.46 69.93 64.48 1. (CXX) g++ options: -O3 -fPIC -lm
ACES DGEMM Sustained Floating-Point Rate OpenBenchmarking.org GFLOP/s, More Is Better ACES DGEMM 1.0 Sustained Floating-Point Rate Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 10 20 30 40 50 SE +/- 0.07, N = 4 SE +/- 0.16, N = 5 SE +/- 0.10, N = 5 SE +/- 0.22, N = 7 SE +/- 0.40, N = 7 SE +/- 0.17, N = 7 SE +/- 0.01, N = 4 SE +/- 0.01, N = 4 SE +/- 0.04, N = 4 SE +/- 0.09, N = 5 SE +/- 0.01, N = 3 SE +/- 0.09, N = 5 SE +/- 0.08, N = 6 17.93 21.82 21.00 39.09 45.25 44.97 15.94 17.85 19.77 22.54 13.49 23.54 29.14 1. (CC) gcc options: -O3 -march=native -fopenmp
Speedb Test: Read While Writing OpenBenchmarking.org Op/s, More Is Better Speedb 2.7 Test: Read While Writing Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 5M 10M 15M 20M 25M SE +/- 123169.00, N = 15 SE +/- 88013.69, N = 15 SE +/- 86788.79, N = 3 SE +/- 170909.18, N = 3 SE +/- 118870.12, N = 3 SE +/- 172052.60, N = 3 SE +/- 45758.35, N = 3 SE +/- 75416.94, N = 3 SE +/- 88257.34, N = 3 SE +/- 93731.24, N = 7 SE +/- 48302.92, N = 15 SE +/- 62510.72, N = 3 SE +/- 143570.67, N = 4 10457238 12053901 11882103 18024993 19595777 22829426 17548934 17945745 8795408 9988176 7147120 10695360 12168413 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Liquid-DSP Threads: 128 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 57 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 1000M 2000M 3000M 4000M 5000M SE +/- 484194.63, N = 3 SE +/- 3527510.93, N = 3 SE +/- 6398003.16, N = 3 SE +/- 20120967.50, N = 3 SE +/- 6778479.02, N = 3 SE +/- 18691531.06, N = 3 SE +/- 6887912.12, N = 3 SE +/- 1909915.65, N = 3 SE +/- 2030052.00, N = 3 SE +/- 3119294.79, N = 3 SE +/- 1549551.91, N = 3 SE +/- 3116800.35, N = 3 SE +/- 5260228.13, N = 3 2825033333 2982800000 2687066667 4256300000 4755333333 4714500000 3736300000 4136766667 2670033333 2972400000 1554666667 3181266667 3503200000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 200 400 600 800 1000 SE +/- 0.82, N = 3 SE +/- 0.13, N = 3 SE +/- 0.05, N = 3 SE +/- 0.77, N = 7 SE +/- 0.60, N = 11 SE +/- 1.05, N = 5 SE +/- 0.48, N = 3 SE +/- 0.06, N = 3 SE +/- 0.12, N = 3 SE +/- 0.34, N = 3 SE +/- 0.39, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 795.07 100.67 109.00 91.16 83.11 102.84 259.66 240.38 28.73 38.50 127.89 62.46 26.85 MIN: 583.77 / MAX: 1627.8 MIN: 233.78 / MAX: 289.08 MIN: 218.44 / MAX: 254.1 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Llamafile Test: llava-v1.5-7b-q4 - Acceleration: CPU OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.7 Test: llava-v1.5-7b-q4 - Acceleration: CPU Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 6 12 18 24 30 SE +/- 0.09, N = 12 SE +/- 0.11, N = 4 SE +/- 0.07, N = 4 SE +/- 0.02, N = 5 SE +/- 0.10, N = 5 SE +/- 0.05, N = 4 SE +/- 0.08, N = 3 SE +/- 0.30, N = 15 SE +/- 0.10, N = 3 SE +/- 0.02, N = 3 SE +/- 0.11, N = 3 SE +/- 0.15, N = 4 SE +/- 0.17, N = 4 0.99 21.00 20.65 25.75 25.38 20.64 8.56 9.60 7.67 8.13 19.11 20.95 16.61
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 700 1400 2100 2800 3500 SE +/- 0.76, N = 3 SE +/- 3.51, N = 3 SE +/- 0.47, N = 3 SE +/- 4.84, N = 3 SE +/- 4.06, N = 3 SE +/- 7.27, N = 3 SE +/- 1.73, N = 3 SE +/- 0.61, N = 3 SE +/- 3.41, N = 3 SE +/- 4.55, N = 3 SE +/- 4.60, N = 3 SE +/- 1.46, N = 3 SE +/- 0.73, N = 3 146.26 1542.61 1396.78 2739.01 2986.33 3280.25 832.29 934.97 2074.30 2243.84 637.76 1643.43 2924.66 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
miniFE Problem Size: Small OpenBenchmarking.org CG Mflops, More Is Better miniFE 2.2 Problem Size: Small Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 11K 22K 33K 44K 55K SE +/- 8.98, N = 4 SE +/- 49.20, N = 4 SE +/- 42.17, N = 4 SE +/- 42.89, N = 5 SE +/- 92.04, N = 5 SE +/- 53.07, N = 5 SE +/- 19.87, N = 4 SE +/- 8.42, N = 4 SE +/- 601.03, N = 12 SE +/- 572.00, N = 12 SE +/- 54.57, N = 4 SE +/- 11.14, N = 4 SE +/- 135.77, N = 4 24015.5 24526.0 24548.8 50909.6 53167.8 50139.9 40441.0 40626.4 20091.1 18621.2 22957.3 35230.1 31830.2 1. (CXX) g++ options: -O3 -fopenmp -lmpi_cxx -lmpi
RocksDB Test: Read While Writing OpenBenchmarking.org Op/s, More Is Better RocksDB 9.0 Test: Read While Writing Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 3M 6M 9M 12M 15M SE +/- 88887.11, N = 3 SE +/- 28098.62, N = 3 SE +/- 81998.56, N = 3 SE +/- 36524.26, N = 3 SE +/- 93669.97, N = 15 SE +/- 109424.14, N = 3 SE +/- 45015.86, N = 3 SE +/- 136761.19, N = 4 SE +/- 83772.27, N = 13 SE +/- 26369.56, N = 3 SE +/- 23120.76, N = 3 SE +/- 61518.27, N = 10 SE +/- 28201.44, N = 3 9445415 9333645 8934176 14608544 14158419 15776186 11340389 11864815 7439663 7366500 5539870 7841738 8926893 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
PyTorch Device: CPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 14 28 42 56 70 SE +/- 0.24, N = 5 SE +/- 0.08, N = 3 SE +/- 0.11, N = 3 SE +/- 0.10, N = 3 SE +/- 0.19, N = 3 SE +/- 0.04, N = 3 SE +/- 0.24, N = 3 SE +/- 0.02, N = 3 SE +/- 0.72, N = 3 SE +/- 0.43, N = 15 SE +/- 0.17, N = 3 SE +/- 0.12, N = 3 SE +/- 0.19, N = 3 23.83 33.76 33.18 34.65 34.69 27.53 26.91 30.87 51.05 51.86 48.99 56.44 63.30 MIN: 12.48 / MAX: 24.59 MIN: 31.39 / MAX: 34.3 MIN: 32.26 / MAX: 33.81 MIN: 33.72 / MAX: 35.48 MIN: 33.34 / MAX: 35.97 MIN: 26.63 / MAX: 28.06 MIN: 25.38 / MAX: 27.92 MIN: 27.91 / MAX: 31.42 MIN: 40.71 / MAX: 53.89 MIN: 30.55 / MAX: 55.87 MIN: 47.82 / MAX: 49.69 MIN: 48.09 / MAX: 58.6 MIN: 48.94 / MAX: 65.25
PyTorch Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 14 28 42 56 70 SE +/- 0.09, N = 3 SE +/- 0.18, N = 3 SE +/- 0.13, N = 3 SE +/- 0.21, N = 3 SE +/- 0.09, N = 3 SE +/- 0.08, N = 3 SE +/- 0.12, N = 3 SE +/- 0.13, N = 3 SE +/- 0.76, N = 3 SE +/- 0.62, N = 3 SE +/- 0.04, N = 3 SE +/- 0.52, N = 3 SE +/- 0.64, N = 3 24.24 33.68 33.30 34.90 34.90 27.78 26.82 30.86 52.97 51.56 48.89 54.84 63.60 MIN: 21.29 / MAX: 24.51 MIN: 31.27 / MAX: 34.43 MIN: 32.26 / MAX: 33.94 MIN: 33.85 / MAX: 35.99 MIN: 34.15 / MAX: 35.71 MIN: 26.81 / MAX: 28.37 MIN: 10.77 / MAX: 27.82 MIN: 28.02 / MAX: 31.65 MIN: 33.28 / MAX: 55.78 MIN: 30.49 / MAX: 54.7 MIN: 45.35 / MAX: 49.3 MIN: 46.5 / MAX: 58.5 MIN: 37.79 / MAX: 65.67
PyTorch Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 14 28 42 56 70 SE +/- 0.15, N = 3 SE +/- 0.06, N = 3 SE +/- 0.18, N = 3 SE +/- 0.26, N = 3 SE +/- 0.10, N = 3 SE +/- 0.10, N = 3 SE +/- 0.14, N = 3 SE +/- 0.33, N = 5 SE +/- 0.71, N = 3 SE +/- 0.62, N = 3 SE +/- 0.14, N = 3 SE +/- 0.24, N = 3 SE +/- 0.12, N = 3 24.51 33.49 33.23 35.01 34.71 27.68 26.89 30.69 51.55 51.35 48.99 56.01 63.06 MIN: 22.33 / MAX: 24.82 MIN: 32.03 / MAX: 34.13 MIN: 31.97 / MAX: 33.93 MIN: 33.84 / MAX: 36.39 MIN: 33.58 / MAX: 35.7 MIN: 26.61 / MAX: 28.44 MIN: 24.84 / MAX: 27.54 MIN: 27.43 / MAX: 32.15 MIN: 37.49 / MAX: 54.33 MIN: 41.6 / MAX: 53.81 MIN: 47.13 / MAX: 49.74 MIN: 51.84 / MAX: 59.12 MIN: 33.2 / MAX: 65.54
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 900K 1800K 2700K 3600K 4500K SE +/- 4953.93, N = 3 SE +/- 11512.67, N = 3 SE +/- 4774.62, N = 3 SE +/- 39970.22, N = 3 SE +/- 27594.68, N = 3 SE +/- 15503.17, N = 3 SE +/- 20221.52, N = 3 SE +/- 19583.16, N = 5 SE +/- 24978.23, N = 12 SE +/- 17697.00, N = 3 SE +/- 13469.59, N = 3 SE +/- 20350.34, N = 3 SE +/- 13863.97, N = 12 1725175 2606500 2416375 3603261 3989358 3422492 1748658 1846080 1792636 1607424 1720762 1748146 1699046 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 0.14 0.28 0.42 0.56 0.7 SE +/- 0.002, N = 3 SE +/- 0.002, N = 3 SE +/- 0.001, N = 3 SE +/- 0.003, N = 3 SE +/- 0.002, N = 3 SE +/- 0.001, N = 3 SE +/- 0.007, N = 3 SE +/- 0.006, N = 5 SE +/- 0.008, N = 12 SE +/- 0.007, N = 3 SE +/- 0.005, N = 3 SE +/- 0.007, N = 3 SE +/- 0.005, N = 12 0.580 0.384 0.414 0.278 0.251 0.292 0.572 0.542 0.559 0.622 0.581 0.572 0.589 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
GraphicsMagick Operation: Enhanced OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Enhanced Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 SE +/- 0.67, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.67, N = 3 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 266 172 163 264 300 304 270 299 160 181 123 216 228 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
ClickHouse 100M Rows Hits Dataset, Second Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 130 260 390 520 650 SE +/- 3.08, N = 3 SE +/- 2.99, N = 3 SE +/- 5.72, N = 3 SE +/- 3.14, N = 3 SE +/- 0.42, N = 3 SE +/- 9.26, N = 3 SE +/- 3.34, N = 3 SE +/- 2.12, N = 3 SE +/- 1.94, N = 3 SE +/- 4.95, N = 3 SE +/- 0.73, N = 3 SE +/- 2.93, N = 3 SE +/- 2.86, N = 6 244.83 337.32 337.44 562.50 597.73 450.12 381.05 403.96 465.06 474.68 339.67 486.05 455.79 MIN: 28.33 / MAX: 2608.7 MIN: 35.76 / MAX: 4000 MIN: 33.44 / MAX: 4615.38 MIN: 57.47 / MAX: 6666.67 MIN: 61.41 / MAX: 5454.55 MIN: 66.15 / MAX: 5454.55 MIN: 48.39 / MAX: 5000 MIN: 54.35 / MAX: 5000 MIN: 32.59 / MAX: 5000 MIN: 36.43 / MAX: 6000 MIN: 21.1 / MAX: 4285.71 MIN: 40.43 / MAX: 6666.67 MIN: 42.19 / MAX: 6666.67
Timed Linux Kernel Compilation Build: allmodconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.8 Build: allmodconfig Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 130 260 390 520 650 SE +/- 1.15, N = 3 SE +/- 0.91, N = 3 SE +/- 0.78, N = 3 SE +/- 0.49, N = 3 SE +/- 0.37, N = 3 SE +/- 1.05, N = 3 SE +/- 0.76, N = 3 SE +/- 0.67, N = 3 SE +/- 0.61, N = 3 SE +/- 0.67, N = 3 SE +/- 0.35, N = 3 SE +/- 0.80, N = 3 SE +/- 0.72, N = 3 366.87 406.41 438.17 311.83 290.34 337.69 274.86 251.20 428.39 384.06 612.78 362.45 316.90
ClickHouse 100M Rows Hits Dataset, Third Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 130 260 390 520 650 SE +/- 1.87, N = 3 SE +/- 1.77, N = 3 SE +/- 5.23, N = 3 SE +/- 4.03, N = 3 SE +/- 4.34, N = 3 SE +/- 3.32, N = 3 SE +/- 2.14, N = 3 SE +/- 1.22, N = 3 SE +/- 6.03, N = 3 SE +/- 3.60, N = 3 SE +/- 4.79, N = 3 SE +/- 3.45, N = 3 SE +/- 3.62, N = 6 247.83 338.84 335.46 559.55 595.19 458.96 379.92 400.52 470.02 476.91 342.99 481.66 458.23 MIN: 26.58 / MAX: 2857.14 MIN: 35.76 / MAX: 4000 MIN: 32.86 / MAX: 5454.55 MIN: 57.03 / MAX: 5000 MIN: 62.05 / MAX: 5000 MIN: 68.65 / MAX: 4000 MIN: 48.98 / MAX: 4000 MIN: 54.15 / MAX: 5000 MIN: 32.59 / MAX: 5454.55 MIN: 36.01 / MAX: 5000 MIN: 20.7 / MAX: 5000 MIN: 40.16 / MAX: 5454.55 MIN: 42.16 / MAX: 6000
Timed LLVM Compilation Build System: Ninja OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 16.0 Build System: Ninja Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 60 120 180 240 300 SE +/- 0.96, N = 3 SE +/- 0.20, N = 3 SE +/- 0.10, N = 3 SE +/- 0.31, N = 3 SE +/- 0.27, N = 3 SE +/- 0.74, N = 3 SE +/- 0.20, N = 3 SE +/- 0.06, N = 3 SE +/- 0.19, N = 3 SE +/- 0.36, N = 3 SE +/- 1.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 293.19 205.01 215.93 135.67 124.46 146.76 184.20 169.45 212.48 197.84 298.41 187.02 165.05
7-Zip Compression Test: Compression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Compression Rating Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 120K 240K 360K 480K 600K SE +/- 1146.13, N = 3 SE +/- 268.94, N = 3 SE +/- 206.69, N = 3 SE +/- 719.89, N = 3 SE +/- 1520.59, N = 3 SE +/- 1188.96, N = 3 SE +/- 610.46, N = 3 SE +/- 933.46, N = 3 SE +/- 1836.55, N = 3 SE +/- 2258.81, N = 3 SE +/- 248.73, N = 3 SE +/- 1535.53, N = 3 SE +/- 1982.97, N = 3 319039 331357 319094 549500 579112 575440 413851 438048 314716 342363 243732 388190 441636 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
ClickHouse 100M Rows Hits Dataset, First Run / Cold Cache OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 120 240 360 480 600 SE +/- 2.04, N = 3 SE +/- 1.57, N = 3 SE +/- 1.88, N = 3 SE +/- 5.33, N = 3 SE +/- 7.88, N = 3 SE +/- 2.78, N = 3 SE +/- 2.21, N = 3 SE +/- 1.12, N = 3 SE +/- 2.85, N = 3 SE +/- 5.88, N = 3 SE +/- 1.56, N = 3 SE +/- 3.41, N = 3 SE +/- 4.18, N = 6 243.61 323.59 322.69 536.82 566.31 433.79 365.62 388.29 446.40 461.62 326.65 465.50 437.20 MIN: 31.19 / MAX: 3333.33 MIN: 35.69 / MAX: 3750 MIN: 32.99 / MAX: 4000 MIN: 56.6 / MAX: 6666.67 MIN: 59.64 / MAX: 5454.55 MIN: 54.1 / MAX: 4285.71 MIN: 47.81 / MAX: 4000 MIN: 53.81 / MAX: 5454.55 MIN: 32.64 / MAX: 4615.38 MIN: 35.59 / MAX: 5454.55 MIN: 20.85 / MAX: 5000 MIN: 40.93 / MAX: 5454.55 MIN: 41.7 / MAX: 5454.55
CloverLeaf Input: clover_bm16 OpenBenchmarking.org Seconds, Fewer Is Better CloverLeaf 1.3 Input: clover_bm16 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 120 240 360 480 600 SE +/- 0.16, N = 3 SE +/- 0.79, N = 3 SE +/- 1.08, N = 3 SE +/- 3.79, N = 9 SE +/- 2.24, N = 3 SE +/- 4.99, N = 9 SE +/- 0.11, N = 3 SE +/- 0.00, N = 3 SE +/- 1.43, N = 3 SE +/- 2.03, N = 3 SE +/- 1.58, N = 3 SE +/- 0.13, N = 3 SE +/- 0.54, N = 3 564.86 495.25 498.22 334.30 245.82 400.52 314.88 313.50 351.29 357.57 512.36 328.47 410.59 1. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
x265 Video Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better x265 3.6 Video Input: Bosphorus 4K Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 9 18 27 36 45 SE +/- 0.14, N = 9 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.08, N = 3 SE +/- 0.11, N = 3 SE +/- 0.02, N = 3 SE +/- 0.11, N = 3 SE +/- 0.13, N = 3 SE +/- 0.08, N = 3 SE +/- 0.39, N = 3 SE +/- 0.13, N = 3 SE +/- 0.11, N = 4 SE +/- 0.06, N = 4 17.45 28.13 27.74 31.72 32.12 28.16 20.22 21.30 29.05 31.40 29.76 37.86 38.93 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
srsRAN Project Test: PDSCH Processor Benchmark, Throughput Total OpenBenchmarking.org Mbps, More Is Better srsRAN Project 23.10.1-20240325 Test: PDSCH Processor Benchmark, Throughput Total Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 6K 12K 18K 24K 30K SE +/- 12.21, N = 3 SE +/- 207.19, N = 5 SE +/- 58.21, N = 3 SE +/- 357.13, N = 12 SE +/- 348.28, N = 4 SE +/- 237.63, N = 3 SE +/- 150.02, N = 4 SE +/- 134.28, N = 4 SE +/- 938.95, N = 15 SE +/- 281.72, N = 15 SE +/- 44.42, N = 3 SE +/- 236.27, N = 4 SE +/- 298.34, N = 15 13714.6 19375.9 19485.8 27695.2 29384.9 25194.6 27281.9 29804.4 21286.6 15081.0 13537.7 24688.5 26378.1 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -march=native -mavx2 -mavx -msse4.1 -mfma -march=native -mavx2 -mavx -msse4.1 -mfma -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq 1. (CXX) g++ options: -O3 -fno-trapping-math -fno-math-errno -ldl
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 130 260 390 520 650 SE +/- 0.04, N = 3 SE +/- 0.39, N = 3 SE +/- 0.13, N = 3 SE +/- 4.59, N = 7 SE +/- 4.29, N = 11 SE +/- 6.34, N = 5 SE +/- 0.25, N = 3 SE +/- 0.03, N = 3 SE +/- 1.21, N = 3 SE +/- 4.09, N = 3 SE +/- 0.45, N = 3 SE +/- 0.17, N = 3 SE +/- 0.54, N = 3 40.05 317.38 293.07 525.88 576.98 621.42 138.53 149.63 415.96 467.08 156.13 477.77 592.20 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Llamafile Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.7 Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 2 4 6 8 10 SE +/- 0.08, N = 8 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 0.59 5.16 5.11 8.35 8.48 7.47 5.39 5.58 1.47 1.54 4.41 5.85 4.08
libavif avifenc Encoder Speed: 10, Lossless OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 10, Lossless Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 2 4 6 8 10 SE +/- 0.003, N = 7 SE +/- 0.006, N = 7 SE +/- 0.010, N = 7 SE +/- 0.006, N = 8 SE +/- 0.002, N = 8 SE +/- 0.004, N = 7 SE +/- 0.009, N = 6 SE +/- 0.003, N = 6 SE +/- 0.005, N = 7 SE +/- 0.015, N = 7 SE +/- 0.008, N = 7 SE +/- 0.006, N = 7 SE +/- 0.008, N = 8 5.521 5.735 5.734 4.792 4.770 5.662 7.507 6.849 4.916 4.867 5.906 4.923 4.456 1. (CXX) g++ options: -O3 -fPIC -lm
CloverLeaf Input: clover_bm64_short OpenBenchmarking.org Seconds, Fewer Is Better CloverLeaf 1.3 Input: clover_bm64_short Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 14 28 42 56 70 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 2.15, N = 15 SE +/- 1.81, N = 15 SE +/- 2.07, N = 12 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.15, N = 3 SE +/- 0.17, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 63.16 57.38 57.54 46.50 42.17 48.36 38.01 38.01 41.43 42.22 60.89 39.48 39.38 1. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
libavif avifenc Encoder Speed: 6, Lossless OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 6, Lossless Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 3 6 9 12 15 SE +/- 0.009, N = 6 SE +/- 0.009, N = 6 SE +/- 0.011, N = 6 SE +/- 0.010, N = 7 SE +/- 0.014, N = 7 SE +/- 0.007, N = 6 SE +/- 0.012, N = 5 SE +/- 0.010, N = 6 SE +/- 0.045, N = 6 SE +/- 0.033, N = 6 SE +/- 0.016, N = 6 SE +/- 0.013, N = 7 SE +/- 0.025, N = 7 7.091 7.182 7.301 5.799 5.757 6.853 9.188 8.359 6.836 6.605 8.201 6.278 5.784 1. (CXX) g++ options: -O3 -fPIC -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 4 8 12 16 20 SE +/- 0.21, N = 3 SE +/- 0.05, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 12 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 17.31 16.32 18.05 12.50 12.58 13.84 12.63 11.54 14.29 13.85 16.34 14.04 13.26 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 20K 40K 60K 80K 100K SE +/- 714.02, N = 3 SE +/- 175.33, N = 3 SE +/- 299.71, N = 3 SE +/- 232.97, N = 3 SE +/- 87.23, N = 3 SE +/- 242.45, N = 3 SE +/- 186.80, N = 3 SE +/- 232.81, N = 3 SE +/- 95.84, N = 3 SE +/- 143.25, N = 3 SE +/- 434.11, N = 12 SE +/- 78.02, N = 3 SE +/- 198.41, N = 3 57787 61272 55395 79987 79492 72244 79191 86677 69969 72225 61233 71227 75396 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
libavif avifenc Encoder Speed: 6 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 6 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 0.9547 1.9094 2.8641 3.8188 4.7735 SE +/- 0.007, N = 8 SE +/- 0.016, N = 9 SE +/- 0.011, N = 9 SE +/- 0.011, N = 10 SE +/- 0.005, N = 10 SE +/- 0.002, N = 9 SE +/- 0.003, N = 8 SE +/- 0.004, N = 8 SE +/- 0.017, N = 9 SE +/- 0.011, N = 9 SE +/- 0.010, N = 8 SE +/- 0.022, N = 9 SE +/- 0.016, N = 9 3.816 3.484 3.623 2.756 2.723 3.251 4.243 3.872 3.730 3.550 4.093 3.169 2.971 1. (CXX) g++ options: -O3 -fPIC -lm
CPU Power Consumption Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Watts CPU Power Consumption Monitor Phoronix Test Suite System Monitoring Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 21.38 / Avg: 126.62 / Max: 253.21 Min: 8.43 / Avg: 128.7 / Max: 184.62 Min: 9.26 / Avg: 114.13 / Max: 155.71 Min: 14.69 / Avg: 244.69 / Max: 373.1 Min: 17.06 / Avg: 290.08 / Max: 413.51 Min: 10.09 / Avg: 225.05 / Max: 397.44 Min: 21.86 / Avg: 142.1 / Max: 271.22 Min: 21.7 / Avg: 169.1 / Max: 357.69 Min: 38.11 / Avg: 291.53 / Max: 379.76 Min: 38.16 / Avg: 295.53 / Max: 384.53 Min: 26.31 / Avg: 237.91 / Max: 292.14 Min: 30.38 / Avg: 278.1 / Max: 383.24 Min: 17.77 / Avg: 260.08 / Max: 405.42
Stockfish CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Stockfish 16.1 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 45.16 / Avg: 230.17 / Max: 249.49 Min: 17.26 / Avg: 174.36 / Max: 184.62 Min: 16.19 / Avg: 145.98 / Max: 155.71 Min: 30.05 / Avg: 347.3 / Max: 373.1 Min: 35.5 / Avg: 386.38 / Max: 410.66 Min: 21.51 / Avg: 332.06 / Max: 363.69 Min: 43.78 / Avg: 240.94 / Max: 270.17 Min: 43.61 / Avg: 310.08 / Max: 337.09 Min: 71.31 / Avg: 341.39 / Max: 379.06 Min: 74.29 / Avg: 341.12 / Max: 366.15 Min: 53.05 / Avg: 263.42 / Max: 290.77 Min: 56.83 / Avg: 339.56 / Max: 379.91 Min: 22.35 / Avg: 337.72 / Max: 370.84
Stockfish Chess Benchmark OpenBenchmarking.org Nodes Per Second Per Watt, More Is Better Stockfish 16.1 Chess Benchmark Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 130K 260K 390K 520K 650K 258486.45 568916.36 621037.11 569277.48 555213.84 571475.98 509643.71 403742.35 199243.06 215737.78 193986.52 285328.34 325017.74
Stockfish Chess Benchmark OpenBenchmarking.org Nodes Per Second, More Is Better Stockfish 16.1 Chess Benchmark Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 50M 100M 150M 200M 250M SE +/- 1966844.31, N = 12 SE +/- 2397455.91, N = 12 SE +/- 2147688.02, N = 12 SE +/- 3170744.86, N = 15 SE +/- 2268830.04, N = 3 SE +/- 4652276.19, N = 12 SE +/- 3565305.92, N = 15 SE +/- 1441726.26, N = 3 SE +/- 1751369.24, N = 12 SE +/- 629927.17, N = 3 SE +/- 1466028.98, N = 9 SE +/- 1304590.97, N = 3 SE +/- 2966712.90, N = 9 59497098 99198144 90658156 197708350 214524659 189763799 122794246 125194066 68019088 73592230 51099545 96887479 109766345 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -msse4.1 -mssse3 -msse2 -mbmi2 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -msse4.1 -mssse3 -msse2 -mbmi2 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -m64 -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 1. (CXX) g++ options: -lgcov -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -flto -flto-partition=one -flto=jobserver
Xmrig CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Xmrig 6.21 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 43.17 / Avg: 133.89 / Max: 136.96 Min: 17.62 / Avg: 139.24 / Max: 143.75 Min: 15.67 / Avg: 125.96 / Max: 131.33 Min: 30.21 / Avg: 304.31 / Max: 328.13 Min: 36 / Avg: 375.84 / Max: 410.13 Min: 21.91 / Avg: 232.05 / Max: 250.74 Min: 43.68 / Avg: 173.6 / Max: 178.87 Min: 43.43 / Avg: 197.12 / Max: 203.16 Min: 73.18 / Avg: 327.41 / Max: 335.76 Min: 75.82 / Avg: 341.47 / Max: 356.09 Min: 53.3 / Avg: 264.66 / Max: 271.14 Min: 55.89 / Avg: 339.42 / Max: 349.66 Min: 24.38 / Avg: 334.94 / Max: 357.54
Xmrig Variant: GhostRider - Hash Count: 1M OpenBenchmarking.org H/s Per Watt, More Is Better Xmrig 6.21 Variant: GhostRider - Hash Count: 1M Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 11 22 33 44 55 18.777 33.466 36.236 46.688 42.004 40.166 30.621 29.190 16.636 17.929 9.798 17.114 25.015
Llamafile CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Llamafile 0.7 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 28.66 / Avg: 161.17 / Max: 199.77 Min: 17.14 / Avg: 135.55 / Max: 164.93 Min: 16.37 / Avg: 115.77 / Max: 139.52 Min: 30.07 / Avg: 245.28 / Max: 317.66 Min: 29.28 / Avg: 296.68 / Max: 399.75 Min: 21.63 / Avg: 203.84 / Max: 298.7 Min: 43.73 / Avg: 175.78 / Max: 254.24 Min: 43.53 / Avg: 201.04 / Max: 326.57 Min: 72.56 / Avg: 306.79 / Max: 356.97 Min: 86.22 / Avg: 325.29 / Max: 362.03 Min: 51.16 / Avg: 250.18 / Max: 288.75 Min: 53.92 / Avg: 317.1 / Max: 376.78 Min: 33.89 / Avg: 307.46 / Max: 338.87
Llamafile Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU OpenBenchmarking.org Tokens Per Second Per Watt, More Is Better Llamafile 0.7 Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 0.0099 0.0198 0.0297 0.0396 0.0495 0.004 0.038 0.044 0.034 0.029 0.037 0.031 0.028 0.005 0.005 0.018 0.018 0.013
Llamafile CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Llamafile 0.7 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.64 / Avg: 161.56 / Max: 217.37 Min: 17.78 / Avg: 104.22 / Max: 157.47 Min: 14.6 / Avg: 92.71 / Max: 131.37 Min: 28.61 / Avg: 186.7 / Max: 318.2 Min: 32.28 / Avg: 231.13 / Max: 402.04 Min: 20.15 / Avg: 163.65 / Max: 315.47 Min: 43.72 / Avg: 139.67 / Max: 256.22 Min: 43.49 / Avg: 172.82 / Max: 332.78 Min: 72.53 / Avg: 283.07 / Max: 370.83 Min: 72.54 / Avg: 288.22 / Max: 376.39 Min: 51.28 / Avg: 215.58 / Max: 284.94 Min: 56.03 / Avg: 262.55 / Max: 376.09 Min: 34.18 / Avg: 244.07 / Max: 354.9
Llamafile Test: llava-v1.5-7b-q4 - Acceleration: CPU OpenBenchmarking.org Tokens Per Second Per Watt, More Is Better Llamafile 0.7 Test: llava-v1.5-7b-q4 - Acceleration: CPU Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 0.0502 0.1004 0.1506 0.2008 0.251 0.006 0.202 0.223 0.138 0.110 0.126 0.061 0.056 0.027 0.028 0.089 0.080 0.068
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.39 / Avg: 224.63 / Max: 249.42 Min: 17.94 / Avg: 165.08 / Max: 177.71 Min: 16.48 / Avg: 135.3 / Max: 146.77 Min: 30.45 / Avg: 333.47 / Max: 360.29 Min: 31.71 / Avg: 382.65 / Max: 411.13 Min: 23.52 / Avg: 323.53 / Max: 352.29 Min: 43.65 / Avg: 235.17 / Max: 270.9 Min: 43.62 / Avg: 308.92 / Max: 356.46 Min: 75.49 / Avg: 331.88 / Max: 373.56 Min: 87.21 / Avg: 332.74 / Max: 375.71 Min: 49.49 / Avg: 255.74 / Max: 292.14 Min: 59.81 / Avg: 328.72 / Max: 377.28 Min: 24.83 / Avg: 318.97 / Max: 381.52
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.11 / Avg: 87.36 / Max: 98.41 Min: 18.55 / Avg: 159.63 / Max: 174.23 Min: 17.99 / Avg: 135.1 / Max: 150.13 Min: 29.13 / Avg: 323.9 / Max: 362.47 Min: 31.03 / Avg: 374.75 / Max: 410.94 Min: 20.94 / Avg: 299.63 / Max: 344.93 Min: 43.66 / Avg: 230.17 / Max: 253.31 Min: 43.55 / Avg: 296.98 / Max: 325.95 Min: 70.61 / Avg: 331.05 / Max: 366.72 Min: 74.79 / Avg: 330.98 / Max: 373.36 Min: 50.83 / Avg: 254.14 / Max: 284.65 Min: 59.14 / Avg: 321.95 / Max: 371.05 Min: 34.43 / Avg: 325.81 / Max: 362.26
PyTorch CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better PyTorch 2.2.1 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 60 120 180 240 300 Min: 23.05 / Avg: 197.12 / Max: 221.88 Min: 18.44 / Avg: 110.66 / Max: 125.07 Min: 17.13 / Avg: 99.8 / Max: 111.33 Min: 30.14 / Avg: 194.55 / Max: 219.58 Min: 35.86 / Avg: 232.68 / Max: 261.18 Min: 21.06 / Avg: 157.61 / Max: 175.55 Min: 43.57 / Avg: 138.61 / Max: 153.19 Min: 43.48 / Avg: 159.18 / Max: 178.15 Min: 74.44 / Avg: 265.6 / Max: 309.82 Min: 70.81 / Avg: 276.02 / Max: 323.04 Min: 56.55 / Avg: 207.89 / Max: 238.03 Min: 59.74 / Avg: 250.75 / Max: 298.2 Min: 34.92 / Avg: 245.26 / Max: 293.93
PyTorch Device: CPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org batches/sec Per Watt, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 0.0747 0.1494 0.2241 0.2988 0.3735 0.121 0.305 0.332 0.178 0.149 0.175 0.194 0.194 0.192 0.188 0.236 0.225 0.258
PyTorch CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better PyTorch 2.2.1 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 60 120 180 240 300 Min: 23.05 / Avg: 197.5 / Max: 220.26 Min: 19.91 / Avg: 110.56 / Max: 125.45 Min: 17.28 / Avg: 99.64 / Max: 110.85 Min: 30.18 / Avg: 194.95 / Max: 219.41 Min: 32.73 / Avg: 232.73 / Max: 262.5 Min: 21.47 / Avg: 157.48 / Max: 175.9 Min: 43.68 / Avg: 138.47 / Max: 152.75 Min: 43.38 / Avg: 159.18 / Max: 178.76 Min: 75.38 / Avg: 268.45 / Max: 310.8 Min: 89.32 / Avg: 273.3 / Max: 321.11 Min: 55.01 / Avg: 207.81 / Max: 238.76 Min: 61.04 / Avg: 251.84 / Max: 296.62 Min: 18.63 / Avg: 215.65 / Max: 294.3
PyTorch Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org batches/sec Per Watt, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 0.0752 0.1504 0.2256 0.3008 0.376 0.123 0.305 0.334 0.179 0.150 0.176 0.194 0.194 0.197 0.189 0.235 0.218 0.293
PyTorch CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better PyTorch 2.2.1 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 60 120 180 240 300 Min: 23.65 / Avg: 196.43 / Max: 220.94 Min: 19.48 / Avg: 108.57 / Max: 123.57 Min: 15.03 / Avg: 98.23 / Max: 110.34 Min: 28.44 / Avg: 195.3 / Max: 220.5 Min: 35.79 / Avg: 231.06 / Max: 261.25 Min: 21.23 / Avg: 158.01 / Max: 176.03 Min: 43.6 / Avg: 138.69 / Max: 152.97 Min: 43.46 / Avg: 159.15 / Max: 179.26 Min: 73.38 / Avg: 266.73 / Max: 308.34 Min: 76.06 / Avg: 275.89 / Max: 319.9 Min: 53.3 / Avg: 207.69 / Max: 238.28 Min: 60.41 / Avg: 250.31 / Max: 298.35 Min: 35.31 / Avg: 244 / Max: 293.19
PyTorch Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org batches/sec Per Watt, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 0.0761 0.1522 0.2283 0.3044 0.3805 0.125 0.308 0.338 0.179 0.150 0.175 0.194 0.193 0.193 0.186 0.236 0.223 0.258
srsRAN Project CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better srsRAN Project 23.10.1-20240325 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.59 / Avg: 161.97 / Max: 211.95 Min: 17.85 / Avg: 136.58 / Max: 166.81 Min: 16.71 / Avg: 117.93 / Max: 142.26 Min: 28.12 / Avg: 276.24 / Max: 341.73 Min: 32.26 / Avg: 321.41 / Max: 408.75 Min: 21.57 / Avg: 261.04 / Max: 306.84 Min: 43.55 / Avg: 205.11 / Max: 263.97 Min: 43.52 / Avg: 245.99 / Max: 312.37 Min: 74.5 / Avg: 281.29 / Max: 379.76 Min: 74.87 / Avg: 289.12 / Max: 373.87 Min: 51.25 / Avg: 229.96 / Max: 288.72 Min: 60.24 / Avg: 283.1 / Max: 369.61 Min: 25.9 / Avg: 266.9 / Max: 379.06
srsRAN Project Test: PDSCH Processor Benchmark, Throughput Total OpenBenchmarking.org Mbps Per Watt, More Is Better srsRAN Project 23.10.1-20240325 Test: PDSCH Processor Benchmark, Throughput Total Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 40 80 120 160 200 84.68 141.87 165.23 100.26 91.42 96.52 133.01 121.16 75.68 52.16 58.87 87.21 98.83
Liquid-DSP CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Liquid-DSP 1.6 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.87 / Avg: 183.47 / Max: 221.38 Min: 17.86 / Avg: 136.88 / Max: 157.55 Min: 17.93 / Avg: 113.55 / Max: 130.59 Min: 29.69 / Avg: 280.68 / Max: 320.8 Min: 35.59 / Avg: 357.96 / Max: 411.45 Min: 20.69 / Avg: 272.02 / Max: 314.58 Min: 43.63 / Avg: 213.46 / Max: 250.49 Min: 43.73 / Avg: 280.76 / Max: 332.63 Min: 74.44 / Avg: 314.43 / Max: 376.72 Min: 77.34 / Avg: 316.72 / Max: 376.86 Min: 53.55 / Avg: 240.39 / Max: 291.06 Min: 60.01 / Avg: 312.4 / Max: 376.93 Min: 25.3 / Avg: 309.72 / Max: 376.79
Liquid-DSP Threads: 256 - Buffer Length: 256 - Filter Length: 512 OpenBenchmarking.org samples/s Per Watt, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 512 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 1.4M 2.8M 4.2M 5.6M 7M 2000457.64 5998206.24 6532499.05 4853033.94 4387111.54 6413920.52 3974344.33 3349035.56 2666847.49 2982249.17 2257184.32 3267678.46 3805850.46
Liquid-DSP CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Liquid-DSP 1.6 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.42 / Avg: 198.42 / Max: 233.67 Min: 17.88 / Avg: 146.02 / Max: 166.38 Min: 18.06 / Avg: 119.1 / Max: 135.86 Min: 30.72 / Avg: 301.36 / Max: 345.8 Min: 35.02 / Avg: 362.54 / Max: 411.45 Min: 22.44 / Avg: 285.46 / Max: 328.97 Min: 43.61 / Avg: 224.29 / Max: 267.77 Min: 43.65 / Avg: 295.72 / Max: 355.96 Min: 75.93 / Avg: 318.17 / Max: 376.27 Min: 75.49 / Avg: 317.3 / Max: 376.02 Min: 52.71 / Avg: 243.97 / Max: 290.99 Min: 58.98 / Avg: 315.8 / Max: 377.13 Min: 24.86 / Avg: 310.3 / Max: 377.83
Liquid-DSP Threads: 256 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s Per Watt, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 57 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 5M 10M 15M 20M 25M 14308369.45 21345877.02 23457026.73 17475938.77 16030850.56 22424548.82 18991058.67 15942975.31 8954185.90 10156047.28 6601048.41 11085612.93 12268330.08
Liquid-DSP CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Liquid-DSP 1.6 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.51 / Avg: 184.17 / Max: 220.45 Min: 18.57 / Avg: 138.03 / Max: 156.97 Min: 16.09 / Avg: 114.97 / Max: 130.99 Min: 26.08 / Avg: 265.16 / Max: 303.52 Min: 32.21 / Avg: 362.28 / Max: 409.42 Min: 21.47 / Avg: 264.25 / Max: 302.73 Min: 43.64 / Avg: 195.9 / Max: 223.9 Min: 43.62 / Avg: 255.44 / Max: 293.66 Min: 77.21 / Avg: 316.42 / Max: 377.29 Min: 75.73 / Avg: 315.02 / Max: 376.2 Min: 52.09 / Avg: 243.73 / Max: 291.23 Min: 60 / Avg: 313.56 / Max: 376 Min: 27.09 / Avg: 308.24 / Max: 376.57
Liquid-DSP Threads: 128 - Buffer Length: 256 - Filter Length: 512 OpenBenchmarking.org samples/s Per Watt, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 512 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 1.4M 2.8M 4.2M 5.6M 7M 1983409.23 5867538.62 6364836.35 4367851.07 3778092.65 5183635.11 3673478.12 3117578.50 2528910.04 2800439.16 2212405.84 2929507.99 3740373.11
Liquid-DSP CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Liquid-DSP 1.6 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.87 / Avg: 177.22 / Max: 229.74 Min: 17.85 / Avg: 144.65 / Max: 162.72 Min: 17.47 / Avg: 118.2 / Max: 136.58 Min: 29.04 / Avg: 289.1 / Max: 326.36 Min: 35.08 / Avg: 363.41 / Max: 409.45 Min: 21.64 / Avg: 282.21 / Max: 320.93 Min: 43.75 / Avg: 208.54 / Max: 241.22 Min: 43.58 / Avg: 270.81 / Max: 310.28 Min: 75.83 / Avg: 316.47 / Max: 376.18 Min: 79.18 / Avg: 319.2 / Max: 376.38 Min: 51.05 / Avg: 244.28 / Max: 290.35 Min: 32.16 / Avg: 315.31 / Max: 376.7 Min: 24.5 / Avg: 310.75 / Max: 376.14
Liquid-DSP Threads: 128 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s Per Watt, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 57 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 5M 10M 15M 20M 25M 15940557.00 20620501.38 22733164.52 14722432.57 13085490.53 16705633.01 17916149.91 15275772.40 8437038.99 9312055.82 6364402.84 10089438.81 11273487.11
GraphicsMagick CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better GraphicsMagick 1.3.43 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 60 120 180 240 300 Min: 23.46 / Avg: 136.08 / Max: 163.63 Min: 18.4 / Avg: 127.55 / Max: 140 Min: 16.93 / Avg: 110.88 / Max: 122.16 Min: 26.64 / Avg: 247.53 / Max: 267.87 Min: 33.82 / Avg: 320.71 / Max: 343.53 Min: 20.16 / Avg: 226.47 / Max: 243.63 Min: 43.58 / Avg: 194.07 / Max: 209.22 Min: 43.55 / Avg: 246.9 / Max: 265.73 Min: 73.74 / Avg: 330.74 / Max: 355.56 Min: 75.94 / Avg: 329.68 / Max: 362.6 Min: 52.22 / Avg: 254.21 / Max: 282.55 Min: 61.03 / Avg: 329.43 / Max: 359.83 Min: 28.79 / Avg: 327.64 / Max: 359.97
GraphicsMagick Operation: Enhanced OpenBenchmarking.org Iterations Per Minute Per Watt, More Is Better GraphicsMagick 1.3.43 Operation: Enhanced Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 0.4399 0.8798 1.3197 1.7596 2.1995 1.955 1.348 1.470 1.067 0.935 1.342 1.391 1.211 0.484 0.549 0.484 0.656 0.696
libavif avifenc CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better libavif avifenc 1.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 60 120 180 240 300 Min: 22.09 / Avg: 39.67 / Max: 52.08 Min: 15.89 / Avg: 45.79 / Max: 103.55 Min: 15.19 / Avg: 43.89 / Max: 93.61 Min: 27.35 / Avg: 79.69 / Max: 177.97 Min: 31.1 / Avg: 89.96 / Max: 203.77 Min: 20.59 / Avg: 64.93 / Max: 140.09 Min: 43.59 / Avg: 50.67 / Max: 89.41 Min: 43.45 / Avg: 52.35 / Max: 100.96 Min: 73.28 / Avg: 159.39 / Max: 303.29 Min: 72.94 / Avg: 159.29 / Max: 307.76 Min: 49.47 / Avg: 100.66 / Max: 234.57 Min: 58.72 / Avg: 130.94 / Max: 271.24 Min: 26.86 / Avg: 95.6 / Max: 261.18
libavif avifenc CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better libavif avifenc 1.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.66 / Avg: 50.74 / Max: 74.51 Min: 15.99 / Avg: 55.18 / Max: 149.59 Min: 15.05 / Avg: 53.07 / Max: 124.5 Min: 27.48 / Avg: 100.34 / Max: 306.84 Min: 29.45 / Avg: 115.08 / Max: 342.75 Min: 20.4 / Avg: 80.51 / Max: 234.12 Min: 43.56 / Avg: 59.76 / Max: 149.48 Min: 43.39 / Avg: 64.09 / Max: 183.29 Min: 74.59 / Avg: 193.8 / Max: 362.37 Min: 69.76 / Avg: 191.83 / Max: 376.91 Min: 48.9 / Avg: 132.08 / Max: 290.31 Min: 61.6 / Avg: 158.79 / Max: 375.47 Min: 26.64 / Avg: 128.43 / Max: 374.81
libavif avifenc CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better libavif avifenc 1.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 21.98 / Avg: 49.78 / Max: 68.22 Min: 15.86 / Avg: 54.43 / Max: 150.92 Min: 15.57 / Avg: 49.3 / Max: 126.89 Min: 26.55 / Avg: 92.59 / Max: 299.06 Min: 29.87 / Avg: 106.31 / Max: 349.7 Min: 18.49 / Avg: 76.34 / Max: 238.8 Min: 43.55 / Avg: 64.88 / Max: 147.13 Min: 43.39 / Avg: 69.56 / Max: 179.96 Min: 73.48 / Avg: 180.42 / Max: 357.76 Min: 71.59 / Avg: 183.17 / Max: 376.96 Min: 49.52 / Avg: 131.52 / Max: 290.38 Min: 59.37 / Avg: 149.47 / Max: 376.13 Min: 27.77 / Avg: 125.51 / Max: 374.47
libavif avifenc CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better libavif avifenc 1.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 21.96 / Avg: 47.12 / Max: 124.16 Min: 16.88 / Avg: 75.22 / Max: 155.11 Min: 14.11 / Avg: 69.45 / Max: 130.44 Min: 28.7 / Avg: 137.31 / Max: 316.42 Min: 32.31 / Avg: 157.68 / Max: 383.9 Min: 20.27 / Avg: 107.23 / Max: 247.8 Min: 43.58 / Avg: 59.56 / Max: 150.24 Min: 43.42 / Avg: 65.19 / Max: 183.13 Min: 71.37 / Avg: 235.53 / Max: 369.9 Min: 80.19 / Avg: 235.72 / Max: 375.98 Min: 50.37 / Avg: 150.68 / Max: 290.84 Min: 58.97 / Avg: 196.29 / Max: 374.92 Min: 34.19 / Avg: 161.32 / Max: 375.73
libavif avifenc CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better libavif avifenc 1.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 21.77 / Avg: 52.05 / Max: 123.81 Min: 17.01 / Avg: 85.23 / Max: 156.74 Min: 16.02 / Avg: 77.61 / Max: 131.52 Min: 29.48 / Avg: 156.52 / Max: 318.36 Min: 30.24 / Avg: 180.87 / Max: 389.03 Min: 19.55 / Avg: 121.7 / Max: 248.44 Min: 43.56 / Avg: 65.01 / Max: 148.96 Min: 43.39 / Avg: 72.37 / Max: 182.54 Min: 75.95 / Avg: 254.61 / Max: 372.81 Min: 69.59 / Avg: 253.47 / Max: 376.81 Min: 49.17 / Avg: 165.96 / Max: 290.88 Min: 61.27 / Avg: 218.41 / Max: 375.95 Min: 34.78 / Avg: 197.77 / Max: 373.2
x265 CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better x265 3.6 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 60 120 180 240 300 Min: 21.74 / Avg: 69.84 / Max: 83.64 Min: 17.3 / Avg: 88.38 / Max: 113.06 Min: 15.46 / Avg: 81.58 / Max: 101.27 Min: 28.94 / Avg: 145.28 / Max: 189.25 Min: 32.43 / Avg: 164.71 / Max: 212.57 Min: 20.91 / Avg: 112.7 / Max: 141.97 Min: 43.65 / Avg: 80.41 / Max: 103.35 Min: 43.45 / Avg: 88.07 / Max: 115.63 Min: 75.63 / Avg: 256.33 / Max: 294.6 Min: 72.13 / Avg: 261.62 / Max: 312.67 Min: 52.94 / Avg: 203.52 / Max: 247.27 Min: 59.53 / Avg: 234.38 / Max: 293.23 Min: 34.21 / Avg: 219.3 / Max: 292.58
x265 Video Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second Per Watt, More Is Better x265 3.6 Video Input: Bosphorus 4K Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 0.0765 0.153 0.2295 0.306 0.3825 0.250 0.318 0.340 0.218 0.195 0.250 0.251 0.242 0.113 0.120 0.146 0.161 0.178
7-Zip Compression CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better 7-Zip Compression 22.01 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.13 / Avg: 136.44 / Max: 185.42 Min: 19.72 / Avg: 132.92 / Max: 171.37 Min: 18.26 / Avg: 119.61 / Max: 153.19 Min: 27.34 / Avg: 263.93 / Max: 352.58 Min: 33.61 / Avg: 313.89 / Max: 411.35 Min: 22.44 / Avg: 248.63 / Max: 349.11 Min: 43.69 / Avg: 185.89 / Max: 235.27 Min: 43.58 / Avg: 225.95 / Max: 302.95 Min: 70.41 / Avg: 313.16 / Max: 376.07 Min: 74.78 / Avg: 314.81 / Max: 375.55 Min: 52.56 / Avg: 242.94 / Max: 291.38 Min: 60.14 / Avg: 308.09 / Max: 375.76 Min: 34.7 / Avg: 301.96 / Max: 375.99
7-Zip Compression Test: Decompression Rating OpenBenchmarking.org MIPS Per Watt, More Is Better 7-Zip Compression 22.01 Test: Decompression Rating Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 800 1600 2400 3200 4000 3953.03 2768.54 2828.90 2434.84 2281.23 3140.68 2265.09 2052.50 663.36 773.01 775.27 934.34 1119.86
QuantLib CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better QuantLib 1.32 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.19 / Avg: 194.65 / Max: 253.21 Min: 17.59 / Avg: 157.98 / Max: 175.08 Min: 16.19 / Avg: 127.97 / Max: 140.32 Min: 28.93 / Avg: 316.09 / Max: 352.6 Min: 33.64 / Avg: 369.92 / Max: 411.04 Min: 21.13 / Avg: 311.83 / Max: 350.73 Min: 43.59 / Avg: 210.04 / Max: 270.15 Min: 43.42 / Avg: 273.26 / Max: 357.57 Min: 72.72 / Avg: 321.14 / Max: 375.61 Min: 83.08 / Avg: 328.34 / Max: 376.88 Min: 49.64 / Avg: 253.81 / Max: 290.36 Min: 58.59 / Avg: 325.01 / Max: 377.73 Min: 31.57 / Avg: 322.97 / Max: 378.63
QuantLib Configuration: Multi-Threaded OpenBenchmarking.org MFLOPS Per Watt, More Is Better QuantLib 1.32 Configuration: Multi-Threaded Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 300 600 900 1200 1500 1293.70 1092.36 1202.80 930.70 864.58 1200.71 1113.28 960.37 447.64 495.61 358.69 552.74 605.78
CloverLeaf CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better CloverLeaf 1.3 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.28 / Avg: 159.57 / Max: 178.94 Min: 18.26 / Avg: 143.82 / Max: 147.88 Min: 18.03 / Avg: 132.66 / Max: 136.36 Min: 28.5 / Avg: 250.17 / Max: 287.09 Min: 34.9 / Avg: 301.76 / Max: 361.01 Min: 19.15 / Avg: 200.7 / Max: 237.69 Min: 43.58 / Avg: 186.46 / Max: 191.98 Min: 43.52 / Avg: 205.96 / Max: 212.24 Min: 71.71 / Avg: 345.92 / Max: 368.64 Min: 75.8 / Avg: 346.15 / Max: 373.49 Min: 48.92 / Avg: 267.62 / Max: 276.86 Min: 57.58 / Avg: 346.05 / Max: 371.34 Min: 33.19 / Avg: 289.13 / Max: 310.83
CloverLeaf CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better CloverLeaf 1.3 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.22 / Avg: 155.97 / Max: 178.63 Min: 19.22 / Avg: 132.55 / Max: 146.42 Min: 17.1 / Avg: 122.03 / Max: 133.14 Min: 25.91 / Avg: 223.18 / Max: 288.87 Min: 33.05 / Avg: 264.63 / Max: 353.22 Min: 19.77 / Avg: 183.89 / Max: 245.13 Min: 43.65 / Avg: 168.7 / Max: 186.26 Min: 43.45 / Avg: 184.14 / Max: 204.33 Min: 76.4 / Avg: 324.2 / Max: 367.03 Min: 74.72 / Avg: 323.64 / Max: 372.82 Min: 53.35 / Avg: 254.93 / Max: 281.37 Min: 57.26 / Avg: 320.54 / Max: 366.56 Min: 32.08 / Avg: 299.62 / Max: 336.85
miniFE CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better miniFE 2.2 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.45 / Avg: 100.67 / Max: 175.45 Min: 19.07 / Avg: 96.36 / Max: 147.72 Min: 15.16 / Avg: 86.83 / Max: 132.07 Min: 28.79 / Avg: 152.24 / Max: 300.13 Min: 33.7 / Avg: 177.88 / Max: 364.34 Min: 21.36 / Avg: 127.63 / Max: 261.53 Min: 43.59 / Avg: 108.34 / Max: 211.25 Min: 43.53 / Avg: 119.29 / Max: 232.16 Min: 75.77 / Avg: 253.53 / Max: 365.64 Min: 73.91 / Avg: 260.35 / Max: 366.7 Min: 53.33 / Avg: 190.48 / Max: 282.32 Min: 61.92 / Avg: 224.98 / Max: 377.92 Min: 31.62 / Avg: 198.71 / Max: 331.13
miniFE Problem Size: Small OpenBenchmarking.org CG Mflops Per Watt, More Is Better miniFE 2.2 Problem Size: Small Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 90 180 270 360 450 238.55 254.52 282.72 334.41 298.90 392.87 373.28 340.56 79.24 71.52 120.52 156.59 160.18
m-queens CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better m-queens 1.2 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.95 / Avg: 117.71 / Max: 177.59 Min: 19.39 / Avg: 122.5 / Max: 158.25 Min: 15.51 / Avg: 106.99 / Max: 136.77 Min: 28.35 / Avg: 221.83 / Max: 330.6 Min: 31.01 / Avg: 267.9 / Max: 411.07 Min: 20.79 / Avg: 202.95 / Max: 326.11 Min: 43.69 / Avg: 180.19 / Max: 242.1 Min: 43.54 / Avg: 226.9 / Max: 315.05 Min: 75.51 / Avg: 241.11 / Max: 276.68 Min: 77.06 / Avg: 260.39 / Max: 302.34 Min: 54.03 / Avg: 238.8 / Max: 290.84 Min: 62.12 / Avg: 266.4 / Max: 324.62 Min: 32.66 / Avg: 278.57 / Max: 374.34
ACES DGEMM CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ACES DGEMM 1.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.24 / Avg: 140.74 / Max: 194.16 Min: 17.88 / Avg: 109.94 / Max: 158.28 Min: 16.53 / Avg: 95.47 / Max: 135.35 Min: 28.2 / Avg: 182.5 / Max: 306.04 Min: 31.49 / Avg: 230.52 / Max: 409.55 Min: 22.22 / Avg: 178.2 / Max: 342.37 Min: 43.57 / Avg: 148.35 / Max: 183.52 Min: 43.36 / Avg: 170.6 / Max: 222.09 Min: 75.8 / Avg: 276.9 / Max: 361.7 Min: 73.75 / Avg: 277.15 / Max: 377.23 Min: 52.19 / Avg: 226.98 / Max: 281.28 Min: 53.98 / Avg: 252.19 / Max: 377.52 Min: 23.09 / Avg: 239.87 / Max: 363.28
ACES DGEMM Sustained Floating-Point Rate OpenBenchmarking.org GFLOP/s Per Watt, More Is Better ACES DGEMM 1.0 Sustained Floating-Point Rate Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 0.0567 0.1134 0.1701 0.2268 0.2835 0.127 0.198 0.220 0.214 0.196 0.252 0.107 0.105 0.071 0.081 0.059 0.093 0.121
Coremark CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Coremark 1.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.98 / Avg: 104.34 / Max: 164.47 Min: 16.44 / Avg: 144.77 / Max: 164.64 Min: 14.91 / Avg: 122.91 / Max: 138.78 Min: 26.88 / Avg: 296.23 / Max: 351.89 Min: 32.2 / Avg: 341.96 / Max: 411.86 Min: 21.14 / Avg: 269.93 / Max: 353.42 Min: 43.57 / Avg: 158.45 / Max: 217.13 Min: 21.83 / Avg: 213.94 / Max: 282.7 Min: 76.41 / Avg: 261.99 / Max: 288.93 Min: 77.43 / Avg: 282.3 / Max: 314.07 Min: 50.82 / Avg: 242.89 / Max: 290.97 Min: 54.25 / Avg: 293.49 / Max: 341.26 Min: 34.34 / Avg: 313.68 / Max: 378.24
Coremark CoreMark Size 666 - Iterations Per Second OpenBenchmarking.org Iterations/Sec Per Watt, More Is Better Coremark 1.0 CoreMark Size 666 - Iterations Per Second Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 6K 12K 18K 24K 30K 27062.21 15712.09 16836.69 13254.14 12144.31 16764.47 18400.49 15612.90 6163.40 6571.62 5016.56 7477.77 7555.56
Speedb CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Speedb 2.7 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.12 / Avg: 152.33 / Max: 178.15 Min: 17.32 / Avg: 150.95 / Max: 163.43 Min: 17.9 / Avg: 122.29 / Max: 139.21 Min: 26.3 / Avg: 283.98 / Max: 305.25 Min: 32.81 / Avg: 343.59 / Max: 411.18 Min: 22.4 / Avg: 244.15 / Max: 314.31 Min: 43.64 / Avg: 169.23 / Max: 238.92 Min: 43.55 / Avg: 198.15 / Max: 300.83 Min: 78.68 / Avg: 331.78 / Max: 377.28 Min: 74.62 / Avg: 333.11 / Max: 375.39 Min: 52.53 / Avg: 256.25 / Max: 291.99 Min: 52.35 / Avg: 330.55 / Max: 376.19 Min: 34.03 / Avg: 325.5 / Max: 377.13
Speedb Test: Read While Writing OpenBenchmarking.org Op/s Per Watt, More Is Better Speedb 2.7 Test: Read While Writing Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 20K 40K 60K 80K 100K 68649.72 79851.05 97163.65 63472.87 57032.77 93506.84 103697.42 90565.21 26509.91 29984.58 27890.69 32356.04 37383.41
Speedb CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Speedb 2.7 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.98 / Avg: 198.59 / Max: 217.68 Min: 18.42 / Avg: 150.73 / Max: 161.26 Min: 18.13 / Avg: 120.08 / Max: 129.07 Min: 29.2 / Avg: 274.09 / Max: 293.61 Min: 33.89 / Avg: 382.79 / Max: 411.07 Min: 22.11 / Avg: 296.2 / Max: 318.84 Min: 43.69 / Avg: 235.82 / Max: 270.43 Min: 43.47 / Avg: 311.77 / Max: 356.67 Min: 71.79 / Avg: 310.76 / Max: 333.42 Min: 70.78 / Avg: 327.7 / Max: 377.13 Min: 54.55 / Avg: 255.89 / Max: 290.77 Min: 54.25 / Avg: 330.77 / Max: 378.66 Min: 27.16 / Avg: 327.52 / Max: 377.21
Speedb Test: Random Read OpenBenchmarking.org Op/s Per Watt, More Is Better Speedb 2.7 Test: Random Read Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 500K 1000K 1500K 2000K 2500K 2278519.61 1818446.43 2023204.53 1563545.14 1404496.49 1991742.68 2531402.05 2159153.28 680456.82 744809.12 509439.26 834970.47 962315.70
RocksDB CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better RocksDB 9.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.94 / Avg: 178.89 / Max: 204.7 Min: 17.34 / Avg: 155.39 / Max: 168.8 Min: 17.36 / Avg: 134 / Max: 149.2 Min: 24.6 / Avg: 300.55 / Max: 337.2 Min: 34.3 / Avg: 383.63 / Max: 411.02 Min: 22 / Avg: 301.4 / Max: 339.84 Min: 43.66 / Avg: 179.48 / Max: 270.38 Min: 43.57 / Avg: 208.52 / Max: 356.32 Min: 72.31 / Avg: 332.58 / Max: 376.04 Min: 74.89 / Avg: 331.82 / Max: 375.82 Min: 55.14 / Avg: 255.9 / Max: 290.56 Min: 52.65 / Avg: 330.54 / Max: 376.66 Min: 33.11 / Avg: 323.9 / Max: 378.14
RocksDB Test: Read While Writing OpenBenchmarking.org Op/s Per Watt, More Is Better RocksDB 9.0 Test: Read While Writing Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 14K 28K 42K 56K 70K 52800.80 60067.21 66672.70 48605.69 36906.83 52342.46 63183.03 56900.62 22369.26 22200.62 21648.99 23723.76 27560.28
RocksDB CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better RocksDB 9.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.05 / Avg: 190.62 / Max: 206.24 Min: 19.07 / Avg: 149.48 / Max: 159.86 Min: 18.15 / Avg: 119.15 / Max: 127.37 Min: 24.72 / Avg: 268.72 / Max: 291.05 Min: 33.04 / Avg: 384.04 / Max: 411.06 Min: 21.45 / Avg: 292.89 / Max: 315.65 Min: 43.66 / Avg: 235.93 / Max: 270.68 Min: 43.52 / Avg: 311.76 / Max: 357.69 Min: 73.12 / Avg: 309.28 / Max: 327.48 Min: 77.85 / Avg: 332.82 / Max: 365.47 Min: 53.91 / Avg: 255.83 / Max: 291.63 Min: 54.21 / Avg: 330.58 / Max: 378.42 Min: 25.38 / Avg: 328.84 / Max: 377.98
RocksDB Test: Random Read OpenBenchmarking.org Op/s Per Watt, More Is Better RocksDB 9.0 Test: Random Read Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 500K 1000K 1500K 2000K 2500K 2094589.03 1780768.80 1972313.57 1523041.95 1362651.04 1957165.94 2436056.02 2069916.27 663946.02 704496.50 490897.23 802721.25 904750.01
PostgreSQL CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better PostgreSQL 16 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.16 / Avg: 151.18 / Max: 181.47 Min: 18.63 / Avg: 138.72 / Max: 161.44 Min: 15.23 / Avg: 121.21 / Max: 140.08 Min: 27.65 / Avg: 271.07 / Max: 317.83 Min: 33.83 / Avg: 355.49 / Max: 410.22 Min: 21.35 / Avg: 253.4 / Max: 320.46 Min: 43.55 / Avg: 127.3 / Max: 157.98 Min: 43.45 / Avg: 153.46 / Max: 193.17 Min: 71.87 / Avg: 311.81 / Max: 377.7 Min: 78.53 / Avg: 316.32 / Max: 367.54 Min: 54.25 / Avg: 239.92 / Max: 291.32 Min: 56.77 / Avg: 302.76 / Max: 366.57 Min: 31.51 / Avg: 271.55 / Max: 343.13
PostgreSQL CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better PostgreSQL 16 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 60 120 180 240 300 Min: 23.02 / Avg: 123.24 / Max: 157.33 Min: 16.91 / Avg: 135.16 / Max: 158.27 Min: 15.4 / Avg: 110.68 / Max: 134.33 Min: 19.41 / Avg: 254.31 / Max: 305.58 Min: 32.63 / Avg: 299.03 / Max: 361.05 Min: 21.27 / Avg: 207.74 / Max: 251.71 Min: 43.52 / Avg: 150.61 / Max: 191.14 Min: 43.39 / Avg: 172.92 / Max: 212.03 Min: 69.55 / Avg: 311.42 / Max: 350.84 Min: 86.13 / Avg: 315.59 / Max: 351.55 Min: 54.49 / Avg: 239.87 / Max: 290.09 Min: 54.62 / Avg: 299.36 / Max: 354.29 Min: 31.89 / Avg: 275.46 / Max: 347.94
ClickHouse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ClickHouse 22.12.3.5 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 21.77 / Avg: 67.67 / Max: 170.47 Min: 18.06 / Avg: 82.96 / Max: 166.09 Min: 15.83 / Avg: 76.83 / Max: 137.9 Min: 28.3 / Avg: 138.04 / Max: 305.03 Min: 29.83 / Avg: 160.48 / Max: 343.21 Min: 20.77 / Avg: 109.76 / Max: 265.96 Min: 43.57 / Avg: 77.27 / Max: 231.46 Min: 43.42 / Avg: 84.55 / Max: 263.64 Min: 70.28 / Avg: 238.9 / Max: 367.38 Min: 77.89 / Avg: 241.61 / Max: 372.85 Min: 52.36 / Avg: 174.43 / Max: 288.3 Min: 52.84 / Avg: 205.71 / Max: 375.59 Min: 26.54 / Avg: 176.29 / Max: 377.99
ClickHouse 100M Rows Hits Dataset, Third Run OpenBenchmarking.org Queries Per Minute, Geo Mean Per Watt, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 1.1063 2.2126 3.3189 4.4252 5.5315 3.662 4.085 4.366 4.053 3.709 4.182 4.917 4.737 1.967 1.974 1.966 2.341 2.599
John The Ripper Test: bcrypt OpenBenchmarking.org Real C/S Per Watt, More Is Better John The Ripper 2023.03.14 Test: bcrypt Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 200 400 600 800 1000 693.95 749.17 920.41 606.47 531.63 759.60 885.93 746.76 256.35 273.70 233.71 305.82 342.68
John The Ripper CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better John The Ripper 2023.03.14 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6766E 2P Full Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 90 180 270 360 450 Min: 23.1 / Avg: 155.77 / Max: 182.84 Min: 18.33 / Avg: 135.67 / Max: 154.48 Min: 15.84 / Avg: 101.56 / Max: 134.16 Min: 28.03 / Avg: 274.61 / Max: 310.69 Min: 32.66 / Avg: 362.61 / Max: 410.64 Min: 22.18 / Avg: 290.55 / Max: 334.66 Min: 43.56 / Avg: 214.8 / Max: 240.98 Min: 107.82 / Avg: 445 / Max: 497.2 Min: 43.52 / Avg: 282.96 / Max: 321.53 Min: 71.89 / Avg: 264.78 / Max: 291.9 Min: 71.44 / Avg: 288.1 / Max: 318.09 Min: 52.63 / Avg: 243.63 / Max: 290.65 Min: 54.97 / Avg: 308.91 / Max: 345.11 Min: 23.7 / Avg: 308.68 / Max: 376.19
John The Ripper Test: Blowfish OpenBenchmarking.org Real C/S Per Watt, More Is Better John The Ripper 2023.03.14 Test: Blowfish Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 200 400 600 800 1000 696.76 753.26 805.43 605.49 531.08 757.83 885.52 747.26 257.14 274.74 233.58 305.95 339.84
OpenSSL CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenSSL 3.3 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.95 / Avg: 183.53 / Max: 198.79 Min: 18.44 / Avg: 157.87 / Max: 169.7 Min: 15.55 / Avg: 133.8 / Max: 143.63 Min: 28.99 / Avg: 308.23 / Max: 338.17 Min: 34.64 / Avg: 400.14 / Max: 413.51 Min: 21.49 / Avg: 334.48 / Max: 349.67 Min: 43.65 / Avg: 244.72 / Max: 270.07 Min: 43.5 / Avg: 323.63 / Max: 356.46 Min: 71.29 / Avg: 299.98 / Max: 317.48 Min: 74.41 / Avg: 330.77 / Max: 354.3 Min: 53.35 / Avg: 264.79 / Max: 291.44 Min: 56.54 / Avg: 341.09 / Max: 377.07 Min: 23.35 / Avg: 341.79 / Max: 377.28
OpenSSL Algorithm: SHA512 OpenBenchmarking.org byte/s Per Watt, More Is Better OpenSSL 3.3 Algorithm: SHA512 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 40M 80M 120M 160M 200M 186801619.46 154425638.15 165874523.26 128564080.98 114623223.18 157697655.07 165922834.04 139323873.72 54000562.67 57121711.23 41470367.43 65144677.30 69884736.57
OpenSSL CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenSSL 3.3 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.41 / Avg: 181.78 / Max: 216.97 Min: 18.27 / Avg: 159 / Max: 170.75 Min: 17.53 / Avg: 132.64 / Max: 140.44 Min: 29.19 / Avg: 327.28 / Max: 361.5 Min: 34.63 / Avg: 400.88 / Max: 411.05 Min: 22.61 / Avg: 334.62 / Max: 353.13 Min: 43.63 / Avg: 212.71 / Max: 270.71 Min: 43.49 / Avg: 278.96 / Max: 357.32 Min: 75.75 / Avg: 282.15 / Max: 323.37 Min: 82.11 / Avg: 309.57 / Max: 363.52 Min: 52.69 / Avg: 264.5 / Max: 291.33 Min: 57.24 / Avg: 326.01 / Max: 380.05 Min: 32.34 / Avg: 341.03 / Max: 377.49
OpenSSL Algorithm: SHA256 OpenBenchmarking.org byte/s Per Watt, More Is Better OpenSSL 3.3 Algorithm: SHA256 Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 130M 260M 390M 520M 650M 545938643.43 469088919.27 511227929.81 386445411.79 345260515.93 481947170.76 611047359.48 516781889.88 157500377.52 167457577.18 105324899.05 189585676.93 195213927.96
Timed LLVM Compilation CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Timed LLVM Compilation 16.0 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.71 / Avg: 122.91 / Max: 185.98 Min: 16.99 / Avg: 134 / Max: 170.95 Min: 15.37 / Avg: 117.14 / Max: 147.36 Min: 28.01 / Avg: 241.32 / Max: 332.83 Min: 33.31 / Avg: 289.22 / Max: 411.83 Min: 21.92 / Avg: 221.05 / Max: 334.41 Min: 43.51 / Avg: 148.04 / Max: 239.55 Min: 43.38 / Avg: 172.6 / Max: 293.27 Min: 74.97 / Avg: 314.74 / Max: 377.51 Min: 83.29 / Avg: 311.03 / Max: 377.86 Min: 51.36 / Avg: 243.86 / Max: 291.49 Min: 58.01 / Avg: 298.24 / Max: 377.21 Min: 33.37 / Avg: 291.41 / Max: 377.45
Timed Node.js Compilation CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Timed Node.js Compilation 21.7.2 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 23.63 / Avg: 129.27 / Max: 187.24 Min: 18.11 / Avg: 134.67 / Max: 172.23 Min: 16.32 / Avg: 118.09 / Max: 147.17 Min: 29.13 / Avg: 242.47 / Max: 351.76 Min: 30.95 / Avg: 289.15 / Max: 411.31 Min: 21.84 / Avg: 210.13 / Max: 338.39 Min: 43.59 / Avg: 148.97 / Max: 246.66 Min: 43.35 / Avg: 170.44 / Max: 300.92 Min: 74.34 / Avg: 318.88 / Max: 376.31 Min: 84.71 / Avg: 317.34 / Max: 376.11 Min: 50.7 / Avg: 248.06 / Max: 290.96 Min: 56.59 / Avg: 305.63 / Max: 376.82 Min: 33.43 / Avg: 295.74 / Max: 377.74
Timed Linux Kernel Compilation CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Timed Linux Kernel Compilation 6.8 CPU Power Consumption Monitor Ampere Altra Max M128-30 EPYC 8534P EPYC 8534PN EPYC 9654 EPYC 9684X EPYC 9754 Xeon 6766E Xeon 6780E Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8380 Xeon Platinum 8490H Xeon Platinum 8592+ 70 140 210 280 350 Min: 22.21 / Avg: 170.41 / Max: 199.77 Min: 16.91 / Avg: 150.79 / Max: 171.19 Min: 16.08 / Avg: 129.6 / Max: 144.82 Min: 27.23 / Avg: 282.28 / Max: 331.17 Min: 34.02 / Avg: 348.42 / Max: 413.49 Min: 19.75 / Avg: 262.8 / Max: 335.9 Min: 43.57 / Avg: 201.59 / Max: 252.67 Min: 43.47 / Avg: 255.14 / Max: 329.17 Min: 70.17 / Avg: 330.93 / Max: 375.87 Min: 81.1 / Avg: 330.36 / Max: 377.46 Min: 50.2 / Avg: 256.23 / Max: 291.69 Min: 56.91 / Avg: 323.36 / Max: 378.1 Min: 25.82 / Avg: 317.64 / Max: 378.37
Phoronix Test Suite v10.8.4