2 x Intel Xeon 6780E testing with a Quanta Cloud QuantaGrid D55Q-2U S7Q-MB-MPS-MDP (2A05.QCT001 BIOS) and ASPEED on Ubuntu 24.04 via the Phoronix Test Suite.
Xeon Platinum 8592+ 2P Processor: 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Xeon Platinum 8592+ Changed Processor to INTEL XEON PLATINUM 8592+ @ 3.90GHz (64 Cores / 128 Threads) .
Changed Memory to 512GB .
Xeon Platinum 8490H Changed Processor to Intel Xeon Platinum 8490H @ 3.50GHz (60 Cores / 120 Threads) .
Processor Change: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590
Xeon Platinum 8490H 2P Changed Processor to 2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads) .
Changed Memory to 1008GB .
Xeon Max 9468 Changed Processor to Intel Xeon Max 9468 @ 3.50GHz (48 Cores / 96 Threads) .
Changed Memory to 576GB .
Processor Change: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290
Xeon Max 9468 2P Changed Processor to 2 x Intel Xeon Max 9468 @ 3.50GHz (96 Cores / 192 Threads) .
Changed Memory to 1136GB .
Xeon Max 9480 Changed Processor to Intel Xeon Max 9480 @ 3.50GHz (56 Cores / 112 Threads) .
Changed Memory to 576GB .
Xeon Max 9480 2P Changed Processor to 2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads) .
Changed Memory to 1136GB .
Xeon Platinum 8380 2P Processor: 2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads)Motherboard: Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS)Chipset: Intel Ice Lake IEHMemory: 512GBDisk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Monitor: VE228Network: 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd0003d1Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Mitigation of Microcode + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Xeon Platinum 8380 Changed Processor to Intel Xeon Platinum 8380 @ 3.40GHz (40 Cores / 80 Threads) .
Changed Memory to 256GB .
EPYC 9684X 2P Processor: 2 x AMD EPYC 9684X 96-Core @ 2.55GHz (192 Cores / 384 Threads)Motherboard: AMD Titanite_4G (RTI1007B BIOS)Chipset: AMD Device 14a4Memory: 1520GBDisk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
EPYC 9684X Changed Processor to AMD EPYC 9684X 96-Core @ 2.55GHz (96 Cores / 192 Threads) .
Changed Memory to 12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEG .
EPYC 9654 Changed Processor to AMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads) .
EPYC 9654 2P Changed Processor to 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads) .
Changed Memory to 1520GB .
EPYC 9754 Changed Processor to AMD EPYC 9754 128-Core @ 2.25GHz (128 Cores / 256 Threads) .
Changed Memory to 12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEG .
Processor Change: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00116
EPYC 9754 2P Changed Processor to 2 x AMD EPYC 9754 128-Core @ 2.25GHz (256 Cores / 512 Threads) .
Changed Memory to 1520GB .
EPYC 8534P Processor: AMD EPYC 8534P 64-Core @ 2.30GHz (64 Cores / 128 Threads)Motherboard: AMD Cinnabar (RCB1009C BIOS)Chipset: AMD Device 14a4, Memory: 6 x 32GB DDR5-4800MT/s Samsung M321R4GA0BB0-CQKMGDisk: 2 x 1920GB KIOXIA KCD8XPUG1T92 + 2000GB Corsair MP700 PROGraphics: ASPEED, Network: 2 x Broadcom NetXtreme BCM5720 PCIe
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00213Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
EPYC 8534PN Changed Processor to AMD EPYC 8534PN 64-Core @ 2.00GHz (64 Cores / 128 Threads) .
Changed Disk to 2 x 1920GB KIOXIA KCD8XPUG1T92 .
Xeon 6766E 2P Processor: 2 x Intel Xeon 6766E @ 2.70GHz (288 Cores)Motherboard: Quanta Cloud QuantaGrid D55Q-2U S7Q-MB-MPS-MDP (2A05.QCT001 BIOS)Chipset: Intel Ice Lake IEHMemory: 512GBDisk: 3201GB Micron_7450_MTFDKCB3T2TFS + 2 x 1920GB KIOXIA KCD8XPUG1T92Graphics: ASPEED, Network: 2 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Xeon 6766E Changed Processor to Intel Xeon 6766E @ 2.70GHz (144 Cores) .
Changed Memory to 256GB .
Changed Disk to 2 x 1920GB KIOXIA KCD8XPUG1T92 + 3201GB Micron_7450_MTFDKCB3T2TFS .
Xeon 6780E Changed Processor to Intel Xeon 6780E @ 3.00GHz (144 Cores) .
Changed Disk to 3201GB Micron_7450_MTFDKCB3T2TFS + 2 x 1920GB KIOXIA KCD8XPUG1T92 .
Xeon 6780E 2P Changed Processor to 2 x Intel Xeon 6780E @ 3.00GHz (288 Cores) .
Changed Memory to 512GB .
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 2K 4K 6K 8K 10K SE +/- 3.37, N = 3 SE +/- 4.97, N = 3 SE +/- 4.52, N = 3 SE +/- 8.98, N = 3 SE +/- 7.17, N = 3 SE +/- 4.05, N = 3 SE +/- 9.37, N = 3 SE +/- 3.66, N = 3 SE +/- 1.00, N = 3 SE +/- 0.24, N = 3 SE +/- 10.88, N = 3 SE +/- 18.02, N = 3 SE +/- 25.68, N = 3 SE +/- 6.56, N = 3 SE +/- 54.09, N = 3 SE +/- 4.91, N = 3 SE +/- 2.97, N = 3 SE +/- 3.87, N = 3 SE +/- 5.02, N = 3 SE +/- 2.55, N = 3 SE +/- 2.87, N = 3 SE +/- 3.86, N = 3 10934.17 5725.03 3606.12 7862.58 3802.61 7127.28 4093.73 7689.32 2030.97 1100.18 9752.89 5608.07 5024.32 9203.19 5594.81 10182.16 2830.12 2506.10 2743.39 1414.86 1525.26 2957.69 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenSSL OpenSSL is an open-source toolkit that implements SSL (Secure Sockets Layer) and TLS (Transport Layer Security) protocols. This test profile makes use of the built-in "openssl speed" benchmarking capabilities. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: SHA512 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 20000M 40000M 60000M 80000M 100000M SE +/- 14734422.48, N = 3 SE +/- 37654528.63, N = 3 SE +/- 203213936.42, N = 3 SE +/- 481040738.21, N = 3 SE +/- 500176.69, N = 3 SE +/- 3500318.33, N = 3 SE +/- 1250834.62, N = 3 SE +/- 14339684.98, N = 3 SE +/- 20492408.59, N = 3 SE +/- 6313493.56, N = 3 SE +/- 44023374.36, N = 3 SE +/- 55712209.05, N = 3 SE +/- 6285194.15, N = 3 SE +/- 37307640.51, N = 3 SE +/- 5822493.86, N = 3 SE +/- 17716195.81, N = 3 SE +/- 15082903.45, N = 3 SE +/- 9990938.84, N = 3 SE +/- 66704467.17, N = 3 SE +/- 14430784.68, N = 3 SE +/- 24045021.87, N = 3 SE +/- 64065176.93, N = 3 46520760707 23886054770 22219927723 42846254477 16199261277 32304222993 18893980783 37564522053 22079539900 10980940093 91455971200 45865131913 39627575497 78822257383 52746634113 104776633047 24378460820 22194470973 78599395230 40605137923 45088755640 89194416857 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl byte/s Per Watt
OpenBenchmarking.org byte/s Per Watt, More Is Better OpenSSL 3.3 Algorithm: SHA512 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 40M 80M 120M 160M 200M 67966151.09 69884736.57 65144677.30 62457308.50 54000562.67 51580447.52 57121711.23 55449110.37 42041804.18 41470367.43 114225793.10 114623223.18 128564080.98 125714359.16 157697655.07 154893248.59 154425638.15 165874523.26 159806130.44 165922834.04 139323873.72 137868745.00 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OpenSSL 3.3 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 66.13 / Avg: 684.47 / Max: 754.35 Min: 23.35 / Avg: 341.79 / Max: 377.28 Min: 56.54 / Avg: 341.09 / Max: 377.07 Min: 158.63 / Avg: 686.01 / Max: 753.85 Min: 71.29 / Avg: 299.98 / Max: 317.48 Min: 190.86 / Avg: 626.29 / Max: 729.82 Min: 74.41 / Avg: 330.77 / Max: 354.3 Min: 194.96 / Avg: 677.46 / Max: 722.73 Min: 105.66 / Avg: 525.18 / Max: 583.12 Min: 53.35 / Avg: 264.79 / Max: 291.44 Min: 66.79 / Avg: 800.66 / Max: 822.16 Min: 34.64 / Avg: 400.14 / Max: 413.51 Min: 28.99 / Avg: 308.23 / Max: 338.17 Min: 59.93 / Avg: 626.99 / Max: 687.56 Min: 21.49 / Avg: 334.48 / Max: 349.67 Min: 42.68 / Avg: 676.44 / Max: 705.8 Min: 18.44 / Avg: 157.87 / Max: 169.7 Min: 15.55 / Avg: 133.8 / Max: 143.63 Min: 106.79 / Avg: 491.84 / Max: 540.07 Min: 43.65 / Avg: 244.72 / Max: 270.07 Min: 43.5 / Avg: 323.63 / Max: 356.46 Min: 108.54 / Avg: 646.95 / Max: 712.56 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 126171 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 62890 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 62760 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 126226 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 55097 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 115028 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 60861 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 124201 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 96458 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 48721 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 145720 Joules per run. 12. EPYC 9684X: Approximate power consumption of 73225 Joules per run. 13. EPYC 9654: Approximate power consumption of 56509 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 114322 Joules per run. 15. EPYC 9754: Approximate power consumption of 61210 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 123113 Joules per run. 17. EPYC 8534P: Approximate power consumption of 28995 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 24620 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 90335 Joules per run. 20. Xeon 6766E: Approximate power consumption of 45029 Joules per run. 21. Xeon 6780E: Approximate power consumption of 59439 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 119039 Joules per run.
OpenBenchmarking.org sign/s, More Is Better OpenSSL 3.3 Algorithm: RSA4096 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 20K 40K 60K 80K 100K SE +/- 56.68, N = 3 SE +/- 15.15, N = 3 SE +/- 9.84, N = 3 SE +/- 14.34, N = 3 SE +/- 19.45, N = 3 SE +/- 6.92, N = 3 SE +/- 20.13, N = 3 SE +/- 83.09, N = 3 SE +/- 108.70, N = 3 SE +/- 40.37, N = 3 SE +/- 247.60, N = 3 SE +/- 98.71, N = 3 SE +/- 29.11, N = 3 SE +/- 81.38, N = 3 SE +/- 27.42, N = 3 SE +/- 80.37, N = 3 SE +/- 22.17, N = 3 SE +/- 12.56, N = 3 SE +/- 8.25, N = 3 SE +/- 1.37, N = 3 SE +/- 1.63, N = 3 SE +/- 8.20, N = 3 61499.6 31594.4 27431.1 54601.1 22861.0 45531.0 25441.5 48534.8 36371.6 18389.3 98237.0 48996.8 35964.9 71942.0 53966.9 107830.6 25894.6 21047.5 22587.4 11348.5 12610.8 25098.0 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
Llamafile Mozilla's Llamafile allows distributing and running large language models (LLMs) as a single file. Llamafile aims to make open-source LLMs more accessible to developers and users. Llamafile supports a variety of models, CPUs and GPUs, and other options. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.7 Test: llava-v1.5-7b-q4 - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 6 12 18 24 30 SE +/- 1.08, N = 12 SE +/- 0.17, N = 4 SE +/- 0.15, N = 4 SE +/- 0.09, N = 15 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.10, N = 15 SE +/- 0.11, N = 3 SE +/- 0.02, N = 4 SE +/- 0.10, N = 5 SE +/- 0.02, N = 5 SE +/- 0.07, N = 4 SE +/- 0.05, N = 4 SE +/- 0.08, N = 4 SE +/- 0.11, N = 4 SE +/- 0.07, N = 4 SE +/- 0.02, N = 3 SE +/- 0.08, N = 3 SE +/- 0.30, N = 15 SE +/- 0.04, N = 3 7.49 16.61 20.95 10.44 7.67 7.77 8.13 7.26 12.29 19.11 14.29 25.38 25.75 14.47 20.64 10.94 21.00 20.65 2.83 8.56 9.60 2.99 Tokens Per Second Per Watt
OpenBenchmarking.org Tokens Per Second Per Watt, More Is Better Llamafile 0.7 Test: llava-v1.5-7b-q4 - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0502 0.1004 0.1506 0.2008 0.251 0.015 0.068 0.080 0.019 0.027 0.014 0.028 0.013 0.030 0.089 0.031 0.110 0.138 0.037 0.126 0.032 0.202 0.223 0.007 0.061 0.056 0.007 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Llamafile 0.7 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 81.53 / Avg: 512.88 / Max: 707.9 Min: 34.18 / Avg: 244.07 / Max: 354.9 Min: 56.03 / Avg: 262.55 / Max: 376.09 Min: 152.91 / Avg: 537.58 / Max: 745.57 Min: 72.53 / Avg: 283.07 / Max: 370.83 Min: 205.99 / Avg: 559.87 / Max: 716.53 Min: 72.54 / Avg: 288.22 / Max: 376.39 Min: 191.45 / Avg: 566.01 / Max: 704.67 Min: 95.32 / Avg: 409.62 / Max: 565.75 Min: 51.28 / Avg: 215.58 / Max: 284.94 Min: 62.86 / Avg: 462.55 / Max: 790.45 Min: 32.28 / Avg: 231.13 / Max: 402.04 Min: 28.61 / Avg: 186.7 / Max: 318.2 Min: 57.8 / Avg: 388.15 / Max: 621.67 Min: 20.15 / Avg: 163.65 / Max: 315.47 Min: 40.53 / Avg: 343.52 / Max: 619.26 Min: 17.78 / Avg: 104.22 / Max: 157.47 Min: 14.6 / Avg: 92.71 / Max: 131.37 Min: 103.86 / Avg: 385.26 / Max: 509.52 Min: 43.72 / Avg: 139.67 / Max: 256.22 Min: 43.49 / Avg: 172.82 / Max: 332.78 Min: 106.56 / Avg: 429.62 / Max: 646.38 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 23592 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 5064 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 4792 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 13117 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 9341 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 17169 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 8551 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 18301 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 9612 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 4599 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 9482 Joules per run. 12. EPYC 9684X: Approximate power consumption of 3513 Joules per run. 13. EPYC 9654: Approximate power consumption of 2688 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 7375 Joules per run. 15. EPYC 9754: Approximate power consumption of 2618 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 7214 Joules per run. 17. EPYC 8534P: Approximate power consumption of 1876 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1808 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 38526 Joules per run. 20. Xeon 6766E: Approximate power consumption of 4143 Joules per run. 21. Xeon 6780E: Approximate power consumption of 4632 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 31792 Joules per run.
TensorFlow This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: GoogLeNet Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 12 24 36 48 60 SE +/- 0.12, N = 6 SE +/- 0.21, N = 6 SE +/- 0.19, N = 6 SE +/- 0.23, N = 15 SE +/- 0.27, N = 7 SE +/- 0.20, N = 15 SE +/- 0.27, N = 6 SE +/- 0.23, N = 12 SE +/- 0.34, N = 15 SE +/- 0.24, N = 7 SE +/- 0.17, N = 15 SE +/- 0.33, N = 15 SE +/- 0.41, N = 15 SE +/- 0.14, N = 15 SE +/- 0.27, N = 15 SE +/- 0.04, N = 3 SE +/- 0.30, N = 15 SE +/- 0.14, N = 6 SE +/- 0.05, N = 7 SE +/- 0.04, N = 4 SE +/- 0.09, N = 4 SE +/- 0.06, N = 9 12.69 21.67 33.56 13.50 36.13 18.24 31.47 14.67 29.18 53.38 12.83 34.20 32.80 12.42 21.00 8.10 36.66 36.48 5.88 12.40 13.14 6.72 images/sec Per Watt
OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: GoogLeNet Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.1458 0.2916 0.4374 0.5832 0.729 0.041 0.174 0.217 0.034 0.204 0.043 0.171 0.034 0.127 0.496 0.038 0.261 0.283 0.041 0.207 0.031 0.607 0.648 0.030 0.177 0.172 0.032 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.16.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 100 200 300 400 500 Min: 73.56 / Avg: 313.09 / Max: 440.43 Min: 26.58 / Avg: 124.36 / Max: 199.6 Min: 57.88 / Avg: 154.91 / Max: 259.01 Min: 148.89 / Avg: 402.29 / Max: 545.86 Min: 74.34 / Avg: 177.15 / Max: 279.76 Min: 186.6 / Avg: 423.67 / Max: 565.69 Min: 71.73 / Avg: 183.7 / Max: 287.38 Min: 191.38 / Avg: 433 / Max: 578.39 Min: 98.2 / Avg: 229.87 / Max: 381.04 Min: 50.23 / Avg: 107.65 / Max: 211.46 Min: 61.13 / Avg: 340.38 / Max: 500.24 Min: 30.18 / Avg: 131.02 / Max: 261.02 Min: 27.18 / Avg: 115.93 / Max: 228.86 Min: 57.14 / Avg: 306.45 / Max: 450.83 Min: 20.13 / Avg: 101.49 / Max: 176.75 Min: 39.52 / Avg: 262.36 / Max: 352.55 Min: 14.4 / Avg: 60.4 / Max: 120.48 Min: 15.28 / Avg: 56.3 / Max: 109.74 Min: 104.02 / Avg: 195.59 / Max: 247.83 Min: 43.55 / Avg: 69.97 / Max: 94.67 Min: 43.43 / Avg: 76.44 / Max: 108.57 Min: 105.84 / Avg: 207.14 / Max: 268.89 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 4957 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 1492 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 1627 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 6303 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 1822 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 5762 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 1959 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 6820 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 2651 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 1030 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 5446 Joules per run. 12. EPYC 9684X: Approximate power consumption of 1354 Joules per run. 13. EPYC 9654: Approximate power consumption of 1237 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 5026 Joules per run. 15. EPYC 9754: Approximate power consumption of 1353 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 5859 Joules per run. 17. EPYC 8534P: Approximate power consumption of 656 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 619 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 5588 Joules per run. 20. Xeon 6766E: Approximate power consumption of 1242 Joules per run. 21. Xeon 6780E: Approximate power consumption of 1280 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 5340 Joules per run.
Pennant Pennant is an application focused on hydrodynamics on general unstructured meshes in 2D. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Hydro Cycle Time - Seconds, Fewer Is Better Pennant 1.0.1 Test: sedovbig Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 6 12 18 24 30 SE +/- 0.018471, N = 4 SE +/- 0.002400, N = 3 SE +/- 0.002987, N = 3 SE +/- 0.016400, N = 4 SE +/- 0.001847, N = 3 SE +/- 0.003237, N = 4 SE +/- 0.013353, N = 3 SE +/- 0.003253, N = 4 SE +/- 0.052953, N = 3 SE +/- 0.034794, N = 3 SE +/- 0.041359, N = 15 SE +/- 0.080453, N = 15 SE +/- 0.052975, N = 7 SE +/- 0.040626, N = 15 SE +/- 0.074320, N = 15 SE +/- 0.037087, N = 15 SE +/- 0.024479, N = 4 SE +/- 0.029749, N = 4 9.964526 16.969100 16.030800 11.284380 21.021120 13.211250 19.882460 12.106900 15.247190 25.789450 3.081108 5.460660 5.916458 3.408337 5.147658 2.940456 11.369640 12.151320 1. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Pennant 1.0.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 140 280 420 560 700 Min: 69.95 / Avg: 489.66 / Max: 753.78 Min: 26.41 / Avg: 279.92 / Max: 376.36 Min: 57.56 / Avg: 287.94 / Max: 376.04 Min: 148.41 / Avg: 535.71 / Max: 753.56 Min: 72.63 / Avg: 303.18 / Max: 377.15 Min: 189.6 / Avg: 573.95 / Max: 754.13 Min: 78.91 / Avg: 298.37 / Max: 377.04 Min: 206.49 / Avg: 569.16 / Max: 751.77 Min: 101.05 / Avg: 438.87 / Max: 580.29 Min: 51.49 / Avg: 239.83 / Max: 289.95 Min: 64.82 / Avg: 404.01 / Max: 819.66 Min: 30.95 / Avg: 242.71 / Max: 409.53 Min: 26.98 / Avg: 200.64 / Max: 329.21 Min: 55.22 / Avg: 351.84 / Max: 674.58 Min: 20.25 / Avg: 182.99 / Max: 330.83 Min: 41.72 / Avg: 310.27 / Max: 663.85 Min: 19.05 / Avg: 123.57 / Max: 166.99 Min: 16.13 / Avg: 110.49 / Max: 145.79 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 9304 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 6345 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 6143 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 10312 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 7883 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 11479 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 7658 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 11241 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 9216 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 7275 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 4740 Joules per run. 12. EPYC 9684X: Approximate power consumption of 2589 Joules per run. 13. EPYC 9654: Approximate power consumption of 2264 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 4246 Joules per run. 15. EPYC 9754: Approximate power consumption of 2025 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 4819 Joules per run. 17. EPYC 8534P: Approximate power consumption of 2039 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1906 Joules per run.
OpenFOAM OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.
QuantLib QuantLib is an open-source library/framework around quantitative finance for modeling, trading and risk management scenarios. QuantLib is written in C++ with Boost and its built-in benchmark used reports the QuantLib Benchmark Index benchmark score. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org MFLOPS, More Is Better QuantLib 1.32 Configuration: Multi-Threaded Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 160K 320K 480K 640K 800K SE +/- 248.00, N = 3 SE +/- 63.14, N = 3 SE +/- 105.60, N = 3 SE +/- 362.38, N = 3 SE +/- 155.19, N = 3 SE +/- 286.86, N = 3 SE +/- 40.48, N = 3 SE +/- 160.59, N = 3 SE +/- 457.00, N = 3 SE +/- 395.04, N = 3 SE +/- 1065.76, N = 3 SE +/- 412.72, N = 3 SE +/- 86.78, N = 3 SE +/- 713.18, N = 3 SE +/- 156.35, N = 3 SE +/- 804.57, N = 3 SE +/- 82.80, N = 3 SE +/- 86.28, N = 3 SE +/- 1610.78, N = 3 SE +/- 306.14, N = 3 SE +/- 846.02, N = 3 SE +/- 1647.70, N = 3 380867.5 195648.8 179647.5 350187.5 143755.3 288129.1 162727.4 316359.2 182366.9 91036.5 644091.0 319827.2 294183.2 593246.9 374413.5 759922.1 172566.8 153920.8 456271.0 233836.3 262432.6 519392.2 1. (CXX) g++ options: -O3 -march=native -fPIE -pie MFLOPS Per Watt
OpenBenchmarking.org MFLOPS Per Watt, More Is Better QuantLib 1.32 Configuration: Multi-Threaded Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 300 600 900 1200 1500 585.75 605.78 552.74 537.18 447.64 436.19 495.61 477.83 359.31 358.69 881.58 864.58 930.70 921.01 1200.71 1200.40 1092.36 1202.80 1089.21 1113.28 960.37 956.27 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better QuantLib 1.32 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 77.95 / Avg: 650.23 / Max: 756.48 Min: 31.57 / Avg: 322.97 / Max: 378.63 Min: 58.59 / Avg: 325.01 / Max: 377.73 Min: 167.37 / Avg: 651.9 / Max: 756.65 Min: 72.72 / Avg: 321.14 / Max: 375.61 Min: 205.33 / Avg: 660.57 / Max: 754.82 Min: 83.08 / Avg: 328.34 / Max: 376.88 Min: 203.63 / Avg: 662.07 / Max: 755.13 Min: 100.73 / Avg: 507.54 / Max: 581.6 Min: 49.64 / Avg: 253.81 / Max: 290.36 Min: 65.34 / Avg: 730.61 / Max: 822.15 Min: 33.64 / Avg: 369.92 / Max: 411.04 Min: 28.93 / Avg: 316.09 / Max: 352.6 Min: 55.66 / Avg: 644.13 / Max: 715.22 Min: 21.13 / Avg: 311.83 / Max: 350.73 Min: 40.73 / Avg: 633.06 / Max: 715.84 Min: 17.59 / Avg: 157.98 / Max: 175.08 Min: 16.19 / Avg: 127.97 / Max: 140.32 Min: 103.76 / Avg: 418.9 / Max: 541.48 Min: 43.59 / Avg: 210.04 / Max: 270.15 Min: 43.42 / Avg: 273.26 / Max: 357.57 Min: 104.62 / Avg: 543.14 / Max: 713.12 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 42698 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 20670 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21126 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 44329 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 21088 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 43377 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 22108 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 45904 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 45510 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 22673 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 48464 Joules per run. 12. EPYC 9684X: Approximate power consumption of 23798 Joules per run. 13. EPYC 9654: Approximate power consumption of 21915 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 44874 Joules per run. 15. EPYC 9754: Approximate power consumption of 22867 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 47268 Joules per run. 17. EPYC 8534P: Approximate power consumption of 12322 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 11091 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 26530 Joules per run. 20. Xeon 6766E: Approximate power consumption of 12673 Joules per run. 21. Xeon 6780E: Approximate power consumption of 14756 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 30054 Joules per run.
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 40 80 120 160 200 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.45, N = 15 SE +/- 0.46, N = 3 SE +/- 0.07, N = 3 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.08, N = 3 SE +/- 0.09, N = 3 SE +/- 0.02, N = 3 SE +/- 0.13, N = 3 SE +/- 0.34, N = 3 SE +/- 0.10, N = 3 SE +/- 0.33, N = 3 22.96 21.87 36.20 25.12 23.12 24.00 24.94 25.72 60.90 62.64 33.18 32.00 34.92 36.90 38.85 39.86 41.38 45.71 180.29 172.72 153.76 157.28 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 79.4 / Avg: 653.57 / Max: 770.7 Min: 24.83 / Avg: 318.97 / Max: 381.52 Min: 59.81 / Avg: 328.72 / Max: 377.28 Min: 175.49 / Avg: 660.59 / Max: 741.22 Min: 75.49 / Avg: 331.88 / Max: 373.56 Min: 208.68 / Avg: 665.43 / Max: 751.81 Min: 87.21 / Avg: 332.74 / Max: 375.71 Min: 200.26 / Avg: 664.69 / Max: 755.11 Min: 102.66 / Avg: 511.4 / Max: 581.89 Min: 49.49 / Avg: 255.74 / Max: 292.14 Min: 67.9 / Avg: 760.8 / Max: 819.21 Min: 31.71 / Avg: 382.65 / Max: 411.13 Min: 30.45 / Avg: 333.47 / Max: 360.29 Min: 59.67 / Avg: 652.58 / Max: 705.65 Min: 23.52 / Avg: 323.53 / Max: 352.29 Min: 42.75 / Avg: 632.45 / Max: 690.87 Min: 17.94 / Avg: 165.08 / Max: 177.71 Min: 16.48 / Avg: 135.3 / Max: 146.77 Min: 106.76 / Avg: 462.61 / Max: 540.57 Min: 43.65 / Avg: 235.17 / Max: 270.9 Min: 43.62 / Avg: 308.92 / Max: 356.46 Min: 108.82 / Avg: 608.93 / Max: 712.7 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 42918 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 20733 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21367 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 43379 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 21351 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 43253 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 21517 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 43205 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 33071 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16538 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 49452 Joules per run. 12. EPYC 9684X: Approximate power consumption of 24744 Joules per run. 13. EPYC 9654: Approximate power consumption of 21453 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 42418 Joules per run. 15. EPYC 9754: Approximate power consumption of 20921 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 41531 Joules per run. 17. EPYC 8534P: Approximate power consumption of 10730 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 8795 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 30841 Joules per run. 20. Xeon 6766E: Approximate power consumption of 15364 Joules per run. 21. Xeon 6780E: Approximate power consumption of 20183 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 40799 Joules per run.
John The Ripper This is a benchmark of John The Ripper, which is a password cracker. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: WPA PSK Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 300K 600K 900K 1200K 1500K SE +/- 15579.94, N = 15 SE +/- 864.17, N = 3 SE +/- 1599.31, N = 3 SE +/- 2519.00, N = 3 SE +/- 987.33, N = 3 SE +/- 5122.51, N = 3 SE +/- 1274.00, N = 3 SE +/- 788.50, N = 3 SE +/- 1491.72, N = 3 SE +/- 177.03, N = 3 SE +/- 5291.50, N = 3 SE +/- 2683.36, N = 3 SE +/- 921.74, N = 3 SE +/- 1333.33, N = 3 SE +/- 478.70, N = 3 SE +/- 4358.90, N = 3 SE +/- 321.00, N = 3 SE +/- 79.20, N = 3 SE +/- 187.67, N = 3 SE +/- 30.00, N = 3 SE +/- 66.16, N = 3 SE +/- 394.40, N = 3 797093 428116 401278 793253 286552 562875 334076 657889 491583 248066 1294000 671322 643475 1253333 803187 1551000 386212 339998 367657 188925 209803 407256 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2 Real C/S Per Watt
OpenBenchmarking.org Real C/S Per Watt, More Is Better John The Ripper 2023.03.14 Test: WPA PSK Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 600 1200 1800 2400 3000 1285.88 1374.72 1347.41 1261.48 1133.97 1057.22 1204.61 1100.83 1004.94 1017.12 1799.50 1853.75 2017.72 1941.48 2304.83 2253.10 2414.27 2563.93 881.55 953.29 815.37 784.52 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better John The Ripper 2023.03.14 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 64.41 / Avg: 619.88 / Max: 753.08 Min: 23.24 / Avg: 311.42 / Max: 376.46 Min: 56.65 / Avg: 297.81 / Max: 364.7 Min: 165.05 / Avg: 628.83 / Max: 743.61 Min: 66.96 / Avg: 252.7 / Max: 281.63 Min: 186.18 / Avg: 532.41 / Max: 591.91 Min: 76.35 / Avg: 277.33 / Max: 310.37 Min: 193.96 / Avg: 597.63 / Max: 753.44 Min: 99.22 / Avg: 489.17 / Max: 579.96 Min: 53.04 / Avg: 243.89 / Max: 290.93 Min: 67.44 / Avg: 719.09 / Max: 821.15 Min: 33.28 / Avg: 362.14 / Max: 411.02 Min: 29.6 / Avg: 318.91 / Max: 365.41 Min: 59 / Avg: 645.56 / Max: 737.44 Min: 22.59 / Avg: 348.48 / Max: 397.44 Min: 43.51 / Avg: 688.39 / Max: 796.51 Min: 18.24 / Avg: 159.97 / Max: 182.75 Min: 17.08 / Avg: 132.61 / Max: 150.07 Min: 108.35 / Avg: 417.06 / Max: 466.57 Min: 43.68 / Avg: 198.18 / Max: 221.69 Min: 43.57 / Avg: 257.31 / Max: 292.39 Min: 109.89 / Avg: 519.11 / Max: 586.15 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 21448 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 10692 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 10324 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 22009 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 8676 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 18457 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 9522 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 20718 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 16795 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 8374 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 24928 Joules per run. 12. EPYC 9684X: Approximate power consumption of 12313 Joules per run. 13. EPYC 9654: Approximate power consumption of 10843 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 22164 Joules per run. 15. EPYC 9754: Approximate power consumption of 11964 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 23864 Joules per run. 17. EPYC 8534P: Approximate power consumption of 5492 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 4553 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 14458 Joules per run. 20. Xeon 6766E: Approximate power consumption of 6738 Joules per run. 21. Xeon 6780E: Approximate power consumption of 8920 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 17996 Joules per run.
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 200 400 600 800 1000 SE +/- 0.85, N = 3 SE +/- 0.54, N = 3 SE +/- 0.17, N = 3 SE +/- 3.48, N = 3 SE +/- 1.21, N = 3 SE +/- 1.99, N = 3 SE +/- 4.09, N = 3 SE +/- 1.13, N = 3 SE +/- 0.17, N = 3 SE +/- 0.45, N = 3 SE +/- 0.37, N = 3 SE +/- 4.29, N = 11 SE +/- 4.59, N = 7 SE +/- 8.96, N = 3 SE +/- 6.34, N = 5 SE +/- 11.78, N = 3 SE +/- 0.39, N = 3 SE +/- 0.13, N = 3 SE +/- 2.30, N = 15 SE +/- 0.25, N = 3 SE +/- 0.03, N = 3 SE +/- 3.00, N = 3 1128.78 592.20 477.77 793.64 415.96 795.63 467.08 889.18 281.36 156.13 1110.49 576.98 525.88 990.16 621.42 1127.05 317.38 293.07 243.76 138.53 149.63 264.66 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
miniBUDE MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 70 140 210 280 350 SE +/- 1.93, N = 15 SE +/- 0.03, N = 3 SE +/- 0.31, N = 3 SE +/- 0.99, N = 3 SE +/- 0.31, N = 3 SE +/- 1.48, N = 3 SE +/- 0.96, N = 4 SE +/- 0.93, N = 3 SE +/- 0.75, N = 3 SE +/- 0.11, N = 3 SE +/- 2.28, N = 3 SE +/- 1.71, N = 3 SE +/- 0.93, N = 3 SE +/- 0.08, N = 3 SE +/- 0.01, N = 3 SE +/- 3.85, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.08, N = 3 191.82 108.12 86.97 140.83 70.21 127.85 78.11 133.99 97.08 49.20 309.22 187.68 171.77 291.28 232.75 288.54 107.72 97.98 78.24 39.35 43.73 86.88 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm Billion Interactions/s Per Watt
OpenBenchmarking.org Billion Interactions/s Per Watt, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.1906 0.3812 0.5718 0.7624 0.953 0.319 0.334 0.275 0.244 0.245 0.211 0.248 0.215 0.196 0.191 0.532 0.551 0.605 0.588 0.847 0.669 0.746 0.789 0.216 0.225 0.196 0.195 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better miniBUDE 20210901 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 63.99 / Avg: 600.52 / Max: 754.84 Min: 23.61 / Avg: 323.61 / Max: 376.85 Min: 62.05 / Avg: 316.19 / Max: 372.81 Min: 173.4 / Avg: 578.13 / Max: 755.42 Min: 72.43 / Avg: 286.83 / Max: 306.63 Min: 193.86 / Avg: 605.49 / Max: 719.24 Min: 75.23 / Avg: 314.81 / Max: 352.37 Min: 203.67 / Avg: 621.91 / Max: 746.15 Min: 104.71 / Avg: 494.9 / Max: 576.68 Min: 52.78 / Avg: 257.94 / Max: 287.95 Min: 68.45 / Avg: 581.3 / Max: 795.09 Min: 33.63 / Avg: 340.93 / Max: 409.44 Min: 28.02 / Avg: 283.82 / Max: 328.33 Min: 59.15 / Avg: 495.6 / Max: 654.49 Min: 20.19 / Avg: 274.94 / Max: 327 Min: 42.31 / Avg: 431.39 / Max: 620.63 Min: 18.74 / Avg: 144.45 / Max: 156.43 Min: 16.52 / Avg: 124.23 / Max: 135.64 Min: 105.16 / Avg: 361.96 / Max: 383.12 Min: 43.66 / Avg: 174.56 / Max: 194.55 Min: 43.56 / Avg: 223.09 / Max: 250.29 Min: 107.71 / Avg: 444.54 / Max: 472.65 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 18576 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 16828 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 20131 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 24282 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 22181 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 27045 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 22036 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 26535 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 28209 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 27944 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 12401 Joules per run. 12. EPYC 9684X: Approximate power consumption of 10796 Joules per run. 13. EPYC 9654: Approximate power consumption of 9650 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 11068 Joules per run. 15. EPYC 9754: Approximate power consumption of 7148 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 9634 Joules per run. 17. EPYC 8534P: Approximate power consumption of 7512 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 6998 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 25217 Joules per run. 20. Xeon 6766E: Approximate power consumption of 23507 Joules per run. 21. Xeon 6780E: Approximate power consumption of 27068 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 28154 Joules per run.
OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 1700 3400 5100 6800 8500 SE +/- 48.20, N = 15 SE +/- 0.70, N = 3 SE +/- 7.77, N = 3 SE +/- 24.63, N = 3 SE +/- 7.81, N = 3 SE +/- 36.96, N = 3 SE +/- 23.93, N = 4 SE +/- 23.14, N = 3 SE +/- 18.66, N = 3 SE +/- 2.69, N = 3 SE +/- 57.10, N = 3 SE +/- 42.85, N = 3 SE +/- 23.15, N = 3 SE +/- 2.03, N = 3 SE +/- 0.20, N = 3 SE +/- 96.25, N = 3 SE +/- 0.13, N = 3 SE +/- 0.10, N = 3 SE +/- 0.82, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 SE +/- 1.96, N = 3 4795.46 2703.09 2174.19 3520.71 1755.33 3196.12 1952.61 3349.76 2426.88 1230.08 7730.47 4692.11 4294.28 7281.96 5818.74 7213.43 2692.87 2449.45 1955.88 983.71 1093.21 2172.10 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
ASTC Encoder ASTC Encoder (astcenc) is for the Adaptive Scalable Texture Compression (ASTC) format commonly used with OpenGL, OpenGL ES, and Vulkan graphics APIs. This test profile does a coding test of both compression/decompression. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org MT/s, More Is Better ASTC Encoder 4.7 Preset: Thorough Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 30 60 90 120 150 SE +/- 0.55, N = 5 SE +/- 0.05, N = 4 SE +/- 0.01, N = 4 SE +/- 0.19, N = 5 SE +/- 0.01, N = 3 SE +/- 0.05, N = 4 SE +/- 0.03, N = 4 SE +/- 0.03, N = 5 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 1.46, N = 12 SE +/- 0.06, N = 5 SE +/- 0.01, N = 4 SE +/- 0.73, N = 15 SE +/- 0.01, N = 5 SE +/- 1.20, N = 5 SE +/- 0.02, N = 4 SE +/- 0.02, N = 3 SE +/- 0.42, N = 4 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.85, N = 4 97.94 54.45 51.30 86.98 37.01 72.33 42.98 83.34 30.03 15.50 116.12 73.38 65.30 105.41 86.01 121.30 41.02 37.96 71.02 40.69 45.21 79.29 1. (CXX) g++ options: -O3 -flto -pthread MT/s Per Watt
OpenBenchmarking.org MT/s Per Watt, More Is Better ASTC Encoder 4.7 Preset: Thorough Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.1136 0.2272 0.3408 0.4544 0.568 0.262 0.244 0.214 0.203 0.139 0.153 0.164 0.179 0.074 0.068 0.316 0.330 0.338 0.319 0.505 0.456 0.359 0.384 0.310 0.290 0.259 0.299 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ASTC Encoder 4.7 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 76.68 / Avg: 373.98 / Max: 732.13 Min: 34.05 / Avg: 223.18 / Max: 369.47 Min: 60.85 / Avg: 239.45 / Max: 374.18 Min: 147.85 / Avg: 428.35 / Max: 731.41 Min: 72.98 / Avg: 265.38 / Max: 375.06 Min: 204.94 / Avg: 472.75 / Max: 744.21 Min: 78.02 / Avg: 261.71 / Max: 374.53 Min: 195.71 / Avg: 466.49 / Max: 741.06 Min: 99.18 / Avg: 403.9 / Max: 572.69 Min: 49.99 / Avg: 228.75 / Max: 289.57 Min: 63.05 / Avg: 367.67 / Max: 734.43 Min: 33.53 / Avg: 222.24 / Max: 407.18 Min: 28.71 / Avg: 193.35 / Max: 335.29 Min: 55.87 / Avg: 330.17 / Max: 623.66 Min: 20.4 / Avg: 170.2 / Max: 353.81 Min: 38.72 / Avg: 265.99 / Max: 577.68 Min: 15.96 / Avg: 114.12 / Max: 173.87 Min: 15.09 / Avg: 98.95 / Max: 145.65 Min: 103.99 / Avg: 228.94 / Max: 433.24 Min: 43.64 / Avg: 140.53 / Max: 230.96 Min: 43.44 / Avg: 174.24 / Max: 297.52 Min: 106.82 / Avg: 264.73 / Max: 530.48 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 5161 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 3961 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 4430 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 6425 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 5838 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 7446 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 5300 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 6904 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 10501 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 9226 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 5025 Joules per run. 12. EPYC 9684X: Approximate power consumption of 3245 Joules per run. 13. EPYC 9654: Approximate power consumption of 3045 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 4600 Joules per run. 15. EPYC 9754: Approximate power consumption of 2485 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 3830 Joules per run. 17. EPYC 8534P: Approximate power consumption of 2368 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 2177 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 4293 Joules per run. 20. Xeon 6766E: Approximate power consumption of 3185 Joules per run. 21. Xeon 6780E: Approximate power consumption of 3601 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 4567 Joules per run.
RELION RELION - REgularised LIkelihood OptimisatioN - is a stand-alone computer program for Maximum A Posteriori refinement of (multiple) 3D reconstructions or 2D class averages in cryo-electron microscopy (cryo-EM). It is developed in the research group of Sjors Scheres at the MRC Laboratory of Molecular Biology. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better RELION 4.0.1 Test: Basic - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 150 300 450 600 750 SE +/- 1.41, N = 3 SE +/- 2.68, N = 7 SE +/- 7.14, N = 9 SE +/- 2.65, N = 3 SE +/- 2.98, N = 3 SE +/- 3.24, N = 12 SE +/- 4.65, N = 9 SE +/- 2.66, N = 12 SE +/- 0.35, N = 3 SE +/- 7.86, N = 9 SE +/- 1.27, N = 15 SE +/- 2.17, N = 3 SE +/- 2.95, N = 3 SE +/- 2.11, N = 12 SE +/- 7.69, N = 9 SE +/- 4.04, N = 12 SE +/- 4.63, N = 3 SE +/- 6.20, N = 3 155.74 290.45 373.18 203.41 412.37 214.42 384.38 201.38 368.22 705.58 93.17 176.42 238.88 145.65 360.21 201.27 468.69 496.24 1. (CXX) g++ options: -fopenmp -std=c++11 -O3 -rdynamic -ldl -ltiff -lfftw3f -lfftw3 -lpng -ljpeg -lmpi_cxx -lmpi CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better RELION 4.0.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 140 280 420 560 700 Min: 77.4 / Avg: 665.17 / Max: 755.23 Min: 22.57 / Avg: 341.82 / Max: 377.61 Min: 50.74 / Avg: 344.24 / Max: 377.4 Min: 170.14 / Avg: 679.44 / Max: 754.54 Min: 73.55 / Avg: 345.11 / Max: 376.88 Min: 199.08 / Avg: 683.82 / Max: 754.9 Min: 73.36 / Avg: 344.98 / Max: 377.25 Min: 195.56 / Avg: 682.36 / Max: 754.93 Min: 103.02 / Avg: 531.46 / Max: 582.55 Min: 53.81 / Avg: 267.6 / Max: 290.36 Min: 63.79 / Avg: 752.52 / Max: 819.67 Min: 32.42 / Avg: 394.87 / Max: 409.71 Min: 28.15 / Avg: 320.59 / Max: 347.29 Min: 52.45 / Avg: 622.74 / Max: 703.72 Min: 21.86 / Avg: 270.75 / Max: 336.67 Min: 42.44 / Avg: 553.69 / Max: 696.76 Min: 18.83 / Avg: 163.61 / Max: 166.72 Min: 17.41 / Avg: 148.71 / Max: 151.06 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 106428 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 100496 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 129663 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 141097 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 143452 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 148959 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 133775 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 139714 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 197525 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 189610 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 72192 Joules per run. 12. EPYC 9684X: Approximate power consumption of 70814 Joules per run. 13. EPYC 9654: Approximate power consumption of 77584 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 92269 Joules per run. 15. EPYC 9754: Approximate power consumption of 98100 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 112537 Joules per run. 17. EPYC 8534P: Approximate power consumption of 77059 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 74158 Joules per run.
OpenSSL OpenSSL is an open-source toolkit that implements SSL (Secure Sockets Layer) and TLS (Transport Layer Security) protocols. This test profile makes use of the built-in "openssl speed" benchmarking capabilities. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: ChaCha20-Poly1305 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 200000M 400000M 600000M 800000M 1000000M SE +/- 82161991.11, N = 3 SE +/- 120899798.30, N = 3 SE +/- 766713911.50, N = 3 SE +/- 132227134.30, N = 3 SE +/- 6370607.14, N = 3 SE +/- 4148679.28, N = 3 SE +/- 37795783.50, N = 3 SE +/- 36941390.18, N = 3 SE +/- 31274617.76, N = 3 SE +/- 255765711.98, N = 3 SE +/- 558033954.71, N = 3 SE +/- 4478378.70, N = 3 SE +/- 29295317.86, N = 3 SE +/- 6119305.11, N = 3 SE +/- 151303743.70, N = 3 SE +/- 19082587.00, N = 3 SE +/- 24234601.89, N = 3 SE +/- 65233629.47, N = 3 SE +/- 37182497.08, N = 3 SE +/- 2360978.39, N = 3 SE +/- 18243420.30, N = 3 SE +/- 38565703.74, N = 3 444099144270 223625738013 225038850730 442202532977 161321058213 320396720447 187796174440 372735215297 293502122413 146156212950 767652719547 383925652077 350960998357 698925822223 457039748870 906028608990 211185661727 193305093643 240005135153 120591787257 134033039090 266583857887 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl byte/s Per Watt
OpenBenchmarking.org byte/s Per Watt, More Is Better OpenSSL 3.3 Algorithm: ChaCha20-Poly1305 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 300M 600M 900M 1200M 1500M 648595124.99 658820863.84 666607882.23 644676877.17 568545794.25 542055990.77 603664493.39 574875604.57 554436256.62 552257367.63 957228032.13 957073830.82 1061980440.86 1039886433.31 1269363721.24 1244610923.33 1287300050.02 1388893901.10 536427227.19 569925760.92 483646931.54 471667041.65 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OpenSSL 3.3 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 79.72 / Avg: 684.71 / Max: 754.83 Min: 21.83 / Avg: 339.43 / Max: 376.89 Min: 58.01 / Avg: 337.59 / Max: 352.56 Min: 163.33 / Avg: 685.93 / Max: 736.16 Min: 74.91 / Avg: 283.74 / Max: 304.03 Min: 186.72 / Avg: 591.08 / Max: 630.87 Min: 71.53 / Avg: 311.09 / Max: 362.15 Min: 193.92 / Avg: 648.38 / Max: 695.92 Min: 104.8 / Avg: 529.37 / Max: 582.49 Min: 54.07 / Avg: 264.65 / Max: 291.12 Min: 68.91 / Avg: 801.95 / Max: 822.13 Min: 35.8 / Avg: 401.15 / Max: 411.05 Min: 27.82 / Avg: 330.48 / Max: 353.86 Min: 54.76 / Avg: 672.12 / Max: 721.51 Min: 21.97 / Avg: 360.05 / Max: 375.06 Min: 41.79 / Avg: 727.96 / Max: 758.79 Min: 16.74 / Avg: 164.05 / Max: 171.53 Min: 14.85 / Avg: 139.18 / Max: 148.57 Min: 107.32 / Avg: 447.17 / Max: 525.92 Min: 43.7 / Avg: 211.59 / Max: 250.8 Min: 43.58 / Avg: 277.13 / Max: 331.03 Min: 109.07 / Avg: 565.2 / Max: 671.32 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 125758 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 62456 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 62116 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 126211 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 52209 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 108364 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 57241 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 119085 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 97228 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 48696 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 145956 Joules per run. 12. EPYC 9684X: Approximate power consumption of 73410 Joules per run. 13. EPYC 9654: Approximate power consumption of 60588 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 122325 Joules per run. 15. EPYC 9754: Approximate power consumption of 65890 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 132489 Joules per run. 17. EPYC 8534P: Approximate power consumption of 30131 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 25563 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 82279 Joules per run. 20. Xeon 6766E: Approximate power consumption of 39003 Joules per run. 21. Xeon 6780E: Approximate power consumption of 50992 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 103807 Joules per run.
Blender Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Classroom - Compute: CPU-Only Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 30 60 90 120 150 SE +/- 0.22, N = 3 SE +/- 0.11, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.20, N = 3 SE +/- 0.38, N = 3 SE +/- 0.40, N = 3 SE +/- 0.25, N = 3 SE +/- 0.16, N = 3 SE +/- 0.38, N = 3 SE +/- 0.03, N = 3 SE +/- 0.14, N = 3 SE +/- 0.11, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.18, N = 3 SE +/- 0.09, N = 3 SE +/- 0.05, N = 3 SE +/- 0.67, N = 3 SE +/- 0.05, N = 3 33.61 63.61 68.61 35.91 86.67 44.71 76.87 40.38 62.54 124.63 18.67 35.66 40.26 21.12 31.65 16.82 67.67 75.26 27.41 52.47 48.07 24.61 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Blender 4.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 80.44 / Avg: 621.31 / Max: 724.97 Min: 24.56 / Avg: 326.8 / Max: 368.75 Min: 60.22 / Avg: 330.03 / Max: 377.07 Min: 168.91 / Avg: 636.73 / Max: 754.11 Min: 77.25 / Avg: 334.43 / Max: 376.17 Min: 203.45 / Avg: 652.82 / Max: 753.03 Min: 77.77 / Avg: 335.02 / Max: 376.96 Min: 210.08 / Avg: 648.81 / Max: 752.1 Min: 101.27 / Avg: 509.54 / Max: 580.93 Min: 52.8 / Avg: 262.14 / Max: 290.33 Min: 62.19 / Avg: 671.43 / Max: 821.27 Min: 32.63 / Avg: 365.01 / Max: 410.63 Min: 31.02 / Avg: 300.94 / Max: 333.76 Min: 59.51 / Avg: 570.92 / Max: 684.42 Min: 21.92 / Avg: 295.34 / Max: 341.6 Min: 41.08 / Avg: 534.08 / Max: 683.35 Min: 16.44 / Avg: 159.04 / Max: 169.83 Min: 17.21 / Avg: 130.93 / Max: 139.49 Min: 105.51 / Avg: 410.34 / Max: 487.07 Min: 43.66 / Avg: 214.19 / Max: 233.43 Min: 43.65 / Avg: 273.8 / Max: 305.54 Min: 108.2 / Avg: 509.44 / Max: 619.2 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 23817 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 22331 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 24312 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 26106 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 30544 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 32206 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 27249 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 29197 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 34139 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 33728 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 15219 Joules per run. 12. EPYC 9684X: Approximate power consumption of 14722 Joules per run. 13. EPYC 9654: Approximate power consumption of 13342 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 14653 Joules per run. 15. EPYC 9754: Approximate power consumption of 10632 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 11572 Joules per run. 17. EPYC 8534P: Approximate power consumption of 11451 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 10430 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 13268 Joules per run. 20. Xeon 6766E: Approximate power consumption of 12209 Joules per run. 21. Xeon 6780E: Approximate power consumption of 14420 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 14943 Joules per run.
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 60 120 180 240 300 SE +/- 0.09, N = 3 SE +/- 0.09, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.18, N = 3 SE +/- 0.10, N = 3 SE +/- 0.10, N = 3 SE +/- 0.06, N = 3 SE +/- 0.14, N = 3 SE +/- 0.92, N = 3 SE +/- 0.09, N = 3 SE +/- 1.22, N = 15 SE +/- 2.90, N = 15 SE +/- 0.44, N = 15 SE +/- 6.97, N = 15 SE +/- 1.90, N = 15 SE +/- 0.19, N = 3 SE +/- 0.41, N = 3 SE +/- 0.07, N = 3 SE +/- 0.25, N = 3 SE +/- 0.15, N = 3 SE +/- 0.34, N = 3 43.41 39.62 100.39 45.78 41.93 42.16 59.69 64.91 113.70 236.81 43.77 110.91 157.45 63.98 230.24 85.86 161.48 156.59 293.02 283.83 266.91 274.52 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 83.28 / Avg: 525.5 / Max: 710.63 Min: 34.28 / Avg: 219.81 / Max: 297.36 Min: 59.06 / Avg: 327.33 / Max: 376.83 Min: 166.26 / Avg: 657.43 / Max: 746.56 Min: 75.73 / Avg: 330.51 / Max: 371.12 Min: 197.25 / Avg: 664.45 / Max: 750.81 Min: 74.3 / Avg: 331.92 / Max: 379.36 Min: 198.61 / Avg: 661.77 / Max: 760.61 Min: 101.92 / Avg: 505.26 / Max: 553.92 Min: 51.68 / Avg: 253.57 / Max: 279.32 Min: 69.94 / Avg: 750.87 / Max: 819.03 Min: 34.13 / Avg: 363.03 / Max: 408.76 Min: 28.22 / Avg: 304.28 / Max: 347.63 Min: 55.49 / Avg: 628.28 / Max: 705.07 Min: 20.51 / Avg: 267.71 / Max: 344.82 Min: 40.79 / Avg: 578.55 / Max: 688.18 Min: 19.75 / Avg: 155.49 / Max: 170.23 Min: 16.08 / Avg: 138.77 / Max: 151.09 Min: 104.28 / Avg: 438.97 / Max: 506.66 Min: 43.7 / Avg: 221.35 / Max: 243.97 Min: 43.59 / Avg: 263.16 / Max: 290.9 Min: 106.87 / Avg: 515.24 / Max: 592.9 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 35033 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 14361 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21495 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 43391 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 21593 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 43411 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 21685 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 43897 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 33178 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16651 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 49808 Joules per run. 12. EPYC 9684X: Approximate power consumption of 23912 Joules per run. 13. EPYC 9654: Approximate power consumption of 20042 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 41592 Joules per run. 15. EPYC 9754: Approximate power consumption of 17919 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 39033 Joules per run. 17. EPYC 8534P: Approximate power consumption of 10314 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 9112 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 31313 Joules per run. 20. Xeon 6766E: Approximate power consumption of 14757 Joules per run. 21. Xeon 6780E: Approximate power consumption of 17544 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 36239 Joules per run.
OpenSSL OpenSSL is an open-source toolkit that implements SSL (Secure Sockets Layer) and TLS (Transport Layer Security) protocols. This test profile makes use of the built-in "openssl speed" benchmarking capabilities. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: ChaCha20 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 300000M 600000M 900000M 1200000M 1500000M SE +/- 303075210.03, N = 3 SE +/- 3335467.26, N = 3 SE +/- 232288636.76, N = 3 SE +/- 271318554.29, N = 3 SE +/- 415487944.57, N = 3 SE +/- 329510485.23, N = 3 SE +/- 312824840.64, N = 3 SE +/- 863978337.15, N = 3 SE +/- 352722951.98, N = 3 SE +/- 151152302.42, N = 3 SE +/- 874940734.18, N = 3 SE +/- 94935214.36, N = 3 SE +/- 151272595.84, N = 3 SE +/- 80233613.02, N = 3 SE +/- 170968063.89, N = 3 SE +/- 63368290.15, N = 3 SE +/- 9570566.28, N = 3 SE +/- 71110585.03, N = 3 SE +/- 11835135.62, N = 3 SE +/- 11028602.79, N = 3 SE +/- 39095934.62, N = 3 SE +/- 63366974.35, N = 3 684284382760 344150916937 316126421173 624402972947 226597354153 449908494927 263740690067 522912403347 425451190063 212294883830 1086618191950 544904084773 503311021123 1001502634860 656396329387 1306928507573 307068938377 282053327077 352826821653 177249062183 196920683270 391911225480 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl byte/s Per Watt
OpenBenchmarking.org byte/s Per Watt, More Is Better OpenSSL 3.3 Algorithm: ChaCha20 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 400M 800M 1200M 1600M 2000M 1003586866.34 1008751851.93 977212174.27 936302176.04 811931853.54 774438543.71 852735838.29 846331621.99 804835329.47 802490465.58 1353849347.71 1361592598.33 1510491450.86 1480134319.02 1795036060.88 1778324265.62 1824186596.16 2009755510.33 804207062.62 862670148.37 730208953.76 712317847.22 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OpenSSL 3.3 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 150 300 450 600 750 Min: 70.13 / Avg: 681.84 / Max: 728.96 Min: 22.69 / Avg: 341.17 / Max: 376.63 Min: 54.19 / Avg: 323.5 / Max: 377.22 Min: 168.89 / Avg: 666.88 / Max: 755.69 Min: 71.67 / Avg: 279.08 / Max: 326.73 Min: 197.94 / Avg: 580.95 / Max: 674.82 Min: 73.21 / Avg: 309.29 / Max: 373.85 Min: 183.97 / Avg: 617.86 / Max: 744.83 Min: 101.74 / Avg: 528.62 / Max: 581.46 Min: 54.01 / Avg: 264.55 / Max: 291.24 Min: 70.23 / Avg: 802.61 / Max: 826.12 Min: 34.55 / Avg: 400.2 / Max: 411.05 Min: 30.31 / Avg: 333.21 / Max: 358.89 Min: 59.94 / Avg: 676.63 / Max: 728.84 Min: 22.28 / Avg: 365.67 / Max: 391.73 Min: 42.15 / Avg: 734.92 / Max: 800.62 Min: 17.59 / Avg: 168.33 / Max: 176.1 Min: 15.27 / Avg: 140.34 / Max: 147.74 Min: 108.7 / Avg: 438.73 / Max: 492.61 Min: 43.7 / Avg: 205.47 / Max: 234.45 Min: 43.55 / Avg: 269.68 / Max: 311.17 Min: 109.96 / Avg: 550.19 / Max: 629.46 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 125913 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 62774 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 59524 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 122929 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 51351 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 106507 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 56909 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 117187 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 97090 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 48676 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 145808 Joules per run. 12. EPYC 9684X: Approximate power consumption of 73369 Joules per run. 13. EPYC 9654: Approximate power consumption of 61089 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 123372 Joules per run. 15. EPYC 9754: Approximate power consumption of 66918 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 134001 Joules per run. 17. EPYC 8534P: Approximate power consumption of 30917 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 25729 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 80726 Joules per run. 20. Xeon 6766E: Approximate power consumption of 37737 Joules per run. 21. Xeon 6780E: Approximate power consumption of 49531 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 101419 Joules per run.
John The Ripper This is a benchmark of John The Ripper, which is a password cracker. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: Blowfish Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 90K 180K 270K 360K 450K SE +/- 649.08, N = 3 SE +/- 79.75, N = 3 SE +/- 11.39, N = 3 SE +/- 348.45, N = 3 SE +/- 17.33, N = 3 SE +/- 116.69, N = 3 SE +/- 8.67, N = 3 SE +/- 169.28, N = 3 SE +/- 14.62, N = 3 SE +/- 6.33, N = 3 SE +/- 454.86, N = 3 SE +/- 98.33, N = 3 SE +/- 38.33, N = 3 SE +/- 3455.48, N = 3 SE +/- 1.33, N = 3 SE +/- 2397.15, N = 3 SE +/- 13.72, N = 3 SE +/- 20.54, N = 3 SE +/- 353.58, N = 3 SE +/- 174.44, N = 3 SE +/- 14.67, N = 3 SE +/- 482.17, N = 3 205499 105831 94513 183583 67893 134562 79152 156658 113223 56939 374589 192574 166541 316492 220188 415412 102198 93473 363300 190209 211449 404739 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2 Real C/S Per Watt
OpenBenchmarking.org Real C/S Per Watt, More Is Better John The Ripper 2023.03.14 Test: Blowfish Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 200 400 600 800 1000 332.35 339.84 305.95 291.56 257.14 243.04 274.74 258.82 231.64 233.58 527.64 531.08 605.49 568.71 757.83 711.80 753.26 805.43 818.19 885.52 747.26 720.56 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better John The Ripper 2023.03.14 CPU Power Consumption Monitor Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Full Xeon 6766E Xeon 6780E Xeon 6780E 2P Xeon 6766E 2P 140 280 420 560 700 Min: 54.97 / Avg: 308.91 / Max: 345.11 Min: 161.87 / Avg: 629.66 / Max: 734.18 Min: 22.7 / Avg: 311.41 / Max: 377.71 Min: 64.41 / Avg: 618.33 / Max: 750.74 Min: 71.89 / Avg: 264.78 / Max: 291.9 Min: 194.9 / Avg: 554.18 / Max: 671.99 Min: 71.78 / Avg: 289.17 / Max: 318.47 Min: 196.84 / Avg: 607.6 / Max: 711.09 Min: 103.01 / Avg: 489.04 / Max: 579.68 Min: 52.63 / Avg: 243.63 / Max: 290.65 Min: 63.32 / Avg: 718.13 / Max: 821.91 Min: 34.3 / Avg: 362.84 / Max: 410.63 Min: 28.03 / Avg: 274.61 / Max: 310.69 Min: 57.83 / Avg: 558.52 / Max: 635.56 Min: 22.46 / Avg: 289.87 / Max: 333.39 Min: 41.23 / Avg: 584.92 / Max: 678.42 Min: 18.94 / Avg: 136.45 / Max: 154.65 Min: 15.84 / Avg: 101.56 / Max: 134.16 Min: 107.82 / Avg: 445 / Max: 497.2 Min: 43.68 / Avg: 214.53 / Max: 240.46 Min: 43.56 / Avg: 282.97 / Max: 322.03 Min: 109.68 / Avg: 564.37 / Max: 639.35 Min: 108.45 / Avg: 444.03 / Max: 499.02 1. Xeon Platinum 8490H: Approximate power consumption of 10606 Joules per run. 2. Xeon Platinum 8490H 2P: Approximate power consumption of 22038 Joules per run. 3. Xeon Platinum 8592+: Approximate power consumption of 10692 Joules per run. 4. Xeon Platinum 8592+ 2P: Approximate power consumption of 21642 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 9091 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 19027 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 9832 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 20861 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 16790 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 8283 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 24656 Joules per run. 12. EPYC 9684X: Approximate power consumption of 12458 Joules per run. 13. EPYC 9654: Approximate power consumption of 9428 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 18990 Joules per run. 15. EPYC 9754: Approximate power consumption of 9952 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 26906 Joules per run. 17. EPYC 8534P: Approximate power consumption of 4685 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 4130 Joules per run. 19. Xeon 6766E: Approximate power consumption of 7365 Joules per run. 20. Xeon 6780E: Approximate power consumption of 9715 Joules per run. 21. Xeon 6780E 2P: Approximate power consumption of 19377 Joules per run. 22. Xeon 6766E 2P: Approximate power consumption of 15245 Joules per run.
Result
OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: bcrypt Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 90K 180K 270K 360K 450K SE +/- 288.38, N = 3 SE +/- 46.28, N = 3 SE +/- 10.67, N = 3 SE +/- 292.24, N = 3 SE +/- 8.84, N = 3 SE +/- 866.68, N = 3 SE +/- 8.67, N = 3 SE +/- 576.80, N = 3 SE +/- 12.67, N = 3 SE +/- 6.33, N = 3 SE +/- 1315.55, N = 3 SE +/- 154.46, N = 3 SE +/- 20.00, N = 3 SE +/- 710.46, N = 3 SE +/- 1.33, N = 3 SE +/- 4958.68, N = 4 SE +/- 22.28, N = 3 SE +/- 0.00, N = 3 SE +/- 801.76, N = 3 SE +/- 32.84, N = 3 SE +/- 87.49, N = 3 SE +/- 2096.39, N = 3 206778 105781 94551 183603 67875 133866 79144 155959 113219 56939 376268 192898 166541 320527 220188 412723 102222 93472 363133 190058 211311 402275 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2 Real C/S Per Watt
OpenBenchmarking.org Real C/S Per Watt, More Is Better John The Ripper 2023.03.14 Test: bcrypt Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 200 400 600 800 1000 334.53 342.68 305.82 292.69 256.35 241.56 273.70 256.68 231.51 233.71 523.96 531.63 606.47 573.89 759.60 705.60 749.17 920.41 816.03 885.93 746.76 712.79
7-Zip Compression This is a test of 7-Zip compression/decompression with its integrated benchmark feature. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Decompression Rating Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 300K 600K 900K 1200K 1500K SE +/- 28320.74, N = 3 SE +/- 119.21, N = 3 SE +/- 61.74, N = 3 SE +/- 185.14, N = 3 SE +/- 916.22, N = 3 SE +/- 2598.93, N = 3 SE +/- 374.59, N = 3 SE +/- 6276.88, N = 3 SE +/- 559.82, N = 3 SE +/- 309.57, N = 3 SE +/- 38431.24, N = 3 SE +/- 1085.99, N = 3 SE +/- 111.53, N = 3 SE +/- 15794.26, N = 3 SE +/- 291.68, N = 3 SE +/- 14188.09, N = 3 SE +/- 120.28, N = 3 SE +/- 81.21, N = 3 SE +/- 2333.15, N = 3 SE +/- 343.82, N = 3 SE +/- 258.19, N = 3 SE +/- 903.01, N = 3 573410 338146 287862 557054 207738 401707 243347 469131 366534 188345 1116465 716065 642626 1033277 780871 1340226 367989 338355 767313 421063 463768 846335 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC MIPS Per Watt
OpenBenchmarking.org MIPS Per Watt, More Is Better 7-Zip Compression 22.01 Test: Decompression Rating Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 700 1400 2100 2800 3500 986.76 1119.86 934.34 908.47 663.36 637.01 773.01 746.10 777.16 775.27 1928.99 2281.23 2434.84 2011.14 3140.68 2852.08 2768.54 2828.90 1954.73 2265.09 2052.50 1861.55 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better 7-Zip Compression 22.01 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 77.81 / Avg: 581.11 / Max: 756.45 Min: 34.7 / Avg: 301.96 / Max: 375.99 Min: 60.14 / Avg: 308.09 / Max: 375.76 Min: 170.4 / Avg: 613.18 / Max: 756.05 Min: 70.41 / Avg: 313.16 / Max: 376.07 Min: 205.27 / Avg: 630.61 / Max: 754.38 Min: 74.78 / Avg: 314.81 / Max: 375.55 Min: 198.7 / Avg: 628.77 / Max: 756.25 Min: 101.47 / Avg: 471.63 / Max: 582.19 Min: 52.56 / Avg: 242.94 / Max: 291.38 Min: 68.73 / Avg: 578.78 / Max: 823.64 Min: 33.61 / Avg: 313.89 / Max: 411.35 Min: 27.34 / Avg: 263.93 / Max: 352.58 Min: 60.89 / Avg: 513.78 / Max: 716.51 Min: 22.44 / Avg: 248.63 / Max: 349.11 Min: 42.06 / Avg: 469.91 / Max: 704.89 Min: 19.72 / Avg: 132.92 / Max: 171.37 Min: 18.26 / Avg: 119.61 / Max: 153.19 Min: 105.13 / Avg: 392.54 / Max: 530.11 Min: 43.69 / Avg: 185.89 / Max: 235.27 Min: 43.58 / Avg: 225.95 / Max: 302.95 Min: 108.05 / Avg: 454.64 / Max: 642.86 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 30217 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 12783 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 14172 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 31885 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 15240 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 34053 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 15530 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 34583 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 24210 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 11337 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 29132 Joules per run. 12. EPYC 9684X: Approximate power consumption of 11614 Joules per run. 13. EPYC 9654: Approximate power consumption of 10469 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 26203 Joules per run. 15. EPYC 9754: Approximate power consumption of 11520 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 27881 Joules per run. 17. EPYC 8534P: Approximate power consumption of 5981 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 5582 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 20281 Joules per run. 20. Xeon 6766E: Approximate power consumption of 8055 Joules per run. 21. Xeon 6780E: Approximate power consumption of 8963 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 22126 Joules per run.
Primesieve Primesieve generates prime numbers using a highly optimized sieve of Eratosthenes implementation. Primesieve primarily benchmarks the CPU's L1/L2 cache performance. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Primesieve 12.1 Length: 1e13 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 20 40 60 80 100 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.10, N = 3 SE +/- 0.25, N = 3 SE +/- 0.02, N = 4 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 4 SE +/- 0.02, N = 3 SE +/- 0.01, N = 4 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 25.02 48.41 51.82 27.11 67.32 33.92 58.16 30.20 40.44 81.36 12.13 23.27 24.24 12.63 21.76 11.56 45.95 54.39 29.39 57.71 52.07 26.46 1. (CXX) g++ options: -O3 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Primesieve 12.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 72.85 / Avg: 610.7 / Max: 755.46 Min: 21.47 / Avg: 325.15 / Max: 377.46 Min: 54.67 / Avg: 328.05 / Max: 377.53 Min: 169.87 / Avg: 623.11 / Max: 754.26 Min: 74.26 / Avg: 333.11 / Max: 377.38 Min: 198.12 / Avg: 644.29 / Max: 754.21 Min: 74.48 / Avg: 332.68 / Max: 375.62 Min: 195.98 / Avg: 641.65 / Max: 754.11 Min: 103.1 / Avg: 498.66 / Max: 583 Min: 52.11 / Avg: 258.9 / Max: 290.98 Min: 60.51 / Avg: 618.54 / Max: 821.49 Min: 34.15 / Avg: 347.93 / Max: 410.94 Min: 28.63 / Avg: 313.43 / Max: 370.81 Min: 38.5 / Avg: 568.09 / Max: 750.08 Min: 21.63 / Avg: 274.16 / Max: 334.73 Min: 41.03 / Avg: 500.8 / Max: 682.66 Min: 17.27 / Avg: 151.7 / Max: 165.81 Min: 15.99 / Avg: 116.97 / Max: 130.2 Min: 104.03 / Avg: 414.77 / Max: 479.6 Min: 43.71 / Avg: 208.57 / Max: 226.96 Min: 43.4 / Avg: 266.63 / Max: 294.13 Min: 105.22 / Avg: 507.66 / Max: 599.09 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 17914 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 17016 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 18371 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 19524 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 23762 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 24698 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 20626 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 22030 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 22273 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 22093 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 10051 Joules per run. 12. EPYC 9684X: Approximate power consumption of 9626 Joules per run. 13. EPYC 9654: Approximate power consumption of 8985 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 9232 Joules per run. 15. EPYC 9754: Approximate power consumption of 7037 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 7888 Joules per run. 17. EPYC 8534P: Approximate power consumption of 7585 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 6823 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 13826 Joules per run. 20. Xeon 6766E: Approximate power consumption of 12793 Joules per run. 21. Xeon 6780E: Approximate power consumption of 15020 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 15568 Joules per run.
Blender Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Barbershop - Compute: CPU-Only Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 100 200 300 400 500 SE +/- 0.21, N = 3 SE +/- 0.69, N = 3 SE +/- 0.18, N = 3 SE +/- 0.42, N = 3 SE +/- 0.12, N = 3 SE +/- 0.23, N = 3 SE +/- 1.09, N = 3 SE +/- 0.06, N = 3 SE +/- 0.25, N = 3 SE +/- 0.03, N = 3 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 SE +/- 0.25, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 SE +/- 0.41, N = 3 SE +/- 0.33, N = 3 SE +/- 0.08, N = 3 SE +/- 0.17, N = 3 125.87 236.73 261.97 141.54 320.11 169.44 290.56 156.70 235.31 456.81 67.52 123.90 139.25 79.05 114.76 65.58 240.13 263.76 106.48 191.20 174.49 97.18 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Blender 4.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 79.57 / Avg: 660.14 / Max: 755.17 Min: 33.95 / Avg: 339.43 / Max: 377.51 Min: 60.47 / Avg: 340.87 / Max: 376.73 Min: 167.6 / Avg: 666.99 / Max: 755.27 Min: 73.43 / Avg: 343.06 / Max: 375.17 Min: 206.17 / Avg: 675.87 / Max: 751.49 Min: 85.64 / Avg: 342.89 / Max: 377.27 Min: 209.81 / Avg: 673.68 / Max: 752.4 Min: 104.16 / Avg: 521 / Max: 582.69 Min: 52.6 / Avg: 265.95 / Max: 290.85 Min: 68.76 / Avg: 738.74 / Max: 823.72 Min: 35.25 / Avg: 388.09 / Max: 411.05 Min: 27.59 / Avg: 319.36 / Max: 343.48 Min: 58.63 / Avg: 632.52 / Max: 694.54 Min: 23.25 / Avg: 321.43 / Max: 348.37 Min: 41.32 / Avg: 614.31 / Max: 703.89 Min: 17.05 / Avg: 166.92 / Max: 172.9 Min: 17.54 / Avg: 139.56 / Max: 146.03 Min: 106.4 / Avg: 442.07 / Max: 501.67 Min: 43.74 / Avg: 219.92 / Max: 232.7 Min: 43.73 / Avg: 282.74 / Max: 303.29 Min: 108.93 / Avg: 517.76 / Max: 626.1 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 87578 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 82369 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 91354 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 99381 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 111722 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 119403 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 101723 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 110259 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 126603 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 122956 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 53682 Joules per run. 12. EPYC 9684X: Approximate power consumption of 50064 Joules per run. 13. EPYC 9654: Approximate power consumption of 47266 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 53764 Joules per run. 15. EPYC 9754: Approximate power consumption of 38786 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 44025 Joules per run. 17. EPYC 8534P: Approximate power consumption of 41008 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 37636 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 50690 Joules per run. 20. Xeon 6766E: Approximate power consumption of 43617 Joules per run. 21. Xeon 6780E: Approximate power consumption of 51270 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 57644 Joules per run.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Pabellon Barcelona - Compute: CPU-Only Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 30 60 90 120 150 SE +/- 0.06, N = 3 SE +/- 0.09, N = 3 SE +/- 0.15, N = 3 SE +/- 0.26, N = 3 SE +/- 0.31, N = 3 SE +/- 0.08, N = 3 SE +/- 0.44, N = 3 SE +/- 0.20, N = 3 SE +/- 0.26, N = 3 SE +/- 0.15, N = 3 SE +/- 0.11, N = 3 SE +/- 0.16, N = 3 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 SE +/- 0.13, N = 3 SE +/- 0.13, N = 3 SE +/- 0.16, N = 3 SE +/- 0.05, N = 3 SE +/- 0.29, N = 3 SE +/- 0.13, N = 3 SE +/- 0.25, N = 3 SE +/- 0.17, N = 3 41.85 80.29 87.92 46.38 106.96 55.26 97.80 51.29 76.10 150.39 23.84 44.87 48.88 26.35 39.83 21.66 85.12 94.41 35.11 65.67 60.11 31.28 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Blender 4.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 77.37 / Avg: 624.76 / Max: 738.53 Min: 34.2 / Avg: 330.4 / Max: 377.77 Min: 60.61 / Avg: 332.25 / Max: 377.75 Min: 172.77 / Avg: 638.84 / Max: 757.46 Min: 76.03 / Avg: 336.64 / Max: 376.9 Min: 211.91 / Avg: 656.12 / Max: 755.31 Min: 76.38 / Avg: 337.24 / Max: 375.65 Min: 208.34 / Avg: 654.26 / Max: 753.55 Min: 98.03 / Avg: 509.42 / Max: 580.91 Min: 52.51 / Avg: 261.74 / Max: 291.09 Min: 65.23 / Avg: 677.05 / Max: 822.1 Min: 31.38 / Avg: 370.95 / Max: 410.68 Min: 30.54 / Avg: 312.47 / Max: 346.36 Min: 58.1 / Avg: 592.5 / Max: 710.39 Min: 21.64 / Avg: 304.63 / Max: 348.18 Min: 41.28 / Avg: 465.54 / Max: 700.45 Min: 19.07 / Avg: 163.93 / Max: 175 Min: 17.1 / Avg: 133.17 / Max: 140.81 Min: 105.22 / Avg: 415.82 / Max: 498.21 Min: 43.71 / Avg: 217.74 / Max: 239.54 Min: 43.58 / Avg: 280.84 / Max: 315.47 Min: 108.3 / Avg: 523.16 / Max: 632.46 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 29364 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 27974 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 30789 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 33007 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 37591 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 39149 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 34398 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 36420 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 41093 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 40657 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 19183 Joules per run. 12. EPYC 9684X: Approximate power consumption of 18177 Joules per run. 13. EPYC 9654: Approximate power consumption of 16665 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 18170 Joules per run. 15. EPYC 9754: Approximate power consumption of 13607 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 14897 Joules per run. 17. EPYC 8534P: Approximate power consumption of 14699 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 13184 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 16771 Joules per run. 20. Xeon 6766E: Approximate power consumption of 15387 Joules per run. 21. Xeon 6780E: Approximate power consumption of 18255 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 19008 Joules per run.
Coremark This is a test of EEMBC CoreMark processor benchmark. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Iterations/Sec, More Is Better Coremark 1.0 CoreMark Size 666 - Iterations Per Second Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 2M 4M 6M 8M 10M SE +/- 9700.21, N = 3 SE +/- 4635.95, N = 3 SE +/- 9256.47, N = 3 SE +/- 12743.41, N = 3 SE +/- 1747.99, N = 3 SE +/- 7219.73, N = 3 SE +/- 5202.86, N = 3 SE +/- 20649.43, N = 3 SE +/- 30163.42, N = 15 SE +/- 927.64, N = 3 SE +/- 76743.24, N = 3 SE +/- 54326.71, N = 3 SE +/- 10132.66, N = 3 SE +/- 2306.54, N = 3 SE +/- 4775.53, N = 3 SE +/- 54771.53, N = 3 SE +/- 1374.66, N = 3 SE +/- 11678.22, N = 3 SE +/- 9906.84, N = 3 SE +/- 10294.77, N = 3 SE +/- 40214.40, N = 15 SE +/- 7619.10, N = 3 4966250.78 2369998.36 2194630.60 3902076.24 1614763.70 2993136.60 1855135.33 3279262.53 1839444.40 1218453.34 8448083.73 4152864.88 3926265.28 7975907.45 4525288.00 8171241.71 2274636.13 2069432.53 6575205.54 2915609.75 3340274.03 7302247.14 1. (CC) gcc options: -O2 -lrt" -lrt Iterations/Sec Per Watt
OpenBenchmarking.org Iterations/Sec Per Watt, More Is Better Coremark 1.0 CoreMark Size 666 - Iterations Per Second Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 5K 10K 15K 20K 25K 8414.46 7555.56 7477.77 7118.47 6163.40 5763.20 6571.62 5880.62 4373.42 5016.56 13681.18 12144.31 13254.14 14883.36 16764.47 16699.88 15712.09 16836.69 21799.95 18400.49 15612.90 18406.92 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Coremark 1.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 73.47 / Avg: 590.2 / Max: 753.92 Min: 34.34 / Avg: 313.68 / Max: 378.24 Min: 54.25 / Avg: 293.49 / Max: 341.26 Min: 163.01 / Avg: 548.16 / Max: 709.21 Min: 76.41 / Avg: 261.99 / Max: 288.93 Min: 188.96 / Avg: 519.35 / Max: 613.18 Min: 77.43 / Avg: 282.3 / Max: 314.07 Min: 206.68 / Avg: 557.64 / Max: 672.47 Min: 100.85 / Avg: 420.6 / Max: 582.07 Min: 50.82 / Avg: 242.89 / Max: 290.97 Min: 68.03 / Avg: 617.5 / Max: 820.53 Min: 32.2 / Avg: 341.96 / Max: 411.86 Min: 26.88 / Avg: 296.23 / Max: 351.89 Min: 57.24 / Avg: 535.89 / Max: 711.09 Min: 21.14 / Avg: 269.93 / Max: 353.42 Min: 42.53 / Avg: 489.3 / Max: 675.15 Min: 16.44 / Avg: 144.77 / Max: 164.64 Min: 14.91 / Avg: 122.91 / Max: 138.78 Min: 104.32 / Avg: 301.62 / Max: 446.07 Min: 43.57 / Avg: 158.45 / Max: 217.13 Min: 21.83 / Avg: 213.94 / Max: 282.7 Min: 106.84 / Avg: 396.71 / Max: 563.32 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 22821 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 22689 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 15946 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 18820 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 18601 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 21640 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 17690 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 21748 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 18114 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 14735 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 15849 Joules per run. 12. EPYC 9684X: Approximate power consumption of 15160 Joules per run. 13. EPYC 9654: Approximate power consumption of 13824 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 14112 Joules per run. 15. EPYC 9754: Approximate power consumption of 11247 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 13048 Joules per run. 17. EPYC 8534P: Approximate power consumption of 10906 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 10120 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 6736 Joules per run. 20. Xeon 6766E: Approximate power consumption of 6127 Joules per run. 21. Xeon 6780E: Approximate power consumption of 9185 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 9521 Joules per run.
OpenRadioss OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: Chrysler Neon 1M Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 70 140 210 280 350 SE +/- 0.14, N = 3 SE +/- 0.20, N = 3 SE +/- 0.15, N = 3 SE +/- 0.11, N = 3 SE +/- 0.08, N = 3 SE +/- 0.13, N = 3 SE +/- 0.18, N = 3 SE +/- 0.14, N = 3 SE +/- 0.78, N = 3 SE +/- 0.13, N = 3 SE +/- 0.46, N = 3 SE +/- 0.49, N = 3 SE +/- 1.51, N = 8 SE +/- 0.71, N = 12 SE +/- 1.11, N = 3 SE +/- 1.00, N = 10 SE +/- 0.47, N = 3 SE +/- 0.50, N = 3 86.93 157.56 207.20 115.89 228.74 125.15 212.99 117.91 185.03 343.16 49.55 77.32 176.14 77.64 231.96 93.99 297.25 300.69 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OpenRadioss 2023.09.15 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 140 280 420 560 700 Min: 82.45 / Avg: 561.7 / Max: 752.76 Min: 33.32 / Avg: 313.77 / Max: 375.72 Min: 59.23 / Avg: 321.19 / Max: 377.05 Min: 168.54 / Avg: 600.33 / Max: 753.81 Min: 72.8 / Avg: 328.51 / Max: 377.04 Min: 197.55 / Avg: 624.98 / Max: 753.94 Min: 83.35 / Avg: 329.11 / Max: 376.3 Min: 213.51 / Avg: 619.95 / Max: 751.65 Min: 105.1 / Avg: 469.12 / Max: 579.49 Min: 52.15 / Avg: 250.92 / Max: 289.23 Min: 68.17 / Avg: 526.7 / Max: 819.28 Min: 33.17 / Avg: 309.02 / Max: 409.54 Min: 28.56 / Avg: 270.92 / Max: 332.67 Min: 59.6 / Avg: 495.69 / Max: 689.03 Min: 21.25 / Avg: 249.04 / Max: 321.21 Min: 42.16 / Avg: 450.48 / Max: 658.58 Min: 18.8 / Avg: 143.22 / Max: 157.87 Min: 17.52 / Avg: 128.33 / Max: 140.79 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 67779 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 57524 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 76444 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 91850 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 84536 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 99788 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 79096 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 95886 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 108055 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 96186 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 50387 Joules per run. 12. EPYC 9684X: Approximate power consumption of 35331 Joules per run. 13. EPYC 9654: Approximate power consumption of 57638 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 61259 Joules per run. 15. EPYC 9754: Approximate power consumption of 69483 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 69374 Joules per run. 17. EPYC 8534P: Approximate power consumption of 47882 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 43333 Joules per run.
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 8K 16K 24K 32K 40K SE +/- 17.69, N = 3 SE +/- 4.30, N = 3 SE +/- 5.45, N = 3 SE +/- 12.64, N = 3 SE +/- 18.13, N = 3 SE +/- 12.64, N = 3 SE +/- 7.39, N = 3 SE +/- 3.89, N = 3 SE +/- 16.45, N = 3 SE +/- 15.90, N = 3 SE +/- 15.46, N = 3 SE +/- 7.70, N = 3 SE +/- 2.59, N = 3 SE +/- 46.87, N = 3 SE +/- 8.57, N = 3 SE +/- 10.72, N = 3 SE +/- 2.45, N = 3 SE +/- 7.49, N = 3 SE +/- 30.29, N = 3 SE +/- 2.54, N = 3 SE +/- 0.67, N = 3 SE +/- 41.98, N = 3 24676.86 12317.94 9004.23 20937.58 9087.12 17252.27 9686.39 18561.91 13467.28 5913.04 35809.59 17230.35 16038.90 31974.88 19917.54 38546.66 9256.11 8279.63 14551.12 7721.00 8536.39 16394.06 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OSPRay Studio Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 12K 24K 36K 48K 60K SE +/- 7.13, N = 3 SE +/- 37.49, N = 3 SE +/- 62.46, N = 3 SE +/- 34.10, N = 3 SE +/- 28.06, N = 3 SE +/- 72.42, N = 3 SE +/- 83.47, N = 3 SE +/- 51.39, N = 3 SE +/- 53.03, N = 3 SE +/- 148.46, N = 3 SE +/- 17.16, N = 3 SE +/- 39.30, N = 3 SE +/- 44.33, N = 3 SE +/- 32.74, N = 3 SE +/- 33.33, N = 3 SE +/- 12.34, N = 3 SE +/- 250.73, N = 3 SE +/- 31.02, N = 3 SE +/- 409.89, N = 15 SE +/- 199.93, N = 3 SE +/- 371.33, N = 3 SE +/- 429.71, N = 4 12124 23125 31380 14138 37055 16645 33790 15357 30442 54456 8916 16603 18896 10428 15286 8413 38811 42513 38228 52083 46875 35081 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 1.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 78.22 / Avg: 573.74 / Max: 753.21 Min: 35.35 / Avg: 299.63 / Max: 376.51 Min: 61.9 / Avg: 259.12 / Max: 377.23 Min: 175.84 / Avg: 622.79 / Max: 756.66 Min: 74.46 / Avg: 283.63 / Max: 375.94 Min: 210.55 / Avg: 606.6 / Max: 753.89 Min: 78.1 / Avg: 281.43 / Max: 376.32 Min: 201.01 / Avg: 599.93 / Max: 754.22 Min: 95.78 / Avg: 375.01 / Max: 583.47 Min: 53.95 / Avg: 217.25 / Max: 291.65 Min: 66.57 / Avg: 696.59 / Max: 822.15 Min: 35.54 / Avg: 320.39 / Max: 411.05 Min: 29.03 / Avg: 265.51 / Max: 331.71 Min: 61.04 / Avg: 548.32 / Max: 683.37 Min: 21.92 / Avg: 245.02 / Max: 336.36 Min: 41.91 / Avg: 564.91 / Max: 692.23 Min: 17.86 / Avg: 118.24 / Max: 166.58 Min: 17.28 / Avg: 103.3 / Max: 141.73 Min: 105.3 / Avg: 248.8 / Max: 487.82 Min: 43.63 / Avg: 134.74 / Max: 219.04 Min: 43.51 / Avg: 165.73 / Max: 285.29 Min: 107.79 / Avg: 277.62 / Max: 555.46 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 38440 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 26068 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 11833 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 65600 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 14371 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 43069 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 13321 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 39996 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 17500 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 15063 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 69659 Joules per run. 12. EPYC 9684X: Approximate power consumption of 22321 Joules per run. 13. EPYC 9654: Approximate power consumption of 20356 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 41490 Joules per run. 15. EPYC 9754: Approximate power consumption of 16907 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 55173 Joules per run. 17. EPYC 8534P: Approximate power consumption of 6582 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 6129 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 15061 Joules per run. 20. Xeon 6766E: Approximate power consumption of 9657 Joules per run. 21. Xeon 6780E: Approximate power consumption of 10827 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 15616 Joules per run.
Blender Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: BMW27 - Compute: CPU-Only Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 11 22 33 44 55 SE +/- 0.03, N = 4 SE +/- 0.04, N = 3 SE +/- 0.15, N = 3 SE +/- 0.08, N = 4 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.24, N = 3 SE +/- 0.08, N = 4 SE +/- 0.03, N = 3 SE +/- 0.11, N = 3 SE +/- 0.03, N = 6 SE +/- 0.04, N = 4 SE +/- 0.07, N = 4 SE +/- 0.02, N = 5 SE +/- 0.01, N = 4 SE +/- 0.02, N = 6 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.06, N = 5 SE +/- 0.17, N = 8 SE +/- 0.05, N = 3 SE +/- 0.09, N = 5 12.76 23.72 25.89 13.74 31.66 16.55 28.49 15.29 23.67 46.32 7.75 14.29 15.96 8.61 12.86 7.17 27.12 30.07 10.56 19.85 17.61 9.71 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Blender 4.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 73.16 / Avg: 522.14 / Max: 732.74 Min: 33.51 / Avg: 297.61 / Max: 376.94 Min: 57.12 / Avg: 303.66 / Max: 376.88 Min: 171.9 / Avg: 556.95 / Max: 754.1 Min: 72.63 / Avg: 316.78 / Max: 376.8 Min: 204.3 / Avg: 589.35 / Max: 754.59 Min: 80.66 / Avg: 311.66 / Max: 376.47 Min: 211.29 / Avg: 584.52 / Max: 755.18 Min: 103.59 / Avg: 467.53 / Max: 580.29 Min: 52.7 / Avg: 250.52 / Max: 290.53 Min: 66.83 / Avg: 521.92 / Max: 820.17 Min: 35.39 / Avg: 314.77 / Max: 411.05 Min: 27.61 / Avg: 264.26 / Max: 339.47 Min: 56.75 / Avg: 465.75 / Max: 695.98 Min: 21.13 / Avg: 247.78 / Max: 338.02 Min: 41.39 / Avg: 414.63 / Max: 680.91 Min: 17.13 / Avg: 146.16 / Max: 171.02 Min: 18.72 / Avg: 121.31 / Max: 138.75 Min: 104.11 / Avg: 337.47 / Max: 486.69 Min: 43.62 / Avg: 189.01 / Max: 235.56 Min: 43.52 / Avg: 237.13 / Max: 302.65 Min: 106.78 / Avg: 401.76 / Max: 612.07 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 9268 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 8432 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 9312 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 10582 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 11404 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 12573 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 10389 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 11690 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 13247 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 12693 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 6437 Joules per run. 12. EPYC 9684X: Approximate power consumption of 5823 Joules per run. 13. EPYC 9654: Approximate power consumption of 5483 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 6148 Joules per run. 15. EPYC 9754: Approximate power consumption of 4336 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 4768 Joules per run. 17. EPYC 8534P: Approximate power consumption of 4677 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 4206 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 5197 Joules per run. 20. Xeon 6766E: Approximate power consumption of 4607 Joules per run. 21. Xeon 6780E: Approximate power consumption of 5296 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 5866 Joules per run.
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 6 12 18 24 30 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.16, N = 3 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 6.95 6.72 9.79 7.72 7.13 7.32 7.76 7.97 24.39 23.25 3.78 6.93 7.23 3.98 8.03 4.37 8.59 9.46 18.75 17.81 16.36 16.73 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 84.79 / Avg: 638.38 / Max: 770.92 Min: 34.07 / Avg: 323.98 / Max: 378.14 Min: 57.71 / Avg: 328.31 / Max: 374.69 Min: 172.39 / Avg: 651.14 / Max: 755.22 Min: 73.88 / Avg: 330.38 / Max: 377.07 Min: 198.29 / Avg: 659.86 / Max: 754.53 Min: 83.77 / Avg: 330.51 / Max: 377.23 Min: 209.53 / Avg: 660.24 / Max: 754.29 Min: 101.18 / Avg: 504.36 / Max: 573.33 Min: 49.85 / Avg: 255.01 / Max: 291.18 Min: 64.76 / Avg: 750.99 / Max: 819.5 Min: 33.67 / Avg: 380.02 / Max: 410.65 Min: 29.57 / Avg: 331.39 / Max: 358.09 Min: 60.33 / Avg: 641.88 / Max: 698.45 Min: 23.26 / Avg: 322.4 / Max: 353.88 Min: 41.99 / Avg: 631.93 / Max: 700.82 Min: 18.98 / Avg: 159.92 / Max: 172.73 Min: 18.47 / Avg: 133.6 / Max: 149.13 Min: 107.09 / Avg: 456.74 / Max: 515.82 Min: 43.82 / Avg: 230.25 / Max: 249.52 Min: 43.64 / Avg: 297.75 / Max: 328.7 Min: 110.7 / Avg: 588.97 / Max: 656.55 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 43835 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 21383 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21449 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 44060 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 21585 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 43991 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 21704 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 44456 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 33120 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16576 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 49315 Joules per run. 12. EPYC 9684X: Approximate power consumption of 24828 Joules per run. 13. EPYC 9654: Approximate power consumption of 21540 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 41936 Joules per run. 15. EPYC 9754: Approximate power consumption of 21171 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 41918 Joules per run. 17. EPYC 8534P: Approximate power consumption of 10448 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 8684 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 31058 Joules per run. 20. Xeon 6766E: Approximate power consumption of 15043 Joules per run. 21. Xeon 6780E: Approximate power consumption of 19453 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 39658 Joules per run.
Xcompact3d Incompact3d Xcompact3d Incompact3d is a Fortran-MPI based, finite difference high-performance code for solving the incompressible Navier-Stokes equation and as many as you need scalar transport equations. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Xcompact3d Incompact3d 2021-03-11 Input: input.i3d 193 Cells Per Direction Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 6 12 18 24 30 SE +/- 0.03329814, N = 5 SE +/- 0.02923582, N = 4 SE +/- 0.01004100, N = 4 SE +/- 0.04312801, N = 5 SE +/- 0.04445674, N = 4 SE +/- 0.01741826, N = 5 SE +/- 0.01708632, N = 4 SE +/- 0.05695382, N = 15 SE +/- 0.02691998, N = 4 SE +/- 0.01216869, N = 3 SE +/- 0.00891960, N = 5 SE +/- 0.05847189, N = 6 SE +/- 0.06577912, N = 5 SE +/- 0.04312156, N = 5 SE +/- 0.03951909, N = 5 SE +/- 0.01633300, N = 4 SE +/- 0.01040414, N = 3 SE +/- 0.10237421, N = 3 5.39125967 10.19670660 12.92934130 6.39169817 13.96923760 7.29349117 12.79975820 6.66387510 11.24980160 23.97082840 3.75319901 6.88121279 8.25383511 4.26078596 8.87225914 4.51061893 20.93791390 21.17803070 1. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Xcompact3d Incompact3d 2021-03-11 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 140 280 420 560 700 Min: 78.61 / Avg: 426.75 / Max: 741.39 Min: 24.14 / Avg: 251.56 / Max: 369.25 Min: 58.88 / Avg: 278.29 / Max: 373.12 Min: 151.7 / Avg: 495.02 / Max: 746.22 Min: 75.94 / Avg: 288.56 / Max: 366.2 Min: 187.55 / Avg: 524.04 / Max: 746.57 Min: 77.21 / Avg: 283.32 / Max: 372.73 Min: 196.28 / Avg: 524.59 / Max: 749.74 Min: 100.46 / Avg: 415.93 / Max: 564.56 Min: 53.04 / Avg: 237.24 / Max: 284.02 Min: 64.22 / Avg: 431.35 / Max: 814.6 Min: 34.54 / Avg: 254.46 / Max: 403.7 Min: 30.56 / Avg: 216.15 / Max: 325.7 Min: 57.92 / Avg: 371 / Max: 659.72 Min: 22.21 / Avg: 200.17 / Max: 312.99 Min: 40.05 / Avg: 313.08 / Max: 632.39 Min: 19.02 / Avg: 124.9 / Max: 149.76 Min: 17.28 / Avg: 114.52 / Max: 138.44 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 6231 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 4025 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 5148 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 7128 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 5483 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 7441 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 5171 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 7379 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 7175 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 6722 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 5435 Joules per run. 12. EPYC 9684X: Approximate power consumption of 3138 Joules per run. 13. EPYC 9654: Approximate power consumption of 2983 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 4897 Joules per run. 15. EPYC 9754: Approximate power consumption of 3043 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 6105 Joules per run. 17. EPYC 8534P: Approximate power consumption of 3289 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 3016 Joules per run.
OpenSSL OpenSSL is an open-source toolkit that implements SSL (Secure Sockets Layer) and TLS (Transport Layer Security) protocols. This test profile makes use of the built-in "openssl speed" benchmarking capabilities. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org verify/s, More Is Better OpenSSL 3.3 Algorithm: RSA4096 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 800K 1600K 2400K 3200K 4000K SE +/- 6745.42, N = 3 SE +/- 92.62, N = 3 SE +/- 92.46, N = 3 SE +/- 862.96, N = 3 SE +/- 165.80, N = 3 SE +/- 355.69, N = 3 SE +/- 200.66, N = 3 SE +/- 277.84, N = 3 SE +/- 40228.60, N = 3 SE +/- 198.68, N = 3 SE +/- 6125.37, N = 3 SE +/- 1576.96, N = 3 SE +/- 149.48, N = 3 SE +/- 5.26, N = 3 SE +/- 444.74, N = 3 SE +/- 2222.55, N = 3 SE +/- 126.84, N = 3 SE +/- 136.07, N = 3 SE +/- 37.76, N = 3 SE +/- 9.55, N = 3 SE +/- 23.84, N = 3 SE +/- 205.33, N = 3 2057021.6 1036735.6 974189.9 1916162.9 697707.2 1395446.4 813667.6 1627941.4 1099481.5 587354.8 3214376.3 1613828.7 1436324.9 2861959.8 1872096.1 3729470.8 881480.8 810291.8 1479879.0 743282.7 826049.5 1644363.7 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl verify/s Per Watt
OpenBenchmarking.org verify/s Per Watt, More Is Better OpenSSL 3.3 Algorithm: RSA4096 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 1400 2800 4200 5600 7000 2997.55 3030.66 2907.57 2791.77 2306.66 2215.41 2489.80 2430.79 2079.56 2215.62 4099.33 4121.23 4919.81 4728.28 5836.73 5696.67 5691.68 6595.71 4004.98 4295.14 3735.68 3600.28 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OpenSSL 3.3 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 70.64 / Avg: 686.24 / Max: 753.6 Min: 32.63 / Avg: 342.08 / Max: 377.97 Min: 56.91 / Avg: 335.05 / Max: 351.44 Min: 165.7 / Avg: 686.36 / Max: 737.53 Min: 73.89 / Avg: 302.47 / Max: 335.7 Min: 198.5 / Avg: 629.88 / Max: 694.83 Min: 74.71 / Avg: 326.8 / Max: 367.81 Min: 199.02 / Avg: 669.72 / Max: 754.93 Min: 99.67 / Avg: 528.71 / Max: 581.74 Min: 52.16 / Avg: 265.1 / Max: 290.58 Min: 64.61 / Avg: 784.12 / Max: 822.1 Min: 32.96 / Avg: 391.59 / Max: 411.04 Min: 27.6 / Avg: 291.95 / Max: 323.61 Min: 59.69 / Avg: 605.29 / Max: 659.72 Min: 19.93 / Avg: 320.74 / Max: 351.44 Min: 43.66 / Avg: 654.68 / Max: 716.5 Min: 15.75 / Avg: 154.87 / Max: 162.9 Min: 16.2 / Avg: 122.85 / Max: 135.57 Min: 104.34 / Avg: 369.51 / Max: 384.07 Min: 43.61 / Avg: 173.05 / Max: 179.47 Min: 43.31 / Avg: 221.12 / Max: 231.86 Min: 107.48 / Avg: 456.73 / Max: 473.49 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 213419 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 106730 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 104090 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 214145 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 93969 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 196103 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 101853 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 208059 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 164957 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 82622 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 241771 Joules per run. 12. EPYC 9684X: Approximate power consumption of 121131 Joules per run. 13. EPYC 9654: Approximate power consumption of 90796 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 187638 Joules per run. 15. EPYC 9754: Approximate power consumption of 99538 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 203168 Joules per run. 17. EPYC 8534P: Approximate power consumption of 48165 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 38412 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 116888 Joules per run. 20. Xeon 6766E: Approximate power consumption of 54684 Joules per run. 21. Xeon 6780E: Approximate power consumption of 69875 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 143414 Joules per run.
OSPRay Studio Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 14K 28K 42K 56K 70K SE +/- 8.00, N = 3 SE +/- 26.00, N = 3 SE +/- 61.20, N = 3 SE +/- 29.96, N = 3 SE +/- 36.47, N = 3 SE +/- 25.12, N = 3 SE +/- 74.33, N = 3 SE +/- 10.97, N = 3 SE +/- 28.75, N = 3 SE +/- 62.75, N = 3 SE +/- 32.79, N = 3 SE +/- 24.66, N = 3 SE +/- 5.55, N = 3 SE +/- 27.79, N = 3 SE +/- 21.05, N = 3 SE +/- 16.90, N = 3 SE +/- 111.72, N = 3 SE +/- 197.99, N = 3 SE +/- 51.90, N = 3 SE +/- 500.31, N = 3 SE +/- 26.58, N = 3 SE +/- 301.00, N = 12 14358 31993 36649 16837 42837 19701 39238 18111 34866 63035 10514 19535 22305 12427 18129 10015 45377 48844 43906 57657 52501 39283 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 1.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 78.39 / Avg: 616.75 / Max: 753.89 Min: 26.59 / Avg: 252.77 / Max: 377.16 Min: 59.63 / Avg: 268.15 / Max: 377.52 Min: 175.58 / Avg: 588.27 / Max: 757.42 Min: 68.84 / Avg: 291.26 / Max: 378.07 Min: 210.27 / Avg: 614.16 / Max: 754.39 Min: 76.02 / Avg: 287.68 / Max: 377.28 Min: 199.93 / Avg: 609.51 / Max: 752.77 Min: 106.2 / Avg: 388.48 / Max: 582.9 Min: 53.28 / Avg: 223.15 / Max: 291.09 Min: 63.78 / Avg: 623.33 / Max: 822.16 Min: 35.75 / Avg: 329.8 / Max: 411.04 Min: 27.99 / Avg: 273.01 / Max: 332.14 Min: 63.21 / Avg: 573.82 / Max: 678.02 Min: 22.55 / Avg: 256.1 / Max: 337.04 Min: 42.24 / Avg: 558.27 / Max: 695.79 Min: 17.33 / Avg: 121.97 / Max: 166.66 Min: 17.31 / Avg: 107.81 / Max: 142.82 Min: 105.47 / Avg: 265.24 / Max: 464.47 Min: 43.65 / Avg: 142.62 / Max: 223.55 Min: 43.5 / Avg: 175.23 / Max: 284.38 Min: 107.96 / Avg: 295.44 / Max: 567.47 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 64348 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 11375 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 13676 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 41767 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 16408 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 49133 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 15247 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 46120 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 19683 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 17554 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 38854 Joules per run. 12. EPYC 9684X: Approximate power consumption of 25944 Joules per run. 13. EPYC 9654: Approximate power consumption of 23752 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 54322 Joules per run. 15. EPYC 9754: Approximate power consumption of 19719 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 51174 Joules per run. 17. EPYC 8534P: Approximate power consumption of 7562 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 7079 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 17506 Joules per run. 20. Xeon 6766E: Approximate power consumption of 11029 Joules per run. 21. Xeon 6780E: Approximate power consumption of 12441 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 17874 Joules per run.
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 900 1800 2700 3600 4500 SE +/- 11.53, N = 3 SE +/- 0.47, N = 3 SE +/- 2.65, N = 3 SE +/- 0.66, N = 3 SE +/- 2.29, N = 3 SE +/- 1.56, N = 3 SE +/- 2.94, N = 3 SE +/- 1.74, N = 3 SE +/- 3.75, N = 3 SE +/- 0.62, N = 3 SE +/- 5.33, N = 3 SE +/- 1.09, N = 3 SE +/- 6.85, N = 3 SE +/- 3.90, N = 3 SE +/- 11.41, N = 15 SE +/- 5.40, N = 3 SE +/- 0.65, N = 3 SE +/- 0.81, N = 3 SE +/- 2.08, N = 3 SE +/- 2.69, N = 3 SE +/- 2.82, N = 3 SE +/- 2.23, N = 3 2237.69 1159.66 1068.43 1843.61 860.64 1691.79 894.87 1801.89 1186.24 642.44 4013.96 2212.41 1743.49 3353.73 1671.23 4032.66 998.09 918.53 1731.50 924.90 1018.18 1933.08 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
ACES DGEMM This is a multi-threaded DGEMM benchmark. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org GFLOP/s, More Is Better ACES DGEMM 1.0 Sustained Floating-Point Rate Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 20 40 60 80 100 SE +/- 0.11, N = 8 SE +/- 0.08, N = 6 SE +/- 0.09, N = 5 SE +/- 0.28, N = 7 SE +/- 0.04, N = 4 SE +/- 0.06, N = 7 SE +/- 0.09, N = 5 SE +/- 0.04, N = 7 SE +/- 0.09, N = 5 SE +/- 0.01, N = 3 SE +/- 0.39, N = 9 SE +/- 0.40, N = 7 SE +/- 0.22, N = 7 SE +/- 0.10, N = 9 SE +/- 0.17, N = 7 SE +/- 0.19, N = 10 SE +/- 0.16, N = 5 SE +/- 0.10, N = 5 SE +/- 0.03, N = 6 SE +/- 0.01, N = 4 SE +/- 0.01, N = 4 SE +/- 0.04, N = 6 58.25 29.14 23.54 45.97 19.77 39.35 22.54 44.67 24.97 13.49 78.50 45.25 39.09 68.87 44.97 84.69 21.82 21.00 31.48 15.94 17.85 35.20 1. (CC) gcc options: -O3 -march=native -fopenmp GFLOP/s Per Watt
OpenBenchmarking.org GFLOP/s Per Watt, More Is Better ACES DGEMM 1.0 Sustained Floating-Point Rate Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0657 0.1314 0.1971 0.2628 0.3285 0.149 0.121 0.093 0.101 0.071 0.078 0.081 0.090 0.063 0.059 0.215 0.196 0.214 0.228 0.252 0.292 0.198 0.220 0.114 0.107 0.105 0.112 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ACES DGEMM 1.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 68.08 / Avg: 390.95 / Max: 737.84 Min: 23.09 / Avg: 239.87 / Max: 363.28 Min: 53.98 / Avg: 252.19 / Max: 377.52 Min: 164.24 / Avg: 453.94 / Max: 741.45 Min: 75.8 / Avg: 276.9 / Max: 361.7 Min: 193.63 / Avg: 507 / Max: 747.89 Min: 73.75 / Avg: 277.15 / Max: 377.23 Min: 194.98 / Avg: 496.59 / Max: 754.16 Min: 99.45 / Avg: 398.61 / Max: 554.79 Min: 52.19 / Avg: 226.98 / Max: 281.28 Min: 63.45 / Avg: 364.55 / Max: 774.44 Min: 31.49 / Avg: 230.52 / Max: 409.55 Min: 28.2 / Avg: 182.5 / Max: 306.04 Min: 56.61 / Avg: 302.67 / Max: 601.18 Min: 22.22 / Avg: 178.2 / Max: 342.37 Min: 40.76 / Avg: 290.43 / Max: 650.39 Min: 17.88 / Avg: 109.94 / Max: 158.28 Min: 16.53 / Avg: 95.47 / Max: 135.35 Min: 104.19 / Avg: 277.33 / Max: 390.75 Min: 43.57 / Avg: 148.35 / Max: 183.52 Min: 43.36 / Avg: 170.6 / Max: 222.09 Min: 106.31 / Avg: 312.9 / Max: 465.14 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 3128 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 2918 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 3531 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 4280 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 4430 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 5070 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 3991 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 4611 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 5341 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 4842 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 2592 Joules per run. 12. EPYC 9684X: Approximate power consumption of 2141 Joules per run. 13. EPYC 9654: Approximate power consumption of 1851 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 2220 Joules per run. 15. EPYC 9754: Approximate power consumption of 1655 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 1975 Joules per run. 17. EPYC 8534P: Approximate power consumption of 1605 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1432 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 3189 Joules per run. 20. Xeon 6766E: Approximate power consumption of 2782 Joules per run. 21. Xeon 6780E: Approximate power consumption of 2900 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 3390 Joules per run.
Helsing Helsing is an open-source POSIX vampire number generator. This test profile measures the time it takes to generate vampire numbers between varying numbers of digits. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Helsing 1.0-beta Digit Range: 14 digit Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 40 80 120 160 200 SE +/- 0.07, N = 3 SE +/- 0.08, N = 3 SE +/- 0.26, N = 3 SE +/- 0.06, N = 3 SE +/- 0.53, N = 3 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 SE +/- 0.42, N = 3 SE +/- 0.09, N = 3 SE +/- 0.08, N = 3 SE +/- 0.42, N = 3 SE +/- 0.14, N = 3 SE +/- 0.10, N = 3 SE +/- 0.38, N = 5 SE +/- 0.02, N = 3 SE +/- 0.32, N = 3 SE +/- 0.27, N = 3 SE +/- 0.06, N = 3 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 SE +/- 0.10, N = 3 SE +/- 0.01, N = 3 48.09 89.07 93.35 50.83 123.83 65.03 107.24 58.25 82.96 165.79 30.69 56.91 62.17 33.68 48.85 26.78 105.68 120.56 58.96 115.46 103.86 53.02 1. (CC) gcc options: -O2 -pthread CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Helsing 1.0-beta CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 150 300 450 600 750 Min: 74.95 / Avg: 643.2 / Max: 755.25 Min: 32.85 / Avg: 334.81 / Max: 377.7 Min: 56.9 / Avg: 336.32 / Max: 376.98 Min: 173.59 / Avg: 654.95 / Max: 756.78 Min: 73.73 / Avg: 338.57 / Max: 364.52 Min: 210.37 / Avg: 664.49 / Max: 742.91 Min: 87.46 / Avg: 338.48 / Max: 364.16 Min: 203.6 / Avg: 662.24 / Max: 747.53 Min: 102.73 / Avg: 517.9 / Max: 581.32 Min: 52.7 / Avg: 264.22 / Max: 291.17 Min: 67.93 / Avg: 711.96 / Max: 830.1 Min: 34.66 / Avg: 378.16 / Max: 412.26 Min: 28.89 / Avg: 322.19 / Max: 348.84 Min: 58.49 / Avg: 624.24 / Max: 716.4 Min: 21.32 / Avg: 315.34 / Max: 347.42 Min: 41.44 / Avg: 591.29 / Max: 696.59 Min: 18.11 / Avg: 166.23 / Max: 176.55 Min: 17.86 / Avg: 131.19 / Max: 137.88 Min: 105.07 / Avg: 444.27 / Max: 495.95 Min: 43.76 / Avg: 217.84 / Max: 231.94 Min: 43.52 / Avg: 283.2 / Max: 302.38 Min: 107.47 / Avg: 552.92 / Max: 634.15 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 33875 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 31137 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 32735 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 36022 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 43225 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 45850 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 37572 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 41059 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 44885 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 44741 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 24444 Joules per run. 12. EPYC 9684X: Approximate power consumption of 22942 Joules per run. 13. EPYC 9654: Approximate power consumption of 21264 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 23222 Joules per run. 15. EPYC 9754: Approximate power consumption of 16608 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 18133 Joules per run. 17. EPYC 8534P: Approximate power consumption of 18175 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 16311 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 27989 Joules per run. 20. Xeon 6766E: Approximate power consumption of 25923 Joules per run. 21. Xeon 6780E: Approximate power consumption of 30397 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 31517 Joules per run.
Algebraic Multi-Grid Benchmark AMG is a parallel algebraic multigrid solver for linear systems arising from problems on unstructured grids. The driver provided with AMG builds linear systems for various 3-dimensional problems. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Figure Of Merit, More Is Better Algebraic Multi-Grid Benchmark 1.2 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 1000M 2000M 3000M 4000M 5000M SE +/- 9014927.20, N = 3 SE +/- 4000850.45, N = 3 SE +/- 468935.32, N = 3 SE +/- 2438223.49, N = 3 SE +/- 3359086.30, N = 3 SE +/- 7233468.75, N = 3 SE +/- 1778769.08, N = 3 SE +/- 9164253.67, N = 3 SE +/- 467864.03, N = 3 SE +/- 971797.70, N = 3 SE +/- 6340323.98, N = 3 SE +/- 4963892.66, N = 3 SE +/- 1066998.75, N = 3 SE +/- 8808919.44, N = 3 SE +/- 433397.56, N = 3 SE +/- 235140242.43, N = 12 SE +/- 2902028.33, N = 3 SE +/- 291866.98, N = 3 3609646333 1814760000 1605097000 3124402667 1588496667 3156261667 1597993333 3205161000 723153533 1073627667 4467281333 2376149000 2282802000 4324930333 2275352667 2783039083 1150052667 1147108000 1. (CC) gcc options: -lparcsr_ls -lparcsr_mv -lseq_mv -lIJ_mv -lkrylov -lHYPRE_utilities -lm -fopenmp -lmpi Figure Of Merit Per Watt
OpenBenchmarking.org Figure Of Merit Per Watt, More Is Better Algebraic Multi-Grid Benchmark 1.2 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 2M 4M 6M 8M 10M 6520382.60 6349445.21 5415151.06 5278683.30 5380716.03 5320019.08 5363427.41 5337195.71 1552824.49 4622831.26 7422966.05 8293777.78 9442032.07 8578578.70 10610537.82 5533330.98 9344903.38 10387087.22 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Algebraic Multi-Grid Benchmark 1.2 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 140 280 420 560 700 Min: 67.59 / Avg: 553.59 / Max: 733.88 Min: 25.82 / Avg: 285.81 / Max: 370.88 Min: 58.01 / Avg: 296.41 / Max: 368.28 Min: 164.81 / Avg: 591.89 / Max: 729.05 Min: 75.43 / Avg: 295.22 / Max: 373.47 Min: 189.38 / Avg: 593.28 / Max: 741.95 Min: 59.54 / Avg: 297.94 / Max: 371.37 Min: 186.85 / Avg: 600.53 / Max: 731.72 Min: 98.75 / Avg: 465.7 / Max: 552.2 Min: 51.21 / Avg: 232.24 / Max: 283.34 Min: 63.8 / Avg: 601.82 / Max: 781.06 Min: 27.09 / Avg: 286.5 / Max: 375.22 Min: 23.58 / Avg: 241.77 / Max: 304.95 Min: 58.67 / Avg: 504.15 / Max: 640.85 Min: 20 / Avg: 214.44 / Max: 294.78 Min: 42.41 / Avg: 502.96 / Max: 635.91 Min: 17.02 / Avg: 123.07 / Max: 150.22 Min: 16.12 / Avg: 110.44 / Max: 131.86 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 16054 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 7241 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 8102 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 18546 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 6298 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 14041 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 7349 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 15814 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 31202 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 6038 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 22067 Joules per run. 12. EPYC 9684X: Approximate power consumption of 9072 Joules per run. 13. EPYC 9654: Approximate power consumption of 7978 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 19158 Joules per run. 15. EPYC 9754: Approximate power consumption of 9435 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 35249 Joules per run. 17. EPYC 8534P: Approximate power consumption of 4677 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 4197 Joules per run.
OSPRay Studio Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 20K 40K 60K 80K 100K SE +/- 16.05, N = 3 SE +/- 90.37, N = 3 SE +/- 102.40, N = 3 SE +/- 64.24, N = 3 SE +/- 134.33, N = 3 SE +/- 37.55, N = 3 SE +/- 64.91, N = 3 SE +/- 13.86, N = 3 SE +/- 152.29, N = 3 SE +/- 175.68, N = 3 SE +/- 14.62, N = 3 SE +/- 193.23, N = 3 SE +/- 42.05, N = 3 SE +/- 109.43, N = 3 SE +/- 312.83, N = 12 SE +/- 47.34, N = 3 SE +/- 172.59, N = 3 SE +/- 346.19, N = 3 SE +/- 739.02, N = 15 SE +/- 541.85, N = 3 SE +/- 424.84, N = 3 SE +/- 605.82, N = 15 24249 50798 58026 33411 68973 38926 62540 36179 55247 103461 17855 38645 43290 20750 37383 16960 72051 78093 62449 88579 81003 56082 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 1.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 79.71 / Avg: 606.49 / Max: 752.52 Min: 35.11 / Avg: 281.84 / Max: 376.97 Min: 60.65 / Avg: 292.18 / Max: 377.6 Min: 168.48 / Avg: 535.88 / Max: 754.67 Min: 69.88 / Avg: 308.64 / Max: 375.21 Min: 213.26 / Avg: 577.01 / Max: 753.84 Min: 78.44 / Avg: 306.37 / Max: 375.68 Min: 197.25 / Avg: 571.94 / Max: 754.03 Min: 102.98 / Avg: 432.31 / Max: 581.57 Min: 54.98 / Avg: 238.47 / Max: 291.29 Min: 69.54 / Avg: 653.11 / Max: 822.49 Min: 30.5 / Avg: 290.44 / Max: 410.63 Min: 30.06 / Avg: 244.64 / Max: 330.87 Min: 60.75 / Avg: 559.19 / Max: 686.72 Min: 21.62 / Avg: 219.88 / Max: 335.09 Min: 42.88 / Avg: 522.41 / Max: 691.8 Min: 17.98 / Avg: 135.52 / Max: 167.31 Min: 17.4 / Avg: 117.68 / Max: 142.04 Min: 104.78 / Avg: 311.45 / Max: 486.78 Min: 43.65 / Avg: 164.56 / Max: 223.84 Min: 43.57 / Avg: 204.48 / Max: 283.69 Min: 107.48 / Avg: 352.84 / Max: 587.47 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 55393 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 18038 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21134 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 26258 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 25514 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 31543 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 23386 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 29550 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 30838 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 28378 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 48330 Joules per run. 12. EPYC 9684X: Approximate power consumption of 15490 Joules per run. 13. EPYC 9654: Approximate power consumption of 14271 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 46226 Joules per run. 15. EPYC 9754: Approximate power consumption of 11800 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 38484 Joules per run. 17. EPYC 8534P: Approximate power consumption of 12016 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 11180 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 26328 Joules per run. 20. Xeon 6766E: Approximate power consumption of 17773 Joules per run. 21. Xeon 6780E: Approximate power consumption of 20311 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 27168 Joules per run.
Blender Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Fishy Cat - Compute: CPU-Only Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 13 26 39 52 65 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.11, N = 3 SE +/- 0.08, N = 3 SE +/- 0.17, N = 3 SE +/- 0.13, N = 3 SE +/- 0.04, N = 3 SE +/- 0.18, N = 3 SE +/- 0.27, N = 3 SE +/- 0.15, N = 3 SE +/- 0.02, N = 5 SE +/- 0.07, N = 3 SE +/- 0.11, N = 3 SE +/- 0.05, N = 4 SE +/- 0.13, N = 3 SE +/- 0.04, N = 5 SE +/- 0.23, N = 3 SE +/- 0.07, N = 3 SE +/- 0.05, N = 3 SE +/- 0.37, N = 3 SE +/- 0.08, N = 3 SE +/- 0.01, N = 4 17.29 31.91 34.83 19.13 42.78 23.17 38.48 21.45 30.75 59.15 10.16 18.36 20.15 11.25 16.58 9.71 34.35 38.04 16.52 29.55 26.52 15.16 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Blender 4.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 76.09 / Avg: 546.98 / Max: 735.92 Min: 23.46 / Avg: 303.18 / Max: 371.62 Min: 59.73 / Avg: 313.33 / Max: 377.56 Min: 169.36 / Avg: 570.45 / Max: 755.96 Min: 74.34 / Avg: 321.04 / Max: 375.24 Min: 205.55 / Avg: 607.36 / Max: 752.78 Min: 74.14 / Avg: 319.1 / Max: 376.73 Min: 211.08 / Avg: 602.46 / Max: 751.81 Min: 104.59 / Avg: 473.37 / Max: 583.21 Min: 53.1 / Avg: 251.93 / Max: 290.63 Min: 67.56 / Avg: 561.28 / Max: 821.67 Min: 36.44 / Avg: 322.13 / Max: 410.23 Min: 30.77 / Avg: 277.68 / Max: 346.38 Min: 60.34 / Avg: 491.93 / Max: 710.82 Min: 22.97 / Avg: 261.77 / Max: 349.11 Min: 42.38 / Avg: 447.74 / Max: 705.75 Min: 16.84 / Avg: 152.85 / Max: 176.56 Min: 16.69 / Avg: 126.35 / Max: 143.05 Min: 106.69 / Avg: 350.36 / Max: 494.32 Min: 43.64 / Avg: 193.48 / Max: 236.22 Min: 43.69 / Avg: 247.1 / Max: 308.06 Min: 109.2 / Avg: 429.78 / Max: 624.43 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 12398 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 11218 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 12429 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 14261 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 15303 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 17209 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 13828 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 16065 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 16726 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16123 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 8419 Joules per run. 12. EPYC 9684X: Approximate power consumption of 7409 Joules per run. 13. EPYC 9654: Approximate power consumption of 6942 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 7871 Joules per run. 15. EPYC 9754: Approximate power consumption of 5672 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 6627 Joules per run. 17. EPYC 8534P: Approximate power consumption of 6012 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 5433 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 7825 Joules per run. 20. Xeon 6766E: Approximate power consumption of 6707 Joules per run. 21. Xeon 6780E: Approximate power consumption of 7825 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 8810 Joules per run.
m-queens A solver for the N-queens problem with multi-threading support via the OpenMP library. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better m-queens 1.2 Time To Solve Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 6 12 18 24 30 SE +/- 0.028, N = 6 SE +/- 0.030, N = 4 SE +/- 0.025, N = 4 SE +/- 0.021, N = 6 SE +/- 0.031, N = 3 SE +/- 0.021, N = 5 SE +/- 0.035, N = 3 SE +/- 0.028, N = 5 SE +/- 0.066, N = 4 SE +/- 0.023, N = 3 SE +/- 0.064, N = 15 SE +/- 0.025, N = 6 SE +/- 0.019, N = 6 SE +/- 0.093, N = 15 SE +/- 0.021, N = 6 SE +/- 0.031, N = 8 SE +/- 0.019, N = 4 SE +/- 0.029, N = 4 SE +/- 0.035, N = 7 SE +/- 0.039, N = 5 SE +/- 0.032, N = 5 SE +/- 0.034, N = 7 7.402 14.257 15.211 7.881 21.030 10.840 18.102 9.285 12.390 24.175 4.133 6.950 7.738 4.609 6.350 3.981 13.250 14.493 6.045 11.479 10.301 5.512 1. (CXX) g++ options: -fopenmp -O2 -march=native CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better m-queens 1.2 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 77.88 / Avg: 481.61 / Max: 753.74 Min: 32.66 / Avg: 278.57 / Max: 374.34 Min: 62.12 / Avg: 266.4 / Max: 324.62 Min: 165.88 / Avg: 497.84 / Max: 742.37 Min: 75.51 / Avg: 241.11 / Max: 276.68 Min: 201.32 / Avg: 465.55 / Max: 574.13 Min: 77.06 / Avg: 260.39 / Max: 302.34 Min: 180.86 / Avg: 502.47 / Max: 745.73 Min: 99.79 / Avg: 431.33 / Max: 582.73 Min: 54.03 / Avg: 238.8 / Max: 290.84 Min: 63.38 / Avg: 412.8 / Max: 820.43 Min: 31.01 / Avg: 267.9 / Max: 411.07 Min: 28.35 / Avg: 221.83 / Max: 330.6 Min: 52.18 / Avg: 366.51 / Max: 668.54 Min: 20.79 / Avg: 202.95 / Max: 326.11 Min: 41.4 / Avg: 316.2 / Max: 657.62 Min: 19.39 / Avg: 122.5 / Max: 158.25 Min: 15.51 / Avg: 106.99 / Max: 136.77 Min: 105.96 / Avg: 317.88 / Max: 500.32 Min: 43.69 / Avg: 180.19 / Max: 242.1 Min: 43.54 / Avg: 226.9 / Max: 315.05 Min: 108.43 / Avg: 381.31 / Max: 634.03 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 5619 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 5154 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 5195 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 6057 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 6108 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 7263 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 5728 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 6733 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 7117 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 6766 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 3302 Joules per run. 12. EPYC 9684X: Approximate power consumption of 2947 Joules per run. 13. EPYC 9654: Approximate power consumption of 2588 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 3128 Joules per run. 15. EPYC 9754: Approximate power consumption of 2097 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 2530 Joules per run. 17. EPYC 8534P: Approximate power consumption of 2144 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1979 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 3224 Joules per run. 20. Xeon 6766E: Approximate power consumption of 2775 Joules per run. 21. Xeon 6780E: Approximate power consumption of 3267 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 3595 Joules per run.
OSPRay Studio Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 30K 60K 90K 120K 150K SE +/- 47.16, N = 3 SE +/- 162.52, N = 3 SE +/- 58.68, N = 3 SE +/- 125.33, N = 3 SE +/- 41.33, N = 3 SE +/- 155.80, N = 3 SE +/- 65.97, N = 3 SE +/- 141.04, N = 3 SE +/- 32.38, N = 3 SE +/- 623.29, N = 3 SE +/- 27.74, N = 3 SE +/- 89.57, N = 3 SE +/- 231.95, N = 3 SE +/- 756.08, N = 15 SE +/- 50.97, N = 3 SE +/- 28.11, N = 3 SE +/- 29.36, N = 3 SE +/- 13.58, N = 3 SE +/- 900.17, N = 15 SE +/- 365.52, N = 3 SE +/- 189.03, N = 3 SE +/- 176.25, N = 3 33391 59522 68006 38813 80742 45211 73366 41971 64188 121734 20893 44349 50019 27943 42945 20071 84261 91643 71583 101444 92175 66487 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 1.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 81.52 / Avg: 518.28 / Max: 753.01 Min: 34.02 / Avg: 290.6 / Max: 377.55 Min: 59.95 / Avg: 299.76 / Max: 377.1 Min: 167.48 / Avg: 554.33 / Max: 756.36 Min: 69.72 / Avg: 313.73 / Max: 377.15 Min: 204.64 / Avg: 589.92 / Max: 755.25 Min: 74.4 / Avg: 312.09 / Max: 377.67 Min: 194.1 / Avg: 583.5 / Max: 754.71 Min: 105.22 / Avg: 444.93 / Max: 582.81 Min: 52.23 / Avg: 243.3 / Max: 290.85 Min: 68.36 / Avg: 672.33 / Max: 821.45 Min: 34.85 / Avg: 304.67 / Max: 411.05 Min: 27.71 / Avg: 254.04 / Max: 331.67 Min: 60.79 / Avg: 534.58 / Max: 678.46 Min: 21.87 / Avg: 229.47 / Max: 334.93 Min: 43.47 / Avg: 541.66 / Max: 691.2 Min: 18.47 / Avg: 138.95 / Max: 167.41 Min: 16.93 / Avg: 120.39 / Max: 142.49 Min: 56.05 / Avg: 325.96 / Max: 489.46 Min: 43.64 / Avg: 170.07 / Max: 223.38 Min: 43.57 / Avg: 212.15 / Max: 289.98 Min: 107.91 / Avg: 369.36 / Max: 547.58 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 24532 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 21020 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 24680 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 29934 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 29595 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 35985 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 27048 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 33649 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 35594 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 33251 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 55579 Joules per run. 12. EPYC 9684X: Approximate power consumption of 17976 Joules per run. 13. EPYC 9654: Approximate power consumption of 16428 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 36494 Joules per run. 15. EPYC 9754: Approximate power consumption of 13615 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 44957 Joules per run. 17. EPYC 8534P: Approximate power consumption of 14080 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 13042 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 30510 Joules per run. 20. Xeon 6766E: Approximate power consumption of 20579 Joules per run. 21. Xeon 6780E: Approximate power consumption of 23831 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 32257 Joules per run.
miniBUDE MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 50 100 150 200 250 SE +/- 1.02, N = 8 SE +/- 0.20, N = 6 SE +/- 0.61, N = 5 SE +/- 0.81, N = 7 SE +/- 0.12, N = 4 SE +/- 1.28, N = 12 SE +/- 0.84, N = 15 SE +/- 1.85, N = 12 SE +/- 1.19, N = 15 SE +/- 0.38, N = 9 SE +/- 6.15, N = 12 SE +/- 3.27, N = 13 SE +/- 1.18, N = 7 SE +/- 2.97, N = 13 SE +/- 0.70, N = 9 SE +/- 3.98, N = 15 SE +/- 0.04, N = 6 SE +/- 0.03, N = 6 SE +/- 0.05, N = 5 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.46, N = 15 199.73 106.40 82.85 133.63 63.62 108.40 70.84 114.90 85.29 47.26 236.61 151.95 136.95 217.85 229.91 214.62 107.35 98.21 76.60 39.17 43.55 84.35 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm Billion Interactions/s Per Watt
OpenBenchmarking.org Billion Interactions/s Per Watt, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.3179 0.6358 0.9537 1.2716 1.5895 0.503 0.445 0.324 0.291 0.262 0.228 0.280 0.231 0.204 0.206 0.611 0.640 0.706 0.655 1.413 0.732 1.008 1.043 0.255 0.249 0.222 0.236 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better miniBUDE 20210901 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 63.44 / Avg: 396.77 / Max: 754.62 Min: 21.92 / Avg: 239.11 / Max: 377.96 Min: 60.74 / Avg: 255.91 / Max: 343.2 Min: 149.89 / Avg: 459.2 / Max: 669.79 Min: 71.42 / Avg: 242.48 / Max: 294.63 Min: 179.1 / Avg: 476.05 / Max: 713.49 Min: 72.35 / Avg: 253.17 / Max: 324.27 Min: 188.58 / Avg: 496.58 / Max: 737.62 Min: 100.78 / Avg: 417.23 / Max: 578.66 Min: 52.99 / Avg: 229.13 / Max: 286.06 Min: 64.39 / Avg: 387.38 / Max: 798.84 Min: 29.7 / Avg: 237.41 / Max: 409.16 Min: 26.83 / Avg: 194.1 / Max: 318.58 Min: 53.82 / Avg: 332.37 / Max: 634.66 Min: 19.01 / Avg: 162.7 / Max: 323.16 Min: 39.64 / Avg: 293.27 / Max: 587.35 Min: 18.42 / Avg: 106.48 / Max: 155.79 Min: 17.11 / Avg: 94.19 / Max: 135.5 Min: 105.45 / Avg: 300.28 / Max: 380.11 Min: 43.57 / Avg: 157.01 / Max: 182.38 Min: 43.42 / Avg: 196.03 / Max: 231.39 Min: 107.92 / Avg: 357 / Max: 473.69 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 3323 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 2829 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 3583 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 4854 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 4062 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 5475 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 3899 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 5545 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 5619 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 4812 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 2970 Joules per run. 12. EPYC 9684X: Approximate power consumption of 2228 Joules per run. 13. EPYC 9654: Approximate power consumption of 1913 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 2582 Joules per run. 15. EPYC 9754: Approximate power consumption of 1247 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 2327 Joules per run. 17. EPYC 8534P: Approximate power consumption of 1224 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1162 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 4384 Joules per run. 20. Xeon 6766E: Approximate power consumption of 3873 Joules per run. 21. Xeon 6780E: Approximate power consumption of 4378 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 4903 Joules per run.
OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 1300 2600 3900 5200 6500 SE +/- 25.44, N = 8 SE +/- 5.07, N = 6 SE +/- 15.23, N = 5 SE +/- 20.15, N = 7 SE +/- 2.91, N = 4 SE +/- 32.01, N = 12 SE +/- 21.10, N = 15 SE +/- 46.19, N = 12 SE +/- 29.84, N = 15 SE +/- 9.38, N = 9 SE +/- 153.85, N = 12 SE +/- 81.83, N = 13 SE +/- 29.52, N = 7 SE +/- 74.36, N = 13 SE +/- 17.54, N = 9 SE +/- 99.42, N = 15 SE +/- 0.97, N = 6 SE +/- 0.82, N = 6 SE +/- 1.36, N = 5 SE +/- 0.46, N = 3 SE +/- 0.29, N = 3 SE +/- 11.58, N = 15 4993.34 2659.88 2071.19 3340.69 1590.50 2709.93 1771.07 2872.56 2132.24 1181.49 5915.25 3798.70 3423.63 5446.16 5747.82 5365.42 2683.83 2455.16 1915.04 979.28 1088.83 2108.68 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 3K 6K 9K 12K 15K SE +/- 6.25, N = 3 SE +/- 0.73, N = 3 SE +/- 0.81, N = 3 SE +/- 11.51, N = 3 SE +/- 8.09, N = 3 SE +/- 4.11, N = 3 SE +/- 5.68, N = 3 SE +/- 8.70, N = 3 SE +/- 2.84, N = 3 SE +/- 1.06, N = 3 SE +/- 4.04, N = 3 SE +/- 3.54, N = 3 SE +/- 8.39, N = 3 SE +/- 4.21, N = 3 SE +/- 66.33, N = 15 SE +/- 1.24, N = 3 SE +/- 2.22, N = 3 SE +/- 2.89, N = 3 SE +/- 8.74, N = 3 SE +/- 1.12, N = 3 SE +/- 2.61, N = 3 SE +/- 5.08, N = 3 8719.37 4656.92 3325.90 5483.81 2935.47 5576.86 2877.32 5525.56 4390.81 2120.33 11735.42 6017.19 5528.15 10708.91 5778.51 12750.59 2943.08 2763.48 4376.09 2366.83 2553.55 4992.78 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
NAS Parallel Benchmarks NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: LU.C Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 130K 260K 390K 520K 650K SE +/- 726.00, N = 5 SE +/- 213.44, N = 5 SE +/- 130.20, N = 4 SE +/- 398.40, N = 5 SE +/- 71.37, N = 3 SE +/- 441.66, N = 5 SE +/- 37.04, N = 4 SE +/- 411.20, N = 5 SE +/- 155.95, N = 4 SE +/- 123.65, N = 3 SE +/- 1879.23, N = 6 SE +/- 1849.65, N = 6 SE +/- 789.76, N = 5 SE +/- 4162.49, N = 6 SE +/- 2566.89, N = 15 SE +/- 5800.63, N = 15 SE +/- 314.42, N = 4 SE +/- 274.93, N = 3 455312.09 232012.77 135125.15 261127.09 126171.52 246822.52 131606.86 257384.55 185954.54 98557.16 551955.55 362511.43 269047.28 472931.04 279397.45 588329.32 133284.46 130839.12 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6 Total Mop/s Per Watt
OpenBenchmarking.org Total Mop/s Per Watt, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: LU.C Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 400 800 1200 1600 2000 1127.30 960.89 503.44 522.54 449.46 459.15 449.20 478.19 445.10 422.75 1398.79 1613.95 1333.71 1335.18 1409.22 1808.53 1120.43 1212.35 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better NAS Parallel Benchmarks 3.4 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 130 260 390 520 650 Min: 67.67 / Avg: 403.9 / Max: 715.05 Min: 26.25 / Avg: 241.46 / Max: 364.07 Min: 59.44 / Avg: 268.4 / Max: 328.81 Min: 157.28 / Avg: 499.73 / Max: 701.36 Min: 74.49 / Avg: 280.72 / Max: 336.16 Min: 194.99 / Avg: 537.56 / Max: 710.4 Min: 76.87 / Avg: 292.98 / Max: 353.23 Min: 196.19 / Avg: 538.25 / Max: 736.91 Min: 99.57 / Avg: 417.78 / Max: 563.12 Min: 51.86 / Avg: 233.13 / Max: 282.84 Min: 65.04 / Avg: 394.59 / Max: 765.59 Min: 32.65 / Avg: 224.61 / Max: 370.12 Min: 26.14 / Avg: 201.73 / Max: 306.76 Min: 56.83 / Avg: 354.21 / Max: 638.12 Min: 21.38 / Avg: 198.26 / Max: 322.68 Min: 40.45 / Avg: 325.31 / Max: 668.91 Min: 17.95 / Avg: 118.96 / Max: 149.72 Min: 17.84 / Avg: 107.92 / Max: 134.69 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 5574 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 3525 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 5435 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 7296 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 5989 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 7741 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 6006 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 7536 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 6893 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 5906 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 4341 Joules per run. 12. EPYC 9684X: Approximate power consumption of 2433 Joules per run. 13. EPYC 9654: Approximate power consumption of 2582 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 4132 Joules per run. 15. EPYC 9754: Approximate power consumption of 2657 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 5248 Joules per run. 17. EPYC 8534P: Approximate power consumption of 2439 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 2230 Joules per run.
OSPRay Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: particle_volume/scivis/real_time Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 13 26 39 52 65 SE +/- 0.04682, N = 3 SE +/- 0.04057, N = 3 SE +/- 0.00525, N = 3 SE +/- 0.02499, N = 3 SE +/- 0.00932, N = 3 SE +/- 0.05872, N = 3 SE +/- 0.03593, N = 3 SE +/- 0.04134, N = 3 SE +/- 0.03711, N = 3 SE +/- 0.00909, N = 3 SE +/- 0.01792, N = 3 SE +/- 0.01858, N = 3 SE +/- 0.01265, N = 3 SE +/- 0.04960, N = 3 SE +/- 0.02252, N = 3 SE +/- 0.01106, N = 3 SE +/- 0.01395, N = 3 SE +/- 0.00583, N = 3 SE +/- 0.04097, N = 3 SE +/- 0.00610, N = 3 SE +/- 0.01460, N = 3 SE +/- 0.02131, N = 3 53.93480 30.67990 21.89320 38.22690 16.08690 29.34960 18.48510 33.12750 17.62220 9.70022 55.25760 32.52320 28.06890 47.52670 35.14640 56.44850 17.94480 16.45050 32.79790 19.42510 21.51470 36.24640 Items Per Second Per Watt
OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 3.1 Benchmark: particle_volume/scivis/real_time Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0326 0.0652 0.0978 0.1304 0.163 0.091 0.106 0.074 0.061 0.063 0.047 0.061 0.053 0.039 0.041 0.081 0.098 0.107 0.086 0.133 0.107 0.139 0.145 0.106 0.136 0.121 0.094 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OSPRay 3.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 67.98 / Avg: 591.05 / Max: 725.39 Min: 25.32 / Avg: 288.49 / Max: 368.86 Min: 59.59 / Avg: 296.81 / Max: 366.58 Min: 168.54 / Avg: 625.45 / Max: 728.13 Min: 74.87 / Avg: 255.3 / Max: 321.66 Min: 191.04 / Avg: 627.62 / Max: 711.24 Min: 76.7 / Avg: 301.86 / Max: 366.25 Min: 200.54 / Avg: 630.06 / Max: 725.99 Min: 95.5 / Avg: 453.46 / Max: 555.04 Min: 52.66 / Avg: 239.04 / Max: 286.42 Min: 67.89 / Avg: 682.63 / Max: 796.5 Min: 35.05 / Avg: 332.91 / Max: 399.84 Min: 28.04 / Avg: 261.28 / Max: 302.78 Min: 60.52 / Avg: 553.25 / Max: 625.16 Min: 22.25 / Avg: 264.01 / Max: 319.18 Min: 42.57 / Avg: 526.9 / Max: 623.56 Min: 18.42 / Avg: 129.01 / Max: 155.58 Min: 16.2 / Avg: 113.27 / Max: 134.96 Min: 105.71 / Avg: 310.52 / Max: 393.05 Min: 43.64 / Avg: 142.92 / Max: 193.36 Min: 43.6 / Avg: 178.41 / Max: 247.31 Min: 108.67 / Avg: 386.65 / Max: 484.75 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 102843 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 48947 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 43532 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 119670 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 38295 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 108998 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 44876 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 106690 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 68321 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 38087 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 116729 Joules per run. 12. EPYC 9684X: Approximate power consumption of 55707 Joules per run. 13. EPYC 9654: Approximate power consumption of 45026 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 98478 Joules per run. 15. EPYC 9754: Approximate power consumption of 51481 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 90802 Joules per run. 17. EPYC 8534P: Approximate power consumption of 19093 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 16915 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 54134 Joules per run. 20. Xeon 6766E: Approximate power consumption of 21534 Joules per run. 21. Xeon 6780E: Approximate power consumption of 26642 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 76300 Joules per run.
OpenSSL OpenSSL is an open-source toolkit that implements SSL (Secure Sockets Layer) and TLS (Transport Layer Security) protocols. This test profile makes use of the built-in "openssl speed" benchmarking capabilities. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: AES-128-GCM Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 500000M 1000000M 1500000M 2000000M 2500000M SE +/- 1622921637.03, N = 3 SE +/- 1253503549.61, N = 3 SE +/- 28627701.54, N = 3 SE +/- 159598753.20, N = 3 SE +/- 43545680.66, N = 3 SE +/- 268465891.11, N = 3 SE +/- 56355870.99, N = 3 SE +/- 697208281.49, N = 3 SE +/- 266669781.18, N = 3 SE +/- 706172241.68, N = 3 SE +/- 1428966819.54, N = 3 SE +/- 570058274.06, N = 3 SE +/- 164763342.54, N = 3 SE +/- 337702856.52, N = 3 SE +/- 49279694.68, N = 3 SE +/- 1841260363.24, N = 3 SE +/- 530918594.60, N = 3 SE +/- 409615403.40, N = 3 SE +/- 429428665.34, N = 3 SE +/- 195953395.92, N = 3 SE +/- 129279575.06, N = 3 SE +/- 333650111.34, N = 3 1769313146013 889567506540 768804693697 1533026300727 641200848170 1277583382757 747710702660 1484669627050 807229265300 399526815427 1990352059967 996007109267 897288436123 1785006879067 1167221141870 2316611945283 539784931373 488965390857 1096082199713 565720767783 638453203763 1266882866653 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl byte/s Per Watt
OpenBenchmarking.org byte/s Per Watt, More Is Better OpenSSL 3.3 Algorithm: AES-128-GCM Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 700M 1400M 2100M 2800M 3500M 2589909503.87 2600338214.73 2333237948.27 2275619248.61 2035473064.32 1967868118.18 2214398499.06 2168460340.43 1525932773.14 1510207805.12 2480518885.86 2482510440.03 2686039538.13 2638396952.00 3351926704.37 3291374680.15 3225126995.22 3483917754.10 2230951841.30 2305290901.87 1970077384.37 1953802430.20 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OpenSSL 3.3 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 68.61 / Avg: 683.16 / Max: 735.37 Min: 21.98 / Avg: 342.1 / Max: 376.9 Min: 57.48 / Avg: 329.5 / Max: 379.19 Min: 164.19 / Avg: 673.67 / Max: 754.31 Min: 72.06 / Avg: 315.01 / Max: 350.37 Min: 201.68 / Avg: 649.22 / Max: 717.93 Min: 73.91 / Avg: 337.66 / Max: 377.26 Min: 187.64 / Avg: 684.67 / Max: 756.52 Min: 101.06 / Avg: 529.01 / Max: 581.52 Min: 54.11 / Avg: 264.55 / Max: 290.68 Min: 68.36 / Avg: 802.39 / Max: 822.1 Min: 34.83 / Avg: 401.21 / Max: 411.04 Min: 28.74 / Avg: 334.06 / Max: 354.77 Min: 56.69 / Avg: 676.55 / Max: 719.01 Min: 22.8 / Avg: 348.22 / Max: 361.46 Min: 40.47 / Avg: 703.84 / Max: 726.54 Min: 17.13 / Avg: 167.37 / Max: 173.46 Min: 17.62 / Avg: 140.35 / Max: 146.9 Min: 109.26 / Avg: 491.31 / Max: 541.12 Min: 43.71 / Avg: 245.4 / Max: 270.99 Min: 43.57 / Avg: 324.08 / Max: 356.29 Min: 110.15 / Avg: 648.42 / Max: 712.91 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 125701 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 62946 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 60628 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 124630 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 58067 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 119024 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 62017 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 125750 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 97161 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 48677 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 145768 Joules per run. 12. EPYC 9684X: Approximate power consumption of 73421 Joules per run. 13. EPYC 9654: Approximate power consumption of 61132 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 123358 Joules per run. 15. EPYC 9754: Approximate power consumption of 63841 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 128099 Joules per run. 17. EPYC 8534P: Approximate power consumption of 30684 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 25777 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 90400 Joules per run. 20. Xeon 6766E: Approximate power consumption of 45154 Joules per run. 21. Xeon 6780E: Approximate power consumption of 59522 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 118877 Joules per run.
OSPRay Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: particle_volume/ao/real_time Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 13 26 39 52 65 SE +/- 0.07203, N = 3 SE +/- 0.01144, N = 3 SE +/- 0.00975, N = 3 SE +/- 0.02269, N = 3 SE +/- 0.03513, N = 3 SE +/- 0.01945, N = 3 SE +/- 0.01050, N = 3 SE +/- 0.00297, N = 3 SE +/- 0.03319, N = 3 SE +/- 0.05948, N = 3 SE +/- 0.02899, N = 3 SE +/- 0.01754, N = 3 SE +/- 0.01424, N = 3 SE +/- 0.01406, N = 3 SE +/- 0.03039, N = 3 SE +/- 0.01800, N = 3 SE +/- 0.02190, N = 3 SE +/- 0.04390, N = 3 SE +/- 0.03817, N = 3 SE +/- 0.02488, N = 3 SE +/- 0.01225, N = 3 SE +/- 0.03595, N = 3 54.11950 30.84040 21.93240 38.22350 16.05020 29.50180 18.55330 33.11250 17.82690 9.77764 55.33820 32.51880 28.09560 47.61430 35.24610 56.69360 17.96680 16.45040 32.96630 19.51590 21.62220 36.50430 Items Per Second Per Watt
OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 3.1 Benchmark: particle_volume/ao/real_time Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.029 0.058 0.087 0.116 0.145 0.080 0.091 0.065 0.056 0.060 0.043 0.056 0.049 0.034 0.037 0.072 0.085 0.096 0.079 0.114 0.095 0.121 0.129 0.087 0.107 0.092 0.079 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OSPRay 3.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 77.58 / Avg: 677.36 / Max: 715.65 Min: 35 / Avg: 338.48 / Max: 364.64 Min: 59.83 / Avg: 336.31 / Max: 366.79 Min: 176.11 / Avg: 681.46 / Max: 714.09 Min: 74.5 / Avg: 268.43 / Max: 329.84 Min: 200.34 / Avg: 682.67 / Max: 705.07 Min: 78.47 / Avg: 334.1 / Max: 367.59 Min: 195.3 / Avg: 681.19 / Max: 725.09 Min: 103.11 / Avg: 521.41 / Max: 554.74 Min: 53.36 / Avg: 261.49 / Max: 284.07 Min: 61.93 / Avg: 764.28 / Max: 797.27 Min: 36.05 / Avg: 383.1 / Max: 399.03 Min: 28.62 / Avg: 291.85 / Max: 303.75 Min: 60.35 / Avg: 600.41 / Max: 624.73 Min: 23.11 / Avg: 308.84 / Max: 321.58 Min: 42.49 / Avg: 596.49 / Max: 627.65 Min: 17.75 / Avg: 148.12 / Max: 155.49 Min: 16.71 / Avg: 127.12 / Max: 134.69 Min: 106.01 / Avg: 377.24 / Max: 400.35 Min: 43.7 / Avg: 183.09 / Max: 194.2 Min: 43.56 / Avg: 235.42 / Max: 250.81 Min: 108.67 / Avg: 463.55 / Max: 488.13 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 85800 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 41295 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 32622 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 96994 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 27111 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 84423 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 33187 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 78791 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 51967 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 28328 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 95026 Joules per run. 12. EPYC 9684X: Approximate power consumption of 45845 Joules per run. 13. EPYC 9654: Approximate power consumption of 36384 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 78253 Joules per run. 15. EPYC 9754: Approximate power consumption of 44885 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 74163 Joules per run. 17. EPYC 8534P: Approximate power consumption of 14664 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 12754 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 45772 Joules per run. 20. Xeon 6766E: Approximate power consumption of 18065 Joules per run. 21. Xeon 6780E: Approximate power consumption of 22914 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 67214 Joules per run.
Llamafile Mozilla's Llamafile allows distributing and running large language models (LLMs) as a single file. Llamafile aims to make open-source LLMs more accessible to developers and users. Llamafile supports a variety of models, CPUs and GPUs, and other options. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.7 Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.12, N = 6 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 3.05 4.08 5.85 3.82 1.47 1.77 1.54 1.54 3.10 4.41 5.24 8.48 8.35 5.24 7.47 4.63 5.16 5.11 2.56 5.39 5.58 2.67 Tokens Per Second Per Watt
OpenBenchmarking.org Tokens Per Second Per Watt, More Is Better Llamafile 0.7 Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0099 0.0198 0.0297 0.0396 0.0495 0.005 0.013 0.018 0.006 0.005 0.003 0.005 0.002 0.006 0.018 0.009 0.029 0.034 0.011 0.037 0.011 0.038 0.044 0.007 0.031 0.028 0.007 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Llamafile 0.7 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 85.64 / Avg: 568.91 / Max: 665.68 Min: 33.89 / Avg: 307.46 / Max: 338.87 Min: 53.92 / Avg: 317.1 / Max: 376.78 Min: 170.34 / Avg: 630.52 / Max: 723.74 Min: 72.56 / Avg: 306.79 / Max: 356.97 Min: 203.4 / Avg: 633.28 / Max: 704.68 Min: 86.22 / Avg: 325.29 / Max: 362.03 Min: 184.95 / Avg: 639.77 / Max: 696.32 Min: 101.74 / Avg: 484.21 / Max: 566.46 Min: 51.16 / Avg: 250.18 / Max: 288.75 Min: 65.77 / Avg: 568.13 / Max: 708.34 Min: 29.28 / Avg: 296.68 / Max: 399.75 Min: 30.07 / Avg: 245.28 / Max: 317.66 Min: 58.45 / Avg: 480.08 / Max: 600.8 Min: 21.63 / Avg: 203.84 / Max: 298.7 Min: 41.26 / Avg: 412.48 / Max: 564 Min: 17.14 / Avg: 135.55 / Max: 164.93 Min: 16.37 / Avg: 115.77 / Max: 139.52 Min: 105.02 / Avg: 350.49 / Max: 483.96 Min: 43.73 / Avg: 175.78 / Max: 254.24 Min: 43.53 / Avg: 201.04 / Max: 326.57 Min: 108.26 / Avg: 383.74 / Max: 590.61 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 77183 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 31976 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 24311 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 69987 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 81913 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 142698 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 83491 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 168578 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 64562 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 24518 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 47912 Joules per run. 12. EPYC 9684X: Approximate power consumption of 17009 Joules per run. 13. EPYC 9654: Approximate power consumption of 14308 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 40326 Joules per run. 15. EPYC 9754: Approximate power consumption of 13182 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 39048 Joules per run. 17. EPYC 8534P: Approximate power consumption of 11883 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 10227 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 60402 Joules per run. 20. Xeon 6766E: Approximate power consumption of 15468 Joules per run. 21. Xeon 6780E: Approximate power consumption of 17021 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 63573 Joules per run.
OSPRay Studio Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 700 1400 2100 2800 3500 SE +/- 0.88, N = 3 SE +/- 0.88, N = 3 SE +/- 0.58, N = 3 SE +/- 0.58, N = 3 SE +/- 0.33, N = 3 SE +/- 1.76, N = 3 SE +/- 0.58, N = 3 SE +/- 0.58, N = 3 SE +/- 0.33, N = 3 SE +/- 4.62, N = 3 SE +/- 1.20, N = 3 SE +/- 1.15, N = 3 SE +/- 0.58, N = 3 SE +/- 0.58, N = 3 SE +/- 1.20, N = 3 SE +/- 0.88, N = 3 SE +/- 0.58, N = 3 SE +/- 1.20, N = 3 SE +/- 21.79, N = 12 SE +/- 7.84, N = 3 SE +/- 11.06, N = 3 SE +/- 24.01, N = 12 759 1441 1657 894 1988 1049 1792 961 1553 3052 561 1037 1180 661 954 531 2043 2240 1497 2318 2090 1342 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 1.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 81.36 / Avg: 571.36 / Max: 749.47 Min: 35.06 / Avg: 288.94 / Max: 377.45 Min: 60.62 / Avg: 292.35 / Max: 377.02 Min: 171.28 / Avg: 584.71 / Max: 751.6 Min: 74.38 / Avg: 304.87 / Max: 378.48 Min: 203.09 / Avg: 603.55 / Max: 753.72 Min: 75.94 / Avg: 303.61 / Max: 375.87 Min: 198.09 / Avg: 602.84 / Max: 752.6 Min: 104.51 / Avg: 436.59 / Max: 581.52 Min: 52 / Avg: 225.09 / Max: 290.77 Min: 62.5 / Avg: 640.62 / Max: 822.3 Min: 34.89 / Avg: 319.28 / Max: 410.78 Min: 29.72 / Avg: 259.52 / Max: 331.33 Min: 57.88 / Avg: 533.99 / Max: 677.83 Min: 22.93 / Avg: 248.39 / Max: 335.61 Min: 41.9 / Avg: 518.09 / Max: 690.69 Min: 18.36 / Avg: 131.28 / Max: 167.17 Min: 16.85 / Avg: 112.81 / Max: 142.09 Min: 56.57 / Avg: 313.79 / Max: 485.54 Min: 43.68 / Avg: 147 / Max: 223.13 Min: 43.56 / Avg: 188.73 / Max: 285.39 Min: 108 / Avg: 365.31 / Max: 571.25 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 38091 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 20418 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21147 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 40735 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 22662 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 42449 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 22062 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 41596 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 32598 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 18457 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 43135 Joules per run. 12. EPYC 9684X: Approximate power consumption of 22350 Joules per run. 13. EPYC 9654: Approximate power consumption of 18339 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 36133 Joules per run. 15. EPYC 9754: Approximate power consumption of 17553 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 36957 Joules per run. 17. EPYC 8534P: Approximate power consumption of 10327 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 8987 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 26698 Joules per run. 20. Xeon 6766E: Approximate power consumption of 12446 Joules per run. 21. Xeon 6780E: Approximate power consumption of 15476 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 29803 Joules per run.
Result
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 800 1600 2400 3200 4000 SE +/- 0.00, N = 3 SE +/- 1.45, N = 3 SE +/- 0.88, N = 3 SE +/- 0.88, N = 3 SE +/- 1.20, N = 3 SE +/- 2.65, N = 3 SE +/- 1.20, N = 3 SE +/- 0.33, N = 3 SE +/- 2.73, N = 3 SE +/- 3.79, N = 3 SE +/- 1.45, N = 3 SE +/- 1.53, N = 3 SE +/- 1.00, N = 3 SE +/- 0.58, N = 3 SE +/- 0.88, N = 3 SE +/- 0.67, N = 3 SE +/- 1.00, N = 3 SE +/- 3.06, N = 3 SE +/- 4.67, N = 3 SE +/- 6.23, N = 3 SE +/- 3.51, N = 3 SE +/- 16.65, N = 5 898 1709 1977 1063 2357 1237 2123 1143 1833 3616 660 1225 1391 780 1130 630 2421 2649 1832 2731 2472 1631 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 1.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 79.09 / Avg: 574.5 / Max: 751.34 Min: 26.01 / Avg: 290.77 / Max: 377.76 Min: 61.31 / Avg: 293.93 / Max: 377.6 Min: 179.12 / Avg: 588.21 / Max: 753.37 Min: 71.66 / Avg: 307.39 / Max: 377.12 Min: 204.32 / Avg: 605.57 / Max: 755.38 Min: 74.64 / Avg: 306.2 / Max: 376.48 Min: 208.56 / Avg: 606.68 / Max: 753.95 Min: 103.42 / Avg: 440.54 / Max: 582.66 Min: 54.18 / Avg: 227.88 / Max: 291.87 Min: 67.19 / Avg: 642.74 / Max: 821.11 Min: 30.75 / Avg: 323.21 / Max: 411.04 Min: 31.26 / Avg: 263.32 / Max: 331.82 Min: 59.99 / Avg: 534.76 / Max: 676.92 Min: 22.69 / Avg: 249.28 / Max: 335.5 Min: 42.39 / Avg: 515 / Max: 688.22 Min: 18.61 / Avg: 131.5 / Max: 167.12 Min: 17.17 / Avg: 114.16 / Max: 142.74 Min: 105.7 / Avg: 310.43 / Max: 465.96 Min: 43.67 / Avg: 146.96 / Max: 222.56 Min: 43.6 / Avg: 190.51 / Max: 286.01 Min: 108.07 / Avg: 363.45 / Max: 555.01 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 38874 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 21130 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21849 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 41763 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 23772 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 43197 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 23169 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 42670 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 33628 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 19522 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 43492 Joules per run. 12. EPYC 9684X: Approximate power consumption of 22948 Joules per run. 13. EPYC 9654: Approximate power consumption of 18959 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 36185 Joules per run. 15. EPYC 9754: Approximate power consumption of 17948 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 35879 Joules per run. 17. EPYC 8534P: Approximate power consumption of 10432 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 9285 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 26904 Joules per run. 20. Xeon 6766E: Approximate power consumption of 12247 Joules per run. 21. Xeon 6780E: Approximate power consumption of 15939 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 30385 Joules per run.
OpenSSL OpenSSL is an open-source toolkit that implements SSL (Secure Sockets Layer) and TLS (Transport Layer Security) protocols. This test profile makes use of the built-in "openssl speed" benchmarking capabilities. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: AES-256-GCM Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 400000M 800000M 1200000M 1600000M 2000000M SE +/- 1320809584.03, N = 3 SE +/- 3966858436.56, N = 3 SE +/- 2848140790.67, N = 3 SE +/- 1397764228.85, N = 3 SE +/- 119857064.56, N = 3 SE +/- 108288170.03, N = 3 SE +/- 63026881.96, N = 3 SE +/- 112278705.55, N = 3 SE +/- 116420153.53, N = 3 SE +/- 81945775.93, N = 3 SE +/- 1859275059.09, N = 3 SE +/- 671752057.50, N = 3 SE +/- 818689705.82, N = 3 SE +/- 2225250504.62, N = 3 SE +/- 290015345.25, N = 3 SE +/- 1791964708.17, N = 3 SE +/- 148092414.72, N = 3 SE +/- 3442274884.66, N = 3 SE +/- 252081360.30, N = 3 SE +/- 34244051.67, N = 3 SE +/- 317370827.95, N = 3 SE +/- 301551944.80, N = 3 1497529939377 744387683670 700239352717 1369534328470 507456728087 1011898993323 592014115453 1181148957353 712485411447 356062040883 1714061761087 859720599963 767696553667 1526505465813 997539007873 1983103026700 462309750530 415893963207 979419388797 506301374623 568937578313 1125373041173 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl byte/s Per Watt
OpenBenchmarking.org byte/s Per Watt, More Is Better OpenSSL 3.3 Algorithm: AES-256-GCM Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 600M 1200M 1800M 2400M 3000M 2193171119.61 2177657519.61 2048623453.07 1998240264.78 1651813451.15 1587520126.44 1789501537.54 1745319585.66 1345006115.81 1344485766.05 2139406659.57 2144285710.42 2331206946.71 2286984508.79 2889219779.92 2844279712.45 2800094011.98 2991193842.10 1993158291.38 2061752146.93 1758065363.32 1735227671.90 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OpenSSL 3.3 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 67.1 / Avg: 682.81 / Max: 732.1 Min: 23.55 / Avg: 341.83 / Max: 377.46 Min: 57.11 / Avg: 341.81 / Max: 377.46 Min: 152.63 / Avg: 685.37 / Max: 754.67 Min: 69.15 / Avg: 307.21 / Max: 344.49 Min: 186.02 / Avg: 637.41 / Max: 707.3 Min: 76.66 / Avg: 330.83 / Max: 377.06 Min: 191.65 / Avg: 676.75 / Max: 755.44 Min: 103.41 / Avg: 529.73 / Max: 581.31 Min: 52.04 / Avg: 264.83 / Max: 290.23 Min: 64.77 / Avg: 801.19 / Max: 822.22 Min: 34.11 / Avg: 400.94 / Max: 411.04 Min: 29.29 / Avg: 329.31 / Max: 350.94 Min: 59.32 / Avg: 667.48 / Max: 710.25 Min: 22.57 / Avg: 345.26 / Max: 357.86 Min: 42.68 / Avg: 697.23 / Max: 724.85 Min: 17.84 / Avg: 165.11 / Max: 170.43 Min: 16.68 / Avg: 139.04 / Max: 145.32 Min: 108.93 / Avg: 491.39 / Max: 542.48 Min: 43.78 / Avg: 245.57 / Max: 271.22 Min: 43.56 / Avg: 323.62 / Max: 356.6 Min: 109.57 / Avg: 648.54 / Max: 712.9 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 125638 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 62897 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 63007 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 126108 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 56425 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 117496 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 60872 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 124297 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 97470 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 48729 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 145549 Joules per run. 12. EPYC 9684X: Approximate power consumption of 73238 Joules per run. 13. EPYC 9654: Approximate power consumption of 60264 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 121703 Joules per run. 15. EPYC 9754: Approximate power consumption of 63298 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 126895 Joules per run. 17. EPYC 8534P: Approximate power consumption of 30324 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 25537 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 90416 Joules per run. 20. Xeon 6766E: Approximate power consumption of 45185 Joules per run. 21. Xeon 6780E: Approximate power consumption of 59653 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 118900 Joules per run.
Primesieve Primesieve generates prime numbers using a highly optimized sieve of Eratosthenes implementation. Primesieve primarily benchmarks the CPU's L1/L2 cache performance. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Primesieve 12.1 Length: 1e12 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 2 4 6 8 10 SE +/- 0.008, N = 11 SE +/- 0.007, N = 8 SE +/- 0.019, N = 8 SE +/- 0.006, N = 10 SE +/- 0.006, N = 7 SE +/- 0.004, N = 9 SE +/- 0.010, N = 7 SE +/- 0.005, N = 10 SE +/- 0.003, N = 9 SE +/- 0.006, N = 6 SE +/- 0.003, N = 12 SE +/- 0.004, N = 11 SE +/- 0.003, N = 11 SE +/- 0.005, N = 12 SE +/- 0.002, N = 11 SE +/- 0.010, N = 15 SE +/- 0.006, N = 8 SE +/- 0.003, N = 8 SE +/- 0.012, N = 10 SE +/- 0.003, N = 8 SE +/- 0.003, N = 8 SE +/- 0.008, N = 10 2.187 4.250 4.576 2.325 6.160 3.121 5.332 2.691 3.366 6.673 1.199 1.984 2.058 1.242 1.921 1.359 3.801 4.545 2.605 4.806 4.324 2.337 1. (CXX) g++ options: -O3 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Primesieve 12.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 70.6 / Avg: 304.92 / Max: 755.57 Min: 20.57 / Avg: 195.27 / Max: 377.63 Min: 53.72 / Avg: 216.08 / Max: 377.44 Min: 167.18 / Avg: 384.89 / Max: 756.1 Min: 41.72 / Avg: 247.24 / Max: 378.01 Min: 185.19 / Avg: 432.51 / Max: 754.28 Min: 75.05 / Avg: 240.32 / Max: 376.42 Min: 188 / Avg: 419.03 / Max: 755.09 Min: 99.97 / Avg: 315.19 / Max: 581.5 Min: 52.68 / Avg: 193.17 / Max: 291 Min: 65.08 / Avg: 239.55 / Max: 813.29 Min: 33.95 / Avg: 157.31 / Max: 410.23 Min: 26.05 / Avg: 142.51 / Max: 369.88 Min: 58.4 / Avg: 217.76 / Max: 736.92 Min: 21.44 / Avg: 116.27 / Max: 317.57 Min: 39.28 / Avg: 188.39 / Max: 630.34 Min: 16.53 / Avg: 87.74 / Max: 161.22 Min: 16.77 / Avg: 72.3 / Max: 123.74 Min: 104.53 / Avg: 228.57 / Max: 454.64 Min: 43.73 / Avg: 134.25 / Max: 215.68 Min: 43.47 / Avg: 160.81 / Max: 278.45 Min: 105.81 / Avg: 260.26 / Max: 569.59 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 1940 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 1635 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 1891 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 2502 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 2508 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 3028 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 2266 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 2849 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 2346 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 2061 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 1258 Joules per run. 12. EPYC 9684X: Approximate power consumption of 944 Joules per run. 13. EPYC 9654: Approximate power consumption of 868 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 1143 Joules per run. 15. EPYC 9754: Approximate power consumption of 687 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 1017 Joules per run. 17. EPYC 8534P: Approximate power consumption of 680 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 624 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 1531 Joules per run. 20. Xeon 6766E: Approximate power consumption of 1191 Joules per run. 21. Xeon 6780E: Approximate power consumption of 1347 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 1666 Joules per run.
Blender Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Junkshop - Compute: CPU-Only Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 14 28 42 56 70 SE +/- 0.09, N = 3 SE +/- 0.10, N = 3 SE +/- 0.24, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.10, N = 3 SE +/- 0.19, N = 3 SE +/- 0.10, N = 3 SE +/- 0.09, N = 3 SE +/- 0.08, N = 4 SE +/- 0.13, N = 3 SE +/- 0.06, N = 3 SE +/- 0.02, N = 4 SE +/- 0.08, N = 3 SE +/- 0.02, N = 4 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.11, N = 3 SE +/- 0.08, N = 3 SE +/- 0.03, N = 3 SE +/- 0.14, N = 3 18.31 32.08 35.96 21.15 42.85 24.99 39.17 23.45 33.20 61.22 11.47 18.65 21.02 12.87 17.70 11.21 35.82 38.86 18.70 29.06 26.49 16.89 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Blender 4.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 77.61 / Avg: 545.55 / Max: 722.02 Min: 24.83 / Avg: 303.23 / Max: 378.56 Min: 59.14 / Avg: 311.52 / Max: 376.21 Min: 169.62 / Avg: 575.47 / Max: 754.28 Min: 75.79 / Avg: 322.02 / Max: 374.53 Min: 206.83 / Avg: 603.68 / Max: 753.22 Min: 85.92 / Avg: 320.19 / Max: 376.39 Min: 208.58 / Avg: 605.47 / Max: 751.55 Min: 105.08 / Avg: 471.81 / Max: 581.38 Min: 51.88 / Avg: 251.6 / Max: 290.8 Min: 63.79 / Avg: 553.98 / Max: 822.05 Min: 35.12 / Avg: 316.57 / Max: 411.05 Min: 16.01 / Avg: 272.23 / Max: 337.39 Min: 59.75 / Avg: 483.45 / Max: 681.8 Min: 22.09 / Avg: 255.66 / Max: 340.71 Min: 39.86 / Avg: 438.61 / Max: 691.32 Min: 18.72 / Avg: 148.28 / Max: 170.5 Min: 18.29 / Avg: 127.16 / Max: 145.93 Min: 106.82 / Avg: 347.76 / Max: 500.93 Min: 43.7 / Avg: 186.05 / Max: 225.88 Min: 43.63 / Avg: 235.7 / Max: 293.05 Min: 107.64 / Avg: 397.69 / Max: 593.53 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 12548 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 11219 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 12772 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 15538 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 15242 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 18110 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 14088 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 17155 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 18086 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16606 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 9141 Joules per run. 12. EPYC 9684X: Approximate power consumption of 7492 Joules per run. 13. EPYC 9654: Approximate power consumption of 6987 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 8460 Joules per run. 15. EPYC 9754: Approximate power consumption of 5795 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 7018 Joules per run. 17. EPYC 8534P: Approximate power consumption of 6030 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 5510 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 8462 Joules per run. 20. Xeon 6766E: Approximate power consumption of 6326 Joules per run. 21. Xeon 6780E: Approximate power consumption of 7385 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 8882 Joules per run.
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 15 30 45 60 75 SE +/- 0.28, N = 3 SE +/- 0.02, N = 3 SE +/- 0.14, N = 3 SE +/- 0.03, N = 3 SE +/- 0.15, N = 3 SE +/- 0.05, N = 3 SE +/- 0.21, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.11, N = 3 SE +/- 0.02, N = 3 SE +/- 0.26, N = 15 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.11, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 57.13 55.07 55.99 65.02 55.74 56.71 62.53 62.11 16.84 31.05 11.95 21.63 27.46 14.30 38.21 15.84 31.99 34.76 41.50 38.87 35.30 37.17 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 81.23 / Avg: 641.35 / Max: 755.31 Min: 34.63 / Avg: 325.47 / Max: 376.24 Min: 59.15 / Avg: 327.9 / Max: 376.83 Min: 168.6 / Avg: 652.87 / Max: 754.8 Min: 74.41 / Avg: 330.18 / Max: 376.61 Min: 200.42 / Avg: 659.67 / Max: 754.38 Min: 84.64 / Avg: 330.18 / Max: 380.81 Min: 201 / Avg: 659.95 / Max: 753.12 Min: 99.46 / Avg: 509.59 / Max: 578.94 Min: 50.28 / Avg: 253.24 / Max: 288.06 Min: 67.8 / Avg: 760.09 / Max: 819.06 Min: 33.63 / Avg: 370.93 / Max: 400.44 Min: 30.63 / Avg: 302.4 / Max: 328.21 Min: 60.61 / Avg: 599.17 / Max: 650.25 Min: 21.36 / Avg: 269.44 / Max: 322.88 Min: 40.64 / Avg: 591.23 / Max: 648.1 Min: 16.37 / Avg: 152.34 / Max: 164.44 Min: 17.95 / Avg: 130.31 / Max: 141.74 Min: 106.85 / Avg: 458.61 / Max: 523.13 Min: 43.66 / Avg: 218.36 / Max: 239.94 Min: 43.56 / Avg: 269.61 / Max: 298.84 Min: 109.15 / Avg: 564.61 / Max: 636.36 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 43398 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 21373 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21641 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 44178 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 21682 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 43978 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 21792 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 44437 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 33123 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16545 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 49406 Joules per run. 12. EPYC 9684X: Approximate power consumption of 24110 Joules per run. 13. EPYC 9654: Approximate power consumption of 19656 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 39146 Joules per run. 15. EPYC 9754: Approximate power consumption of 17639 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 39218 Joules per run. 17. EPYC 8534P: Approximate power consumption of 9902 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 8514 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 31033 Joules per run. 20. Xeon 6766E: Approximate power consumption of 14412 Joules per run. 21. Xeon 6780E: Approximate power consumption of 17615 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 38017 Joules per run.
NAS Parallel Benchmarks NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: IS.D Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 3K 6K 9K 12K 15K SE +/- 155.00, N = 15 SE +/- 8.92, N = 4 SE +/- 6.56, N = 3 SE +/- 23.92, N = 4 SE +/- 15.55, N = 4 SE +/- 12.99, N = 4 SE +/- 18.08, N = 4 SE +/- 4.96, N = 4 SE +/- 8.35, N = 4 SE +/- 11.05, N = 3 SE +/- 119.22, N = 6 SE +/- 29.95, N = 5 SE +/- 17.53, N = 5 SE +/- 76.70, N = 10 SE +/- 35.67, N = 5 SE +/- 85.04, N = 8 SE +/- 9.85, N = 4 SE +/- 14.39, N = 4 7437.81 4059.70 2865.72 3960.28 3050.16 3816.70 3076.66 3819.83 3345.45 2266.32 12296.27 6346.15 5229.41 10139.69 5702.13 9771.41 2746.20 2718.94 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6 Total Mop/s Per Watt
OpenBenchmarking.org Total Mop/s Per Watt, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: IS.D Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 8 16 24 32 40 18.332 18.030 11.814 8.360 11.909 7.333 11.707 7.258 8.646 10.738 35.302 32.045 29.667 32.063 36.454 31.780 25.260 27.818 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better NAS Parallel Benchmarks 3.4 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 130 260 390 520 650 Min: 67.06 / Avg: 405.72 / Max: 726.27 Min: 25.68 / Avg: 225.16 / Max: 371.3 Min: 60.58 / Avg: 242.56 / Max: 344.06 Min: 145.91 / Avg: 473.71 / Max: 694.3 Min: 75.18 / Avg: 256.12 / Max: 347.73 Min: 196.72 / Avg: 520.51 / Max: 703.63 Min: 75.39 / Avg: 262.81 / Max: 362.43 Min: 196.74 / Avg: 526.3 / Max: 723.61 Min: 103.51 / Avg: 386.95 / Max: 547.42 Min: 54.69 / Avg: 211.05 / Max: 280.75 Min: 66.48 / Avg: 348.31 / Max: 715.01 Min: 32.82 / Avg: 198.04 / Max: 362.78 Min: 25.79 / Avg: 176.27 / Max: 304.26 Min: 54.94 / Avg: 316.24 / Max: 616.93 Min: 20.68 / Avg: 156.42 / Max: 284.24 Min: 41.36 / Avg: 307.47 / Max: 647.96 Min: 19.1 / Avg: 108.72 / Max: 150.47 Min: 9.26 / Avg: 97.74 / Max: 132.42 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 5869 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 3603 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 5094 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 8290 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 5250 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 8588 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 5322 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 8684 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 6675 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 5065 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 3890 Joules per run. 12. EPYC 9684X: Approximate power consumption of 2574 Joules per run. 13. EPYC 9654: Approximate power consumption of 2433 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 3637 Joules per run. 15. EPYC 9754: Approximate power consumption of 2065 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 5073 Joules per run. 17. EPYC 8534P: Approximate power consumption of 2066 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1882 Joules per run.
OSPRay Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 14 28 42 56 70 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.16, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.14, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.23, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 48.76 27.10 24.64 42.82 19.91 35.93 22.36 39.34 22.51 11.86 60.37 34.64 30.61 52.67 37.74 63.85 18.47 16.92 21.22 12.17 13.40 23.12 Items Per Second Per Watt
OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 3.1 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.032 0.064 0.096 0.128 0.16 0.077 0.088 0.079 0.068 0.063 0.055 0.070 0.060 0.047 0.049 0.084 0.094 0.112 0.091 0.130 0.111 0.135 0.142 0.061 0.079 0.069 0.058 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OSPRay 3.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 77.1 / Avg: 630.9 / Max: 750.84 Min: 26.13 / Avg: 308.08 / Max: 376.91 Min: 61.9 / Avg: 311.6 / Max: 375.6 Min: 174.41 / Avg: 631.92 / Max: 708.59 Min: 76.02 / Avg: 317.76 / Max: 373.98 Min: 206.3 / Avg: 652.41 / Max: 753.05 Min: 78.8 / Avg: 318.09 / Max: 375.14 Min: 207.37 / Avg: 650.92 / Max: 752.3 Min: 100.97 / Avg: 476.45 / Max: 565.54 Min: 53.09 / Avg: 241.12 / Max: 287.29 Min: 65.72 / Avg: 718.49 / Max: 821.14 Min: 35.77 / Avg: 367.12 / Max: 410.2 Min: 29.59 / Avg: 273.92 / Max: 319.11 Min: 60.47 / Avg: 577.89 / Max: 656.09 Min: 23.6 / Avg: 289.58 / Max: 332.39 Min: 42.2 / Avg: 573.28 / Max: 670.75 Min: 18.46 / Avg: 136.83 / Max: 158.83 Min: 16.8 / Avg: 119.14 / Max: 138.68 Min: 105.18 / Avg: 346.87 / Max: 441 Min: 43.64 / Avg: 154.91 / Max: 191.69 Min: 43.52 / Avg: 195.57 / Max: 243.19 Min: 107.82 / Avg: 395.24 / Max: 502.47 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 47948 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 17150 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 17761 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 50553 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 18112 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 55020 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 18025 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 53375 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 27316 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 14869 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 51013 Joules per run. 12. EPYC 9684X: Approximate power consumption of 31205 Joules per run. 13. EPYC 9654: Approximate power consumption of 15157 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 42764 Joules per run. 15. EPYC 9754: Approximate power consumption of 24325 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 40703 Joules per run. 17. EPYC 8534P: Approximate power consumption of 8073 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 7148 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 22315 Joules per run. 20. Xeon 6766E: Approximate power consumption of 10430 Joules per run. 21. Xeon 6780E: Approximate power consumption of 12777 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 24900 Joules per run.
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.12, N = 15 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 14.67 13.73 17.84 21.73 16.33 17.19 19.44 20.24 4.54 9.26 4.08 7.85 8.58 4.46 10.97 5.00 10.78 11.48 16.28 15.11 14.01 14.30 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 85.37 / Avg: 650.24 / Max: 758.93 Min: 33.71 / Avg: 302.37 / Max: 379.73 Min: 59.46 / Avg: 330.49 / Max: 383.24 Min: 169.19 / Avg: 657.97 / Max: 750.83 Min: 71.96 / Avg: 331 / Max: 377.8 Min: 209.95 / Avg: 663.67 / Max: 754.1 Min: 75.87 / Avg: 332.1 / Max: 380.66 Min: 203.39 / Avg: 666.38 / Max: 758.84 Min: 100.89 / Avg: 510.45 / Max: 581 Min: 49.67 / Avg: 255.11 / Max: 289.85 Min: 68.28 / Avg: 749.07 / Max: 815.77 Min: 34.99 / Avg: 371.14 / Max: 399.65 Min: 29.58 / Avg: 315.71 / Max: 340.19 Min: 60.42 / Avg: 615.26 / Max: 666.72 Min: 21.25 / Avg: 305.35 / Max: 334.91 Min: 43.09 / Avg: 614.49 / Max: 665.93 Min: 17.62 / Avg: 156.89 / Max: 169.02 Min: 17.95 / Avg: 132.64 / Max: 143.89 Min: 107.07 / Avg: 468.4 / Max: 537.67 Min: 43.79 / Avg: 234.55 / Max: 257.28 Min: 43.53 / Avg: 284.95 / Max: 316.24 Min: 110.43 / Avg: 596.74 / Max: 654.1 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 43133 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 21468 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21482 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 43645 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 21404 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 43360 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 21586 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 43314 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 33009 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16497 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 48190 Joules per run. 12. EPYC 9684X: Approximate power consumption of 23877 Joules per run. 13. EPYC 9654: Approximate power consumption of 20311 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 39787 Joules per run. 15. EPYC 9754: Approximate power consumption of 19746 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 39942 Joules per run. 17. EPYC 8534P: Approximate power consumption of 10146 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 8578 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 30602 Joules per run. 20. Xeon 6766E: Approximate power consumption of 15246 Joules per run. 21. Xeon 6780E: Approximate power consumption of 18427 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 39385 Joules per run.
Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 6 12 18 24 30 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.00, N = 3 SE +/- 0.11, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 11.69 11.17 16.50 15.04 12.54 13.34 13.59 14.42 9.82 18.08 4.91 8.48 9.47 5.20 11.35 6.27 11.22 12.67 26.12 25.33 23.49 24.24 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 84.22 / Avg: 639.31 / Max: 759.19 Min: 33.49 / Avg: 325.49 / Max: 379.56 Min: 60.78 / Avg: 328.2 / Max: 380.56 Min: 174.42 / Avg: 651.12 / Max: 753.13 Min: 73.58 / Avg: 327.03 / Max: 377.73 Min: 206.04 / Avg: 658.8 / Max: 752.52 Min: 83.78 / Avg: 329.87 / Max: 374.74 Min: 204.78 / Avg: 655.73 / Max: 753.37 Min: 101.65 / Avg: 506.94 / Max: 559.01 Min: 50.78 / Avg: 254.29 / Max: 289.74 Min: 70.55 / Avg: 710.38 / Max: 794.96 Min: 34.6 / Avg: 368.08 / Max: 403.09 Min: 29.5 / Avg: 315.59 / Max: 344.89 Min: 35.7 / Avg: 634.64 / Max: 688.41 Min: 22.15 / Avg: 293.51 / Max: 329.03 Min: 43.98 / Avg: 604.36 / Max: 672.48 Min: 18.03 / Avg: 158.07 / Max: 171.2 Min: 15.14 / Avg: 128.27 / Max: 140.82 Min: 107.91 / Avg: 444.05 / Max: 496.43 Min: 43.71 / Avg: 214.7 / Max: 232.23 Min: 43.7 / Avg: 257.32 / Max: 280.77 Min: 110.24 / Avg: 513.09 / Max: 584.23 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 43686 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 21482 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21661 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 44493 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 21475 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 44140 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 21661 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 44590 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 33120 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16444 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 46648 Joules per run. 12. EPYC 9684X: Approximate power consumption of 24048 Joules per run. 13. EPYC 9654: Approximate power consumption of 20724 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 41675 Joules per run. 15. EPYC 9754: Approximate power consumption of 19371 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 40291 Joules per run. 17. EPYC 8534P: Approximate power consumption of 10327 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 8380 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 30491 Joules per run. 20. Xeon 6766E: Approximate power consumption of 14098 Joules per run. 21. Xeon 6780E: Approximate power consumption of 16897 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 35232 Joules per run.
PyTorch This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark]. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 20 40 60 80 100 SE +/- 0.52, N = 3 SE +/- 0.16, N = 3 SE +/- 0.03, N = 3 SE +/- 0.49, N = 3 SE +/- 0.28, N = 3 SE +/- 0.38, N = 8 SE +/- 0.36, N = 3 SE +/- 0.44, N = 3 SE +/- 0.20, N = 3 SE +/- 0.22, N = 3 SE +/- 0.37, N = 12 SE +/- 0.15, N = 3 SE +/- 0.15, N = 3 SE +/- 0.28, N = 15 SE +/- 0.12, N = 3 SE +/- 0.06, N = 3 SE +/- 0.12, N = 3 SE +/- 0.30, N = 3 SE +/- 0.20, N = 3 SE +/- 0.12, N = 3 SE +/- 0.45, N = 4 SE +/- 0.22, N = 4 45.69 77.52 51.46 35.53 50.99 46.49 48.59 35.46 42.64 61.32 19.84 41.17 40.45 19.34 31.62 14.90 41.11 40.97 16.45 32.45 35.85 17.91 batches/sec Per Watt
OpenBenchmarking.org batches/sec Per Watt, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.1026 0.2052 0.3078 0.4104 0.513 0.102 0.377 0.234 0.083 0.214 0.088 0.193 0.066 0.155 0.346 0.052 0.200 0.231 0.056 0.221 0.053 0.435 0.456 0.053 0.258 0.251 0.052 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better PyTorch 2.2.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 110 220 330 440 550 Min: 81.45 / Avg: 450.14 / Max: 553.23 Min: 33.19 / Avg: 205.45 / Max: 273.87 Min: 58.92 / Avg: 219.54 / Max: 264.14 Min: 160.89 / Avg: 425.75 / Max: 563.56 Min: 73.83 / Avg: 237.82 / Max: 286.68 Min: 204.28 / Avg: 527.85 / Max: 604.75 Min: 78.78 / Avg: 251.12 / Max: 295.23 Min: 199.22 / Avg: 540.93 / Max: 610.22 Min: 101.16 / Avg: 274.76 / Max: 317.28 Min: 52.57 / Avg: 177.33 / Max: 220.98 Min: 62.51 / Avg: 384.75 / Max: 433.08 Min: 33.48 / Avg: 206.21 / Max: 246.32 Min: 30.07 / Avg: 174.93 / Max: 206.71 Min: 58.39 / Avg: 343.94 / Max: 402.47 Min: 21.5 / Avg: 143.05 / Max: 166.54 Min: 41.67 / Avg: 279.95 / Max: 308.17 Min: 17.99 / Avg: 94.53 / Max: 112.2 Min: 16.55 / Avg: 89.88 / Max: 106.44 Min: 105.53 / Avg: 307.69 / Max: 344.16 Min: 43.63 / Avg: 125.95 / Max: 146.47 Min: 43.45 / Avg: 142.9 / Max: 169.81 Min: 108.69 / Avg: 341.29 / Max: 380.81 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 14855 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 4451 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 6440 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 19301 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 6976 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 16693 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 8119 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 23440 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 9342 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 4551 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 24336 Joules per run. 12. EPYC 9684X: Approximate power consumption of 7149 Joules per run. 13. EPYC 9654: Approximate power consumption of 6122 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 22195 Joules per run. 15. EPYC 9754: Approximate power consumption of 6199 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 23143 Joules per run. 17. EPYC 8534P: Approximate power consumption of 3309 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 3116 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 24410 Joules per run. 20. Xeon 6766E: Approximate power consumption of 5374 Joules per run. 21. Xeon 6780E: Approximate power consumption of 5609 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 25256 Joules per run.
PostgreSQL This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.2909 0.5818 0.8727 1.1636 1.4545 SE +/- 0.040, N = 12 SE +/- 0.005, N = 12 SE +/- 0.007, N = 3 SE +/- 0.030, N = 12 SE +/- 0.008, N = 12 SE +/- 0.017, N = 9 SE +/- 0.007, N = 3 SE +/- 0.038, N = 9 SE +/- 0.022, N = 9 SE +/- 0.005, N = 3 SE +/- 0.006, N = 12 SE +/- 0.002, N = 3 SE +/- 0.003, N = 3 SE +/- 0.004, N = 12 SE +/- 0.001, N = 3 SE +/- 0.001, N = 3 SE +/- 0.002, N = 3 SE +/- 0.001, N = 3 SE +/- 0.009, N = 12 SE +/- 0.007, N = 3 SE +/- 0.006, N = 5 SE +/- 0.008, N = 12 1.149 0.589 0.572 1.293 0.559 1.027 0.622 1.098 0.525 0.581 0.289 0.251 0.278 0.293 0.292 0.329 0.384 0.414 0.815 0.572 0.542 0.775 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better PostgreSQL 16 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 Min: 70.21 / Avg: 487.56 / Max: 585.59 Min: 31.51 / Avg: 271.55 / Max: 343.13 Min: 56.77 / Avg: 302.76 / Max: 366.57 Min: 163.81 / Avg: 544.97 / Max: 640.25 Min: 71.87 / Avg: 311.81 / Max: 377.7 Min: 136.51 / Avg: 563.23 / Max: 663.44 Min: 78.53 / Avg: 316.32 / Max: 367.54 Min: 199.74 / Avg: 578.23 / Max: 678.5 Min: 104.48 / Avg: 468.46 / Max: 563.8 Min: 54.25 / Avg: 239.92 / Max: 291.32 Min: 61.31 / Avg: 584.31 / Max: 698.79 Min: 33.83 / Avg: 355.49 / Max: 410.22 Min: 27.65 / Avg: 271.07 / Max: 317.83 Min: 53.13 / Avg: 495.05 / Max: 595.37 Min: 21.35 / Avg: 253.4 / Max: 320.46 Min: 40.49 / Avg: 404.84 / Max: 498.33 Min: 18.63 / Avg: 138.72 / Max: 161.44 Min: 15.23 / Avg: 121.21 / Max: 140.08 Min: 55.77 / Avg: 244.42 / Max: 350.99 Min: 43.55 / Avg: 127.3 / Max: 157.98 Min: 43.45 / Avg: 153.46 / Max: 193.17 Min: 107.71 / Avg: 276.72 / Max: 373.07 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 68218 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 38130 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 42588 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 76387 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 43913 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 79415 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 44496 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 81659 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 66625 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 34149 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 82534 Joules per run. 12. EPYC 9684X: Approximate power consumption of 50242 Joules per run. 13. EPYC 9654: Approximate power consumption of 38673 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 69967 Joules per run. 15. EPYC 9754: Approximate power consumption of 36236 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 57757 Joules per run. 17. EPYC 8534P: Approximate power consumption of 19884 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 17374 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 35604 Joules per run. 20. Xeon 6766E: Approximate power consumption of 18247 Joules per run. 21. Xeon 6780E: Approximate power consumption of 21883 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 40079 Joules per run.
OpenBenchmarking.org TPS, More Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 900K 1800K 2700K 3600K 4500K SE +/- 30933.90, N = 12 SE +/- 13863.97, N = 12 SE +/- 20350.34, N = 3 SE +/- 18635.21, N = 12 SE +/- 24978.23, N = 12 SE +/- 16726.04, N = 9 SE +/- 17697.00, N = 3 SE +/- 36627.33, N = 9 SE +/- 74539.48, N = 9 SE +/- 13469.59, N = 3 SE +/- 71870.42, N = 12 SE +/- 27594.68, N = 3 SE +/- 39970.22, N = 3 SE +/- 41074.86, N = 12 SE +/- 15503.17, N = 3 SE +/- 13473.87, N = 3 SE +/- 11512.67, N = 3 SE +/- 4774.62, N = 3 SE +/- 13874.42, N = 12 SE +/- 20221.52, N = 3 SE +/- 19583.16, N = 5 SE +/- 13233.94, N = 12 881881 1699046 1748146 778141 1792636 976035 1607424 920725 1930006 1720762 3480909 3989358 3603261 3422731 3422492 3044620 2606500 2416375 1229649 1748658 1846080 1292122 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
Speedb Speedb is a next-generation key value storage engine that is RocksDB compatible and aiming for stability, efficiency, and performance. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Op/s, More Is Better Speedb 2.7 Test: Read While Writing Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 8M 16M 24M 32M 40M SE +/- 195912.00, N = 15 SE +/- 143570.67, N = 4 SE +/- 62510.72, N = 3 SE +/- 239363.92, N = 3 SE +/- 88257.34, N = 3 SE +/- 171807.74, N = 3 SE +/- 93731.24, N = 7 SE +/- 197596.27, N = 3 SE +/- 48351.08, N = 3 SE +/- 48302.92, N = 15 SE +/- 651901.79, N = 15 SE +/- 118870.12, N = 3 SE +/- 170909.18, N = 3 SE +/- 746932.76, N = 15 SE +/- 172052.60, N = 3 SE +/- 803844.71, N = 15 SE +/- 88013.69, N = 15 SE +/- 86788.79, N = 3 SE +/- 138092.00, N = 3 SE +/- 45758.35, N = 3 SE +/- 75416.94, N = 3 SE +/- 223786.94, N = 15 17585737 12168413 10695360 17297027 8795408 13859254 9988176 15354400 11795318 7147120 33307574 19595777 18024993 30324596 22829426 36593204 12053901 11882103 27630781 17548934 17945745 27657776 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread Op/s Per Watt
OpenBenchmarking.org Op/s Per Watt, More Is Better Speedb 2.7 Test: Read While Writing Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 20K 40K 60K 80K 100K 30648.42 37383.41 32356.04 26260.05 26509.91 21183.20 29984.58 23023.23 23084.61 27890.69 57884.56 57032.77 63472.87 61034.97 93506.84 85339.03 79851.05 97163.65 77049.13 103697.42 90565.21 69360.79 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Speedb 2.7 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 78.24 / Avg: 573.79 / Max: 750.97 Min: 34.03 / Avg: 325.5 / Max: 377.13 Min: 52.35 / Avg: 330.55 / Max: 376.19 Min: 164.82 / Avg: 658.68 / Max: 750.75 Min: 78.68 / Avg: 331.78 / Max: 377.28 Min: 210.71 / Avg: 654.26 / Max: 754.28 Min: 74.62 / Avg: 333.11 / Max: 375.39 Min: 210.91 / Avg: 666.91 / Max: 751.13 Min: 105.62 / Avg: 510.96 / Max: 581.73 Min: 52.53 / Avg: 256.25 / Max: 291.99 Min: 64.91 / Avg: 575.41 / Max: 820.95 Min: 32.81 / Avg: 343.59 / Max: 411.18 Min: 26.3 / Avg: 283.98 / Max: 305.25 Min: 56.42 / Avg: 496.84 / Max: 614.4 Min: 22.4 / Avg: 244.15 / Max: 314.31 Min: 41.53 / Avg: 428.8 / Max: 640.33 Min: 17.32 / Avg: 150.95 / Max: 163.43 Min: 17.9 / Avg: 122.29 / Max: 139.21 Min: 107.63 / Avg: 358.61 / Max: 475.78 Min: 43.64 / Avg: 169.23 / Max: 238.92 Min: 43.55 / Avg: 198.15 / Max: 300.83 Min: 108.97 / Avg: 398.75 / Max: 547.56 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 36876 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 20995 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21266 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 42595 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 21344 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 41872 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 21367 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 42904 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 32531 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16452 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 36788 Joules per run. 12. EPYC 9684X: Approximate power consumption of 21990 Joules per run. 13. EPYC 9654: Approximate power consumption of 18269 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 31731 Joules per run. 15. EPYC 9754: Approximate power consumption of 15625 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 27529 Joules per run. 17. EPYC 8534P: Approximate power consumption of 9701 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 7867 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 23310 Joules per run. 20. Xeon 6766E: Approximate power consumption of 10887 Joules per run. 21. Xeon 6780E: Approximate power consumption of 12748 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 25733 Joules per run.
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: T5 Encoder - Device: CPU - Executor: Parallel Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 100 200 300 400 500 SE +/- 1.73, N = 3 SE +/- 3.84, N = 3 SE +/- 0.86, N = 3 SE +/- 2.94, N = 3 SE +/- 3.48, N = 15 SE +/- 2.44, N = 3 SE +/- 1.74, N = 3 SE +/- 1.67, N = 15 SE +/- 1.11, N = 3 SE +/- 2.25, N = 3 SE +/- 0.65, N = 3 SE +/- 3.58, N = 3 SE +/- 0.55, N = 3 SE +/- 2.43, N = 3 SE +/- 3.02, N = 3 SE +/- 0.64, N = 3 SE +/- 2.24, N = 3 SE +/- 1.96, N = 3 SE +/- 1.08, N = 3 SE +/- 0.65, N = 3 SE +/- 0.69, N = 3 SE +/- 1.28, N = 3 354.75 462.86 326.14 246.34 337.00 246.68 346.21 252.67 249.48 282.25 276.21 446.30 374.75 271.62 319.45 250.63 255.67 254.73 92.51 237.80 246.04 94.42 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: T5 Encoder - Device: CPU - Executor: Parallel Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 3 6 9 12 15 SE +/- 0.01381, N = 3 SE +/- 0.01801, N = 3 SE +/- 0.00807, N = 3 SE +/- 0.04801, N = 3 SE +/- 0.03338, N = 15 SE +/- 0.04072, N = 3 SE +/- 0.01443, N = 3 SE +/- 0.02633, N = 15 SE +/- 0.01782, N = 3 SE +/- 0.02857, N = 3 SE +/- 0.00852, N = 3 SE +/- 0.01812, N = 3 SE +/- 0.00389, N = 3 SE +/- 0.03309, N = 3 SE +/- 0.02990, N = 3 SE +/- 0.01019, N = 3 SE +/- 0.03399, N = 3 SE +/- 0.02993, N = 3 SE +/- 0.12596, N = 3 SE +/- 0.01143, N = 3 SE +/- 0.01135, N = 3 SE +/- 0.14331, N = 3 2.81739 2.15980 3.06500 4.05881 2.97094 4.05270 2.88734 3.95819 4.00675 3.54242 3.61792 2.23922 2.66711 3.68001 3.12904 3.98735 3.91006 3.92455 10.80660 4.20355 4.06272 10.58830 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.17 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 60 120 180 240 300 Min: 99.27 / Avg: 314.65 / Max: 333.57 Min: 52.52 / Avg: 218.31 / Max: 234.43 Min: 64.84 / Avg: 297.41 / Max: 317.19 Min: 33.5 / Avg: 163.65 / Max: 174.8 Min: 29.55 / Avg: 141.28 / Max: 150.78 Min: 57.25 / Avg: 267.87 / Max: 282.78 Min: 21.09 / Avg: 108.61 / Max: 116.43 Min: 40.04 / Avg: 220.47 / Max: 233.47 Min: 17.28 / Avg: 82.81 / Max: 89.26 Min: 15.18 / Avg: 80.15 / Max: 85.73 Min: 103.76 / Avg: 180.19 / Max: 189.22 Min: 43.59 / Avg: 101.11 / Max: 106.64 Min: 43.42 / Avg: 105.34 / Max: 111.27 Min: 105.65 / Avg: 182.76 / Max: 192.69 1. Xeon Platinum 8380 2P: Approximate power consumption of 20452 Joules per run. 2. Xeon Platinum 8380: Approximate power consumption of 14190 Joules per run. 3. EPYC 9684X 2P: Approximate power consumption of 19232 Joules per run. 4. EPYC 9684X: Approximate power consumption of 10583 Joules per run. 5. EPYC 9654: Approximate power consumption of 9136 Joules per run. 6. EPYC 9654 2P: Approximate power consumption of 17322 Joules per run. 7. EPYC 9754: Approximate power consumption of 7024 Joules per run. 8. EPYC 9754 2P: Approximate power consumption of 14330 Joules per run. 9. EPYC 8534P: Approximate power consumption of 5410 Joules per run. 10. EPYC 8534PN: Approximate power consumption of 5210 Joules per run. 11. Xeon 6766E 2P: Approximate power consumption of 11893 Joules per run. 12. Xeon 6766E: Approximate power consumption of 6606 Joules per run. 13. Xeon 6780E: Approximate power consumption of 6882 Joules per run. 14. Xeon 6780E 2P: Approximate power consumption of 12062 Joules per run.
Liquid-DSP LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 57 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 2000M 4000M 6000M 8000M 10000M SE +/- 61971606.40, N = 3 SE +/- 3555434.03, N = 3 SE +/- 5292237.50, N = 3 SE +/- 2331189.49, N = 3 SE +/- 4088330.28, N = 3 SE +/- 17558125.69, N = 3 SE +/- 1976810.00, N = 3 SE +/- 28453880.81, N = 3 SE +/- 3572580.77, N = 3 SE +/- 2935605.18, N = 3 SE +/- 50144890.07, N = 3 SE +/- 8144527.82, N = 3 SE +/- 2618735.91, N = 3 SE +/- 60380193.59, N = 3 SE +/- 12739745.33, N = 3 SE +/- 8069352.17, N = 3 SE +/- 1959875.28, N = 3 SE +/- 4481443.22, N = 3 SE +/- 28436830.58, N = 3 SE +/- 8015887.00, N = 3 SE +/- 6906036.01, N = 3 SE +/- 30821331.00, N = 3 6284300000 3806833333 3500833333 5361266667 2848933333 4825133333 3222533333 5036000000 3037100000 1610466667 8012700000 5811900000 5266466667 7411866667 6401366667 6316266667 3116933333 2793700000 6800900000 4259433333 4714700000 7597566667 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid samples/s Per Watt
OpenBenchmarking.org samples/s Per Watt, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 57 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 5M 10M 15M 20M 25M 10144378.39 12268330.08 11085612.93 8419315.63 8954185.90 7597124.43 10156047.28 7871904.97 6213581.60 6601048.41 11934150.92 16030850.56 17475938.77 12864302.70 22424548.82 16347865.87 21345877.02 23457026.73 15666459.94 18991058.67 15942975.31 13780225.29 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Liquid-DSP 1.6 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 68.73 / Avg: 619.49 / Max: 754.72 Min: 24.86 / Avg: 310.3 / Max: 377.83 Min: 58.98 / Avg: 315.8 / Max: 377.13 Min: 155.13 / Avg: 636.78 / Max: 752.99 Min: 75.93 / Avg: 318.17 / Max: 376.27 Min: 195.33 / Avg: 635.13 / Max: 752.27 Min: 75.49 / Avg: 317.3 / Max: 376.02 Min: 193.94 / Avg: 639.74 / Max: 752.86 Min: 101.61 / Avg: 488.78 / Max: 580.58 Min: 52.71 / Avg: 243.97 / Max: 290.99 Min: 62.88 / Avg: 671.41 / Max: 791.35 Min: 35.02 / Avg: 362.54 / Max: 411.45 Min: 30.72 / Avg: 301.36 / Max: 345.8 Min: 54.92 / Avg: 576.16 / Max: 661.98 Min: 22.44 / Avg: 285.46 / Max: 328.97 Min: 40.8 / Avg: 386.37 / Max: 445.76 Min: 17.88 / Avg: 146.02 / Max: 166.38 Min: 18.06 / Avg: 119.1 / Max: 135.86 Min: 106.08 / Avg: 434.11 / Max: 495.15 Min: 43.61 / Avg: 224.29 / Max: 267.77 Min: 43.65 / Avg: 295.72 / Max: 355.96 Min: 108.43 / Avg: 551.34 / Max: 625.76 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 21476 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 10757 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 10842 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 21651 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 10924 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 21594 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 11000 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 21965 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 16619 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 8458 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 22604 Joules per run. 12. EPYC 9684X: Approximate power consumption of 12327 Joules per run. 13. EPYC 9654: Approximate power consumption of 10246 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 19781 Joules per run. 15. EPYC 9754: Approximate power consumption of 9706 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 13008 Joules per run. 17. EPYC 8534P: Approximate power consumption of 4965 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 4089 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 14904 Joules per run. 20. Xeon 6766E: Approximate power consumption of 7775 Joules per run. 21. Xeon 6780E: Approximate power consumption of 10153 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 18929 Joules per run.
Embree Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Crown Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 50 100 150 200 250 SE +/- 0.07, N = 7 SE +/- 0.05, N = 5 SE +/- 0.07, N = 5 SE +/- 0.12, N = 6 SE +/- 0.05, N = 4 SE +/- 0.14, N = 6 SE +/- 0.02, N = 4 SE +/- 0.48, N = 6 SE +/- 0.08, N = 5 SE +/- 0.07, N = 3 SE +/- 1.23, N = 8 SE +/- 0.20, N = 7 SE +/- 0.08, N = 6 SE +/- 0.43, N = 7 SE +/- 0.64, N = 6 SE +/- 1.04, N = 7 SE +/- 0.04, N = 4 SE +/- 0.07, N = 4 SE +/- 0.11, N = 6 SE +/- 0.05, N = 5 SE +/- 0.02, N = 5 SE +/- 0.14, N = 6 153.16 82.97 70.05 124.71 58.42 107.63 65.33 116.61 82.92 43.67 214.02 130.79 110.53 176.21 126.15 190.08 62.19 58.28 121.43 73.96 81.83 133.42 Frames Per Second Per Watt
OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Crown Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.1415 0.283 0.4245 0.566 0.7075 0.363 0.331 0.258 0.252 0.206 0.205 0.232 0.226 0.205 0.192 0.499 0.522 0.499 0.468 0.629 0.532 0.482 0.517 0.377 0.422 0.381 0.373 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Embree 4.3 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 65.93 / Avg: 422.5 / Max: 748.67 Min: 26.17 / Avg: 250.53 / Max: 384.62 Min: 60.79 / Avg: 271.03 / Max: 377.88 Min: 171.82 / Avg: 493.94 / Max: 734.13 Min: 71.98 / Avg: 284.3 / Max: 376.72 Min: 192.27 / Avg: 525.15 / Max: 751.36 Min: 75.4 / Avg: 281.67 / Max: 377.64 Min: 178.12 / Avg: 516.97 / Max: 755.2 Min: 102.04 / Avg: 404.97 / Max: 574.07 Min: 53.87 / Avg: 227.2 / Max: 288.12 Min: 60.99 / Avg: 428.94 / Max: 819.87 Min: 32.54 / Avg: 250.47 / Max: 410.99 Min: 27.85 / Avg: 221.71 / Max: 341.98 Min: 58.37 / Avg: 376.52 / Max: 669.54 Min: 20.38 / Avg: 200.39 / Max: 335.38 Min: 39.31 / Avg: 357.16 / Max: 678.39 Min: 17.65 / Avg: 128.92 / Max: 171.09 Min: 16.58 / Avg: 112.82 / Max: 146.36 Min: 104.47 / Avg: 322.07 / Max: 484.23 Min: 43.6 / Avg: 175.27 / Max: 236.71 Min: 43.42 / Avg: 214.8 / Max: 302.74 Min: 105.86 / Avg: 357.3 / Max: 564.3 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 4165 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 3407 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 4228 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 5433 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 4975 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 6127 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 4507 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 5859 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 5589 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 4923 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 3646 Joules per run. 12. EPYC 9684X: Approximate power consumption of 2576 Joules per run. 13. EPYC 9654: Approximate power consumption of 2439 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 3389 Joules per run. 15. EPYC 9754: Approximate power consumption of 2071 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 3214 Joules per run. 17. EPYC 8534P: Approximate power consumption of 2159 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1946 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 3596 Joules per run. 20. Xeon 6766E: Approximate power consumption of 2594 Joules per run. 21. Xeon 6780E: Approximate power consumption of 2964 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 3811 Joules per run.
Memcached Memcached is a high performance, distributed memory object caching system. This Memcached test profiles makes use of memtier_benchmark for excuting this CPU/memory-focused server benchmark. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.19 Set To Get Ratio: 1:100 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 2M 4M 6M 8M 10M SE +/- 35300.21, N = 3 SE +/- 35182.67, N = 3 SE +/- 25335.31, N = 3 SE +/- 50660.01, N = 15 SE +/- 21428.06, N = 3 SE +/- 26891.33, N = 3 SE +/- 52575.97, N = 3 SE +/- 24083.78, N = 3 SE +/- 101903.23, N = 15 SE +/- 38410.91, N = 15 SE +/- 27143.58, N = 3 SE +/- 58081.25, N = 3 SE +/- 29027.89, N = 3 SE +/- 83562.82, N = 3 SE +/- 38372.96, N = 3 SE +/- 14591.70, N = 3 SE +/- 36366.89, N = 3 SE +/- 41123.40, N = 3 SE +/- 16910.46, N = 15 SE +/- 19070.02, N = 15 SE +/- 19998.04, N = 15 SE +/- 16926.98, N = 15 3780240.56 4752673.79 4481667.95 3245908.40 4384040.52 3373323.92 4315467.17 3392842.38 4814941.53 4826284.80 8683410.79 8634258.39 8220895.45 8498306.78 7736018.74 7645325.70 6198256.72 5820618.18 1783869.96 2299150.51 2339570.28 1821144.00 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre Ops/sec Per Watt
OpenBenchmarking.org Ops/sec Per Watt, More Is Better Memcached 1.6.19 Set To Get Ratio: 1:100 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 11K 22K 33K 44K 55K 7668.81 18089.30 15564.53 5947.33 15062.13 6127.33 14272.39 5975.55 10688.23 20130.49 15985.01 25824.73 31074.26 17990.14 32910.93 19415.88 44935.74 51146.06 8031.40 21456.14 18800.36 7280.70 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Memcached 1.6.19 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 110 220 330 440 550 Min: 62.89 / Avg: 492.94 / Max: 577.85 Min: 24.01 / Avg: 262.73 / Max: 308.93 Min: 53.66 / Avg: 287.94 / Max: 334.72 Min: 165.51 / Avg: 545.78 / Max: 623.84 Min: 70.74 / Avg: 291.06 / Max: 331.31 Min: 197.32 / Avg: 550.54 / Max: 613.93 Min: 56.01 / Avg: 302.36 / Max: 343.09 Min: 189.98 / Avg: 567.79 / Max: 640.73 Min: 98.17 / Avg: 450.49 / Max: 528.19 Min: 53.19 / Avg: 239.75 / Max: 291.89 Min: 64.05 / Avg: 543.22 / Max: 637.08 Min: 33.48 / Avg: 334.34 / Max: 390.93 Min: 26.63 / Avg: 264.56 / Max: 307.16 Min: 55.17 / Avg: 472.39 / Max: 548.36 Min: 21.61 / Avg: 235.06 / Max: 274.9 Min: 40.14 / Avg: 393.77 / Max: 460.35 Min: 19.03 / Avg: 137.94 / Max: 159.73 Min: 16.61 / Avg: 113.8 / Max: 137.75 Min: 104.69 / Avg: 222.11 / Max: 257.75 Min: 43.49 / Avg: 107.16 / Max: 120.67 Min: 43.41 / Avg: 124.44 / Max: 142.61 Min: 107.52 / Avg: 250.13 / Max: 283.85 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 35163 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 18742 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 20060 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 38641 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 20471 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 38905 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 21266 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 40502 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 31534 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16814 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 38207 Joules per run. 12. EPYC 9684X: Approximate power consumption of 23292 Joules per run. 13. EPYC 9654: Approximate power consumption of 18431 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 33539 Joules per run. 15. EPYC 9754: Approximate power consumption of 16454 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 27957 Joules per run. 17. EPYC 8534P: Approximate power consumption of 9656 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 8004 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 15696 Joules per run. 20. Xeon 6766E: Approximate power consumption of 7587 Joules per run. 21. Xeon 6780E: Approximate power consumption of 8794 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 17659 Joules per run.
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.306 0.612 0.918 1.224 1.53 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 15 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 7 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 15 SE +/- 0.00, N = 3 SE +/- 0.00, N = 9 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.46 0.49 0.43 0.29 0.33 0.28 0.37 0.30 0.45 0.56 0.35 0.45 0.48 0.35 0.73 0.41 0.53 0.60 1.20 1.36 1.25 1.09 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 Min: 81.83 / Avg: 472.9 / Max: 559.21 Min: 33.52 / Avg: 235.56 / Max: 293.33 Min: 59.31 / Avg: 328.19 / Max: 373.29 Min: 169.81 / Avg: 585.54 / Max: 631.87 Min: 73.52 / Avg: 330.72 / Max: 377.05 Min: 201.96 / Avg: 633.47 / Max: 674.77 Min: 83.36 / Avg: 331.78 / Max: 377.93 Min: 200.92 / Avg: 627.67 / Max: 669.86 Min: 104.06 / Avg: 507.52 / Max: 580.05 Min: 51.57 / Avg: 255.35 / Max: 290.92 Min: 36.23 / Avg: 623.56 / Max: 689.59 Min: 34.06 / Avg: 367.01 / Max: 400.16 Min: 26.97 / Avg: 310.58 / Max: 341.7 Min: 57.78 / Avg: 545.61 / Max: 614.54 Min: 21.53 / Avg: 310.47 / Max: 338.08 Min: 40.6 / Avg: 436.99 / Max: 487.81 Min: 19.35 / Avg: 152.78 / Max: 164.84 Min: 16.42 / Avg: 129.12 / Max: 139.81 Min: 104.83 / Avg: 274.08 / Max: 295.37 Min: 43.65 / Avg: 203.6 / Max: 221.29 Min: 43.63 / Avg: 241.33 / Max: 263.98 Min: 107.98 / Avg: 302.19 / Max: 331.56 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 30896 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 15311 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21442 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 38646 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 21387 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 41176 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 21565 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 40840 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 33158 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16512 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 40354 Joules per run. 12. EPYC 9684X: Approximate power consumption of 23734 Joules per run. 13. EPYC 9654: Approximate power consumption of 20291 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 35319 Joules per run. 15. EPYC 9754: Approximate power consumption of 20180 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 28501 Joules per run. 17. EPYC 8534P: Approximate power consumption of 9880 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 8393 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 17906 Joules per run. 20. Xeon 6766E: Approximate power consumption of 13234 Joules per run. 21. Xeon 6780E: Approximate power consumption of 15767 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 19743 Joules per run.
PyTorch This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark]. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 14 28 42 56 70 SE +/- 0.29, N = 3 SE +/- 0.64, N = 3 SE +/- 0.52, N = 3 SE +/- 0.49, N = 3 SE +/- 0.76, N = 3 SE +/- 0.52, N = 3 SE +/- 0.62, N = 3 SE +/- 0.45, N = 3 SE +/- 0.23, N = 3 SE +/- 0.04, N = 3 SE +/- 0.32, N = 12 SE +/- 0.09, N = 3 SE +/- 0.21, N = 3 SE +/- 0.37, N = 12 SE +/- 0.08, N = 3 SE +/- 0.28, N = 12 SE +/- 0.18, N = 3 SE +/- 0.13, N = 3 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 SE +/- 0.13, N = 3 SE +/- 0.12, N = 3 41.45 63.60 54.84 37.44 52.97 41.68 51.56 37.91 36.97 48.89 16.97 34.90 34.90 17.41 27.78 13.11 33.68 33.30 14.67 26.82 30.86 16.22 batches/sec Per Watt
OpenBenchmarking.org batches/sec Per Watt, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0752 0.1504 0.2256 0.3008 0.376 0.082 0.293 0.218 0.077 0.197 0.073 0.189 0.066 0.113 0.235 0.040 0.150 0.179 0.048 0.176 0.044 0.305 0.334 0.045 0.194 0.194 0.045 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better PyTorch 2.2.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 110 220 330 440 550 Min: 72.64 / Avg: 507.69 / Max: 575.72 Min: 18.63 / Avg: 215.65 / Max: 294.3 Min: 61.04 / Avg: 251.84 / Max: 296.62 Min: 165.22 / Avg: 486.52 / Max: 567.17 Min: 75.38 / Avg: 268.45 / Max: 310.8 Min: 201.49 / Avg: 569.91 / Max: 625.34 Min: 89.32 / Avg: 273.3 / Max: 321.11 Min: 193.43 / Avg: 577.93 / Max: 636.86 Min: 101.92 / Avg: 326.58 / Max: 422.87 Min: 55.01 / Avg: 207.81 / Max: 238.76 Min: 61.35 / Avg: 419.25 / Max: 473.7 Min: 32.73 / Avg: 232.73 / Max: 262.5 Min: 30.18 / Avg: 194.95 / Max: 219.41 Min: 55.56 / Avg: 365.56 / Max: 407.37 Min: 21.47 / Avg: 157.48 / Max: 175.9 Min: 40.16 / Avg: 300.12 / Max: 342.36 Min: 19.91 / Avg: 110.56 / Max: 125.45 Min: 17.28 / Avg: 99.64 / Max: 110.85 Min: 105.49 / Avg: 325.94 / Max: 350.34 Min: 43.68 / Avg: 138.47 / Max: 152.75 Min: 43.38 / Avg: 159.18 / Max: 178.76 Min: 108.2 / Avg: 363.82 / Max: 389.75 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 40108 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 9848 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 12340 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 33084 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 13691 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 33245 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 19313 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 41033 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 20683 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 10044 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 53629 Joules per run. 12. EPYC 9684X: Approximate power consumption of 15360 Joules per run. 13. EPYC 9654: Approximate power consumption of 12932 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 46030 Joules per run. 15. EPYC 9754: Approximate power consumption of 13018 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 49920 Joules per run. 17. EPYC 8534P: Approximate power consumption of 7407 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 6742 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 50086 Joules per run. 20. Xeon 6766E: Approximate power consumption of 11539 Joules per run. 21. Xeon 6780E: Approximate power consumption of 11832 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 50692 Joules per run.
GraphicsMagick This is a test of GraphicsMagick with its OpenMP implementation that performs various imaging tests on a sample high resolution (currently 15400 x 6940) JPEG image. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Sharpen Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 80 160 240 320 400 SE +/- 1.67, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 SE +/- 1.67, N = 3 SE +/- 0.00, N = 3 SE +/- 1.20, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.88, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 1.20, N = 3 SE +/- 0.33, N = 3 SE +/- 3.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.88, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.67, N = 3 284 167 157 265 114 199 130 227 144 79 297 201 173 262 207 310 112 105 336 253 281 381 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp Iterations Per Minute Per Watt
OpenBenchmarking.org Iterations Per Minute Per Watt, More Is Better GraphicsMagick 1.3.43 Operation: Sharpen Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.2781 0.5562 0.8343 1.1124 1.3905 0.453 0.512 0.476 0.419 0.345 0.301 0.405 0.343 0.285 0.310 0.492 0.589 0.674 0.544 0.838 0.690 0.881 0.904 0.965 1.236 1.074 0.894 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better GraphicsMagick 1.3.43 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 Min: 74.46 / Avg: 627.19 / Max: 683.79 Min: 26.5 / Avg: 326.08 / Max: 362.61 Min: 62.29 / Avg: 329.54 / Max: 363.35 Min: 148.52 / Avg: 632.93 / Max: 684.15 Min: 74.41 / Avg: 330.11 / Max: 353.01 Min: 197.85 / Avg: 660.39 / Max: 706.79 Min: 74.28 / Avg: 321.22 / Max: 366.4 Min: 206.23 / Avg: 662.12 / Max: 708.79 Min: 102.73 / Avg: 504.87 / Max: 544.93 Min: 53.14 / Avg: 254.91 / Max: 285.61 Min: 65.27 / Avg: 603.16 / Max: 655.4 Min: 34.61 / Avg: 341.04 / Max: 370.17 Min: 28.8 / Avg: 256.57 / Max: 278.61 Min: 59.05 / Avg: 481.76 / Max: 531.74 Min: 22 / Avg: 247.13 / Max: 273.84 Min: 38.07 / Avg: 448.99 / Max: 494.64 Min: 17.43 / Avg: 127.19 / Max: 145.11 Min: 15.82 / Avg: 116.15 / Max: 127.18 Min: 104.82 / Avg: 348.18 / Max: 384.37 Min: 43.7 / Avg: 204.72 / Max: 219.13 Min: 43.66 / Avg: 261.59 / Max: 286.06 Min: 107.76 / Avg: 425.97 / Max: 469.34 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 40140 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 20978 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21201 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 40929 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 21237 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 42045 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 21415 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 42597 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 32144 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16484 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 38603 Joules per run. 12. EPYC 9684X: Approximate power consumption of 21827 Joules per run. 13. EPYC 9654: Approximate power consumption of 16335 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 30672 Joules per run. 15. EPYC 9754: Approximate power consumption of 15734 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 28436 Joules per run. 17. EPYC 8534P: Approximate power consumption of 8607 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 7434 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 22399 Joules per run. 20. Xeon 6766E: Approximate power consumption of 13102 Joules per run. 21. Xeon 6780E: Approximate power consumption of 16829 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 27404 Joules per run.
srsRAN Project srsRAN Project is a complete ORAN-native 5G RAN solution created by Software Radio Systems (SRS). The srsRAN Project radio suite was formerly known as srsLTE and can be used for building your own software-defined radio (SDR) 4G/5G mobile network. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Mbps, More Is Better srsRAN Project 23.10.1-20240325 Test: PUSCH Processor Benchmark, Throughput Total Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 2K 4K 6K 8K 10K SE +/- 0.12, N = 3 SE +/- 18.09, N = 3 SE +/- 18.43, N = 3 SE +/- 47.68, N = 6 SE +/- 0.09, N = 3 SE +/- 26.47, N = 3 SE +/- 18.30, N = 3 SE +/- 0.15, N = 3 SE +/- 0.17, N = 3 SE +/- 0.07, N = 3 SE +/- 2.29, N = 3 SE +/- 55.17, N = 3 SE +/- 0.20, N = 3 SE +/- 74.95, N = 4 SE +/- 63.64, N = 5 SE +/- 76.45, N = 3 SE +/- 25.25, N = 3 SE +/- 19.02, N = 13 SE +/- 36.60, N = 3 SE +/- 8.17, N = 3 SE +/- 0.00, N = 3 SE +/- 14.40, N = 3 5493.4 3088.7 2616.9 4853.6 2170.7 3787.0 2514.0 4386.6 3288.4 1770.0 6999.7 5656.9 5239.6 6835.7 5973.8 8396.7 3193.0 2818.5 3067.0 1953.1 2118.6 3414.2 1. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -fno-trapping-math -fno-math-errno -ldl Mbps Per Watt
OpenBenchmarking.org Mbps Per Watt, More Is Better srsRAN Project 23.10.1-20240325 Test: PUSCH Processor Benchmark, Throughput Total Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 6 12 18 24 30 10.976 13.247 10.299 8.808 7.971 6.643 8.854 7.552 7.535 7.989 10.725 18.052 20.666 12.702 23.406 16.197 24.996 26.846 9.956 15.533 14.180 9.756 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better srsRAN Project 23.10.1-20240325 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 82.2 / Avg: 500.5 / Max: 584.22 Min: 25.89 / Avg: 233.17 / Max: 276.77 Min: 62.91 / Avg: 254.1 / Max: 294.51 Min: 156.44 / Avg: 551.02 / Max: 636.6 Min: 74.32 / Avg: 272.33 / Max: 304.79 Min: 206.4 / Avg: 570.06 / Max: 634.71 Min: 73.76 / Avg: 283.68 / Max: 318.07 Min: 196.65 / Avg: 580.82 / Max: 660.22 Min: 104.84 / Avg: 436.41 / Max: 487.66 Min: 53.15 / Avg: 221.57 / Max: 249.62 Min: 67.45 / Avg: 652.65 / Max: 788.02 Min: 31.36 / Avg: 313.37 / Max: 378.12 Min: 27.31 / Avg: 253.54 / Max: 296.82 Min: 60.3 / Avg: 538.17 / Max: 621.29 Min: 21.5 / Avg: 255.23 / Max: 297.3 Min: 37.54 / Avg: 518.41 / Max: 623.41 Min: 18.17 / Avg: 127.74 / Max: 148.29 Min: 14.51 / Avg: 104.99 / Max: 125.17 Min: 106.26 / Avg: 308.05 / Max: 384.76 Min: 43.71 / Avg: 125.74 / Max: 140.92 Min: 43.57 / Avg: 149.41 / Max: 169.56 Min: 108.83 / Avg: 349.96 / Max: 395.95 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 18519 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 8161 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 9486 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 21673 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 9804 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 22232 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 10402 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 23233 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 16583 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 8050 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 25888 Joules per run. 12. EPYC 9684X: Approximate power consumption of 8983 Joules per run. 13. EPYC 9654: Approximate power consumption of 7606 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 22065 Joules per run. 15. EPYC 9754: Approximate power consumption of 8627 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 22810 Joules per run. 17. EPYC 8534P: Approximate power consumption of 4301 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 3885 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 22488 Joules per run. 20. Xeon 6766E: Approximate power consumption of 7293 Joules per run. 21. Xeon 6780E: Approximate power consumption of 8068 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 22864 Joules per run.
GROMACS The GROMACS (GROningen MAchine for Chemical Simulations) molecular dynamics package testing with the water_GMX50 data. This test profile allows selecting between CPU and GPU-based GROMACS builds. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2024 Implementation: MPI CPU - Input: water_GMX50_bare Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 5 10 15 20 25 SE +/- 0.046, N = 3 SE +/- 0.009, N = 3 SE +/- 0.010, N = 3 SE +/- 0.019, N = 3 SE +/- 0.019, N = 3 SE +/- 0.025, N = 3 SE +/- 0.007, N = 3 SE +/- 0.032, N = 3 SE +/- 0.036, N = 3 SE +/- 0.018, N = 3 SE +/- 0.224, N = 14 SE +/- 0.052, N = 3 SE +/- 0.034, N = 3 SE +/- 0.189, N = 6 SE +/- 0.032, N = 3 SE +/- 0.067, N = 3 SE +/- 0.004, N = 3 SE +/- 0.004, N = 3 18.540 10.477 8.762 15.450 7.545 13.392 8.282 14.127 8.964 4.813 22.525 15.222 12.514 20.234 13.242 21.305 6.499 6.246 1. (CXX) g++ options: -O3 -lm Ns Per Day Per Watt
OpenBenchmarking.org Ns Per Day Per Watt, More Is Better GROMACS 2024 Implementation: MPI CPU - Input: water_GMX50_bare Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 0.0119 0.0238 0.0357 0.0476 0.0595 0.035 0.036 0.029 0.026 0.024 0.022 0.027 0.023 0.019 0.019 0.037 0.048 0.048 0.040 0.053 0.047 0.047 0.052 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better GROMACS 2024 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 140 280 420 560 700 Min: 75.68 / Avg: 535.3 / Max: 753.28 Min: 24.97 / Avg: 289.21 / Max: 376.32 Min: 54.7 / Avg: 306.77 / Max: 376.19 Min: 166.32 / Avg: 584.52 / Max: 753.32 Min: 76.31 / Avg: 314 / Max: 374.89 Min: 201.3 / Avg: 602.79 / Max: 753.69 Min: 75.59 / Avg: 311.94 / Max: 375.77 Min: 205.45 / Avg: 603.46 / Max: 753.72 Min: 104.75 / Avg: 474.08 / Max: 581.34 Min: 53.31 / Avg: 248.51 / Max: 290.81 Min: 65.5 / Avg: 601.18 / Max: 820.89 Min: 33.95 / Avg: 317.95 / Max: 409.49 Min: 27.69 / Avg: 260.21 / Max: 348.03 Min: 56.1 / Avg: 505.98 / Max: 708.92 Min: 22.18 / Avg: 250.1 / Max: 348.03 Min: 40.72 / Avg: 455.51 / Max: 701.31 Min: 18.05 / Avg: 137.24 / Max: 164.83 Min: 16.45 / Avg: 120.24 / Max: 142.62 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 17130 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 8965 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 10328 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 18120 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 10990 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 17883 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 10606 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 19110 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 16277 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 11846 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 18680 Joules per run. 12. EPYC 9684X: Approximate power consumption of 8055 Joules per run. 13. EPYC 9654: Approximate power consumption of 7459 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 16529 Joules per run. 15. EPYC 9754: Approximate power consumption of 7837 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 19587 Joules per run. 17. EPYC 8534P: Approximate power consumption of 5627 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 5130 Joules per run.
OpenVKL OpenVKL is the Intel Open Volume Kernel Library that offers high-performance volume computation kernels and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 2.0.0 Benchmark: vklBenchmarkCPU ISPC Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 900 1800 2700 3600 4500 SE +/- 13.62, N = 3 SE +/- 2.08, N = 3 SE +/- 1.53, N = 3 SE +/- 6.74, N = 3 SE +/- 6.66, N = 3 SE +/- 8.62, N = 3 SE +/- 13.96, N = 3 SE +/- 4.36, N = 3 SE +/- 12.02, N = 3 SE +/- 6.81, N = 3 SE +/- 5.36, N = 3 SE +/- 1.00, N = 3 SE +/- 1.20, N = 3 SE +/- 8.67, N = 3 SE +/- 0.88, N = 3 SE +/- 26.33, N = 3 SE +/- 1.20, N = 3 SE +/- 8.17, N = 3 SE +/- 7.31, N = 3 SE +/- 0.58, N = 3 SE +/- 0.67, N = 3 SE +/- 3.61, N = 3 3222 2004 1734 2716 1243 1776 1356 1852 1527 869 3906 2396 2077 3335 2508 4012 1266 1177 2020 1267 1391 2228 Items / Sec Per Watt
OpenBenchmarking.org Items / Sec Per Watt, More Is Better OpenVKL 2.0.0 Benchmark: vklBenchmarkCPU ISPC Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 3 6 9 12 15 5.106 6.261 5.391 4.287 3.798 2.745 4.129 2.853 3.162 3.527 5.763 6.861 7.601 6.102 9.457 7.673 9.163 9.780 5.786 7.196 6.233 5.416 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OpenVKL 2.0.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 79.05 / Avg: 630.97 / Max: 751.76 Min: 35.93 / Avg: 320.1 / Max: 378.34 Min: 57.62 / Avg: 321.66 / Max: 378.49 Min: 172.02 / Avg: 633.5 / Max: 755.3 Min: 75.39 / Avg: 327.25 / Max: 376.15 Min: 209.11 / Avg: 647.03 / Max: 756.03 Min: 78.05 / Avg: 328.39 / Max: 378.11 Min: 190.07 / Avg: 649.08 / Max: 754.84 Min: 102.24 / Avg: 482.91 / Max: 579.87 Min: 51.77 / Avg: 246.36 / Max: 292 Min: 67.14 / Avg: 677.76 / Max: 821.93 Min: 33.91 / Avg: 349.21 / Max: 411.78 Min: 28.49 / Avg: 273.27 / Max: 332.24 Min: 57.11 / Avg: 546.55 / Max: 678.78 Min: 21.69 / Avg: 265.2 / Max: 336.16 Min: 40.48 / Avg: 522.89 / Max: 678.27 Min: 16.98 / Avg: 138.16 / Max: 167.46 Min: 18.05 / Avg: 120.35 / Max: 144.9 Min: 106.2 / Avg: 349.12 / Max: 504.22 Min: 43.67 / Avg: 176.07 / Max: 237.02 Min: 43.61 / Avg: 223.17 / Max: 308.98 Min: 63.56 / Avg: 411.4 / Max: 636.51 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 436629 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 211480 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 224091 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 456330 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 222423 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 477509 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 218486 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 469714 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 348663 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 163338 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 500410 Joules per run. 12. EPYC 9684X: Approximate power consumption of 255739 Joules per run. 13. EPYC 9654: Approximate power consumption of 206499 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 405538 Joules per run. 15. EPYC 9754: Approximate power consumption of 199964 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 401053 Joules per run. 17. EPYC 8534P: Approximate power consumption of 105048 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 87497 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 331661 Joules per run. 20. Xeon 6766E: Approximate power consumption of 131997 Joules per run. 21. Xeon 6780E: Approximate power consumption of 166042 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 384386 Joules per run.
PyTorch This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark]. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 14 28 42 56 70 SE +/- 0.12, N = 3 SE +/- 0.12, N = 3 SE +/- 0.24, N = 3 SE +/- 0.50, N = 3 SE +/- 0.71, N = 3 SE +/- 0.51, N = 3 SE +/- 0.62, N = 3 SE +/- 0.46, N = 4 SE +/- 0.40, N = 15 SE +/- 0.14, N = 3 SE +/- 0.37, N = 12 SE +/- 0.10, N = 3 SE +/- 0.26, N = 3 SE +/- 0.35, N = 12 SE +/- 0.10, N = 3 SE +/- 0.23, N = 9 SE +/- 0.06, N = 3 SE +/- 0.18, N = 3 SE +/- 0.06, N = 3 SE +/- 0.14, N = 3 SE +/- 0.33, N = 5 SE +/- 0.11, N = 3 40.77 63.06 56.01 37.08 51.55 42.35 51.35 38.30 37.75 48.99 17.28 34.71 35.01 17.07 27.68 13.68 33.49 33.23 14.84 26.89 30.69 16.10 batches/sec Per Watt
OpenBenchmarking.org batches/sec Per Watt, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0761 0.1522 0.2283 0.3044 0.3805 0.080 0.258 0.223 0.076 0.193 0.074 0.186 0.066 0.116 0.236 0.042 0.150 0.179 0.046 0.175 0.046 0.308 0.338 0.045 0.194 0.193 0.044 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better PyTorch 2.2.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 110 220 330 440 550 Min: 81.92 / Avg: 507.01 / Max: 574.06 Min: 35.31 / Avg: 244 / Max: 293.19 Min: 60.41 / Avg: 250.31 / Max: 298.35 Min: 162.87 / Avg: 486.48 / Max: 565.96 Min: 73.38 / Avg: 266.73 / Max: 308.34 Min: 202.91 / Avg: 568.79 / Max: 623.75 Min: 76.06 / Avg: 275.89 / Max: 319.9 Min: 194.23 / Avg: 577.63 / Max: 637.3 Min: 100.89 / Avg: 325.09 / Max: 418.72 Min: 53.3 / Avg: 207.69 / Max: 238.28 Min: 62.55 / Avg: 415.63 / Max: 466.73 Min: 35.79 / Avg: 231.06 / Max: 261.25 Min: 28.44 / Avg: 195.3 / Max: 220.5 Min: 54.65 / Avg: 367.41 / Max: 412.66 Min: 21.23 / Avg: 158.01 / Max: 176.03 Min: 40.2 / Avg: 299.48 / Max: 333.06 Min: 19.48 / Avg: 108.57 / Max: 123.57 Min: 15.03 / Avg: 98.23 / Max: 110.34 Min: 104.56 / Avg: 326.43 / Max: 349.99 Min: 43.6 / Avg: 138.69 / Max: 152.97 Min: 43.46 / Avg: 159.15 / Max: 179.26 Min: 108.31 / Avg: 363.14 / Max: 388.67 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 30083 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 9679 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 12265 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 33405 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 14048 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 32610 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 15266 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 40868 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 20307 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 10038 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 52785 Joules per run. 12. EPYC 9684X: Approximate power consumption of 15327 Joules per run. 13. EPYC 9654: Approximate power consumption of 12955 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 46569 Joules per run. 15. EPYC 9754: Approximate power consumption of 13009 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 48682 Joules per run. 17. EPYC 8534P: Approximate power consumption of 7383 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 6712 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 49944 Joules per run. 20. Xeon 6766E: Approximate power consumption of 11650 Joules per run. 21. Xeon 6780E: Approximate power consumption of 11873 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 51081 Joules per run.
Result
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 14 28 42 56 70 SE +/- 0.30, N = 15 SE +/- 0.19, N = 3 SE +/- 0.12, N = 3 SE +/- 0.21, N = 3 SE +/- 0.72, N = 3 SE +/- 0.26, N = 3 SE +/- 0.43, N = 15 SE +/- 0.34, N = 15 SE +/- 0.38, N = 15 SE +/- 0.17, N = 3 SE +/- 0.29, N = 12 SE +/- 0.19, N = 3 SE +/- 0.10, N = 3 SE +/- 0.23, N = 3 SE +/- 0.04, N = 3 SE +/- 0.22, N = 12 SE +/- 0.08, N = 3 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.24, N = 3 SE +/- 0.02, N = 3 SE +/- 0.13, N = 9 40.83 63.30 56.44 37.55 51.05 41.65 51.86 37.84 37.45 48.99 16.82 34.69 34.65 16.24 27.53 13.76 33.76 33.18 14.81 26.91 30.87 15.97 batches/sec Per Watt
OpenBenchmarking.org batches/sec Per Watt, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0747 0.1494 0.2241 0.2988 0.3735 0.080 0.258 0.225 0.077 0.192 0.073 0.188 0.066 0.114 0.236 0.040 0.149 0.178 0.044 0.175 0.046 0.305 0.332 0.045 0.194 0.194 0.045 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better PyTorch 2.2.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 110 220 330 440 550 Min: 79.08 / Avg: 511.14 / Max: 575.41 Min: 34.92 / Avg: 245.26 / Max: 293.93 Min: 59.74 / Avg: 250.75 / Max: 298.2 Min: 161.18 / Avg: 490.32 / Max: 568.06 Min: 74.44 / Avg: 265.6 / Max: 309.82 Min: 202.76 / Avg: 570.95 / Max: 625.38 Min: 70.81 / Avg: 276.02 / Max: 323.04 Min: 176.16 / Avg: 577.13 / Max: 637.06 Min: 98.32 / Avg: 327.4 / Max: 419.31 Min: 56.55 / Avg: 207.89 / Max: 238.03 Min: 63.73 / Avg: 418.64 / Max: 475.03 Min: 35.86 / Avg: 232.68 / Max: 261.18 Min: 30.14 / Avg: 194.55 / Max: 219.58 Min: 58.93 / Avg: 369.53 / Max: 409.87 Min: 21.06 / Avg: 157.61 / Max: 175.55 Min: 39.07 / Avg: 298.03 / Max: 341.96 Min: 18.44 / Avg: 110.66 / Max: 125.07 Min: 17.13 / Avg: 99.8 / Max: 111.33 Min: 105.19 / Avg: 327.79 / Max: 351.26 Min: 43.57 / Avg: 138.61 / Max: 153.19 Min: 43.48 / Avg: 159.18 / Max: 178.15 Min: 108.16 / Avg: 354.05 / Max: 391.41 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 30396 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 9647 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 12203 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 33832 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 14785 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 33115 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 15936 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 41553 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 20582 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 10048 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 54737 Joules per run. 12. EPYC 9684X: Approximate power consumption of 15357 Joules per run. 13. EPYC 9654: Approximate power consumption of 12970 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 49640 Joules per run. 15. EPYC 9754: Approximate power consumption of 13082 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 48429 Joules per run. 17. EPYC 8534P: Approximate power consumption of 7451 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 6753 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 49933 Joules per run. 20. Xeon 6766E: Approximate power consumption of 11644 Joules per run. 21. Xeon 6780E: Approximate power consumption of 11832 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 59362 Joules per run.
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: yolov4 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 5 10 15 20 25 SE +/- 0.11392, N = 3 SE +/- 0.13074, N = 3 SE +/- 0.01672, N = 3 SE +/- 0.01439, N = 3 SE +/- 0.05802, N = 3 SE +/- 0.12795, N = 3 SE +/- 0.00279, N = 3 SE +/- 0.02010, N = 3 SE +/- 0.09305, N = 3 SE +/- 0.11211, N = 3 SE +/- 0.00606, N = 3 SE +/- 0.00491, N = 3 SE +/- 0.01934, N = 3 SE +/- 0.02467, N = 3 SE +/- 0.01474, N = 3 SE +/- 0.07368, N = 3 SE +/- 0.00112, N = 3 SE +/- 0.03807, N = 3 SE +/- 0.05214, N = 3 SE +/- 0.04609, N = 3 SE +/- 0.03075, N = 3 SE +/- 0.02942, N = 3 14.19800 20.87950 18.14130 12.75460 16.17420 13.08690 16.38980 12.59740 14.21690 17.67470 6.31828 9.80008 9.78516 6.34891 8.63594 5.55767 8.75814 8.47283 4.58960 7.13587 7.69583 4.56278 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: yolov4 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 50 100 150 200 250 SE +/- 0.57, N = 3 SE +/- 0.30, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.22, N = 3 SE +/- 0.74, N = 3 SE +/- 0.01, N = 3 SE +/- 0.13, N = 3 SE +/- 0.46, N = 3 SE +/- 0.36, N = 3 SE +/- 0.15, N = 3 SE +/- 0.05, N = 3 SE +/- 0.20, N = 3 SE +/- 0.61, N = 3 SE +/- 0.20, N = 3 SE +/- 2.38, N = 3 SE +/- 0.01, N = 3 SE +/- 0.53, N = 3 SE +/- 2.49, N = 3 SE +/- 0.91, N = 3 SE +/- 0.52, N = 3 SE +/- 1.41, N = 3 70.44 47.90 55.12 78.40 61.83 76.42 61.01 79.38 70.34 56.58 158.27 102.04 102.19 157.51 115.79 179.99 114.17 118.02 217.93 140.14 129.94 219.17 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.17 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 110 220 330 440 550 Min: 103.81 / Avg: 450.11 / Max: 482.7 Min: 53.1 / Avg: 243.23 / Max: 261.05 Min: 67.07 / Avg: 552.04 / Max: 595.99 Min: 33.83 / Avg: 279.27 / Max: 303.77 Min: 29.58 / Avg: 236.8 / Max: 255.65 Min: 59.75 / Avg: 482.18 / Max: 521.5 Min: 21.66 / Avg: 192.93 / Max: 209.55 Min: 39.89 / Avg: 406.34 / Max: 438.62 Min: 19.76 / Avg: 124.93 / Max: 135 Min: 18.05 / Avg: 113.49 / Max: 122.89 Min: 104.75 / Avg: 350.62 / Max: 384.9 Min: 43.74 / Avg: 152.65 / Max: 163.54 Min: 43.53 / Avg: 179.64 / Max: 193.29 Min: 108.42 / Avg: 392.56 / Max: 431.32 1. Xeon Platinum 8380 2P: Approximate power consumption of 29257 Joules per run. 2. Xeon Platinum 8380: Approximate power consumption of 15891 Joules per run. 3. EPYC 9684X 2P: Approximate power consumption of 35699 Joules per run. 4. EPYC 9684X: Approximate power consumption of 18246 Joules per run. 5. EPYC 9654: Approximate power consumption of 15313 Joules per run. 6. EPYC 9654 2P: Approximate power consumption of 31341 Joules per run. 7. EPYC 9754: Approximate power consumption of 12540 Joules per run. 8. EPYC 9754 2P: Approximate power consumption of 26547 Joules per run. 9. EPYC 8534P: Approximate power consumption of 8121 Joules per run. 10. EPYC 8534PN: Approximate power consumption of 7377 Joules per run. 11. Xeon 6766E 2P: Approximate power consumption of 23258 Joules per run. 12. Xeon 6766E: Approximate power consumption of 9973 Joules per run. 13. Xeon 6780E: Approximate power consumption of 11736 Joules per run. 14. Xeon 6780E 2P: Approximate power consumption of 26040 Joules per run.
NAS Parallel Benchmarks NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: CG.C Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 20K 40K 60K 80K 100K SE +/- 271.54, N = 6 SE +/- 328.18, N = 8 SE +/- 243.41, N = 12 SE +/- 178.23, N = 8 SE +/- 313.88, N = 7 SE +/- 545.92, N = 15 SE +/- 260.16, N = 15 SE +/- 560.41, N = 15 SE +/- 28.62, N = 7 SE +/- 34.34, N = 6 SE +/- 661.05, N = 7 SE +/- 386.70, N = 9 SE +/- 393.67, N = 15 SE +/- 779.47, N = 7 SE +/- 480.71, N = 15 SE +/- 545.82, N = 5 SE +/- 126.79, N = 6 SE +/- 207.19, N = 6 98764.93 63760.45 33811.63 58128.24 35116.55 65396.22 35234.06 66492.44 38906.13 22655.32 88487.91 62071.10 53182.77 84477.72 43799.78 63265.01 22229.94 21684.80 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6 Total Mop/s Per Watt
OpenBenchmarking.org Total Mop/s Per Watt, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: CG.C Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 90 180 270 360 450 305.56 401.38 156.61 145.15 157.12 153.93 155.78 154.97 119.68 119.97 295.11 384.09 356.27 302.72 283.84 254.62 226.89 244.61 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better NAS Parallel Benchmarks 3.4 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 140 280 420 560 700 Min: 54.43 / Avg: 323.22 / Max: 766.2 Min: 25.74 / Avg: 158.85 / Max: 377.04 Min: 57.02 / Avg: 215.9 / Max: 374.98 Min: 146.08 / Avg: 400.48 / Max: 754.34 Min: 74.58 / Avg: 223.5 / Max: 376.44 Min: 187.39 / Avg: 424.86 / Max: 754.4 Min: 71.23 / Avg: 226.18 / Max: 377.45 Min: 189.85 / Avg: 429.08 / Max: 754.24 Min: 100.01 / Avg: 325.09 / Max: 579.93 Min: 52.98 / Avg: 188.84 / Max: 288.7 Min: 58.39 / Avg: 299.85 / Max: 772.2 Min: 17.06 / Avg: 161.61 / Max: 378.41 Min: 26.59 / Avg: 149.28 / Max: 317.86 Min: 55.55 / Avg: 279.06 / Max: 655.46 Min: 19.49 / Avg: 154.31 / Max: 321.83 Min: 38.61 / Avg: 248.47 / Max: 653.54 Min: 17.31 / Avg: 97.98 / Max: 151 Min: 16.9 / Avg: 88.65 / Max: 135.53 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 3502 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 1271 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 2015 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 3604 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 2043 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 3569 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 2081 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 3633 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 3065 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 2109 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 2656 Joules per run. 12. EPYC 9684X: Approximate power consumption of 1203 Joules per run. 13. EPYC 9654: Approximate power consumption of 1174 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 2551 Joules per run. 15. EPYC 9754: Approximate power consumption of 1471 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 4721 Joules per run. 17. EPYC 8534P: Approximate power consumption of 1143 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1064 Joules per run.
ASKAP ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Million Grid Points Per Second, More Is Better ASKAP 1.0 Test: tConvolve MT - Gridding Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 3K 6K 9K 12K 15K SE +/- 60.72, N = 3 SE +/- 54.27, N = 5 SE +/- 4.15, N = 3 SE +/- 75.19, N = 5 SE +/- 87.89, N = 12 SE +/- 23.56, N = 3 SE +/- 32.87, N = 12 SE +/- 195.28, N = 8 SE +/- 19.36, N = 3 SE +/- 6.18, N = 3 SE +/- 204.28, N = 3 SE +/- 262.30, N = 12 SE +/- 59.24, N = 3 SE +/- 141.43, N = 5 SE +/- 2.09, N = 3 SE +/- 21.01, N = 3 SE +/- 0.88, N = 3 SE +/- 0.88, N = 3 6038.92 5062.07 8088.11 7630.06 3375.32 3347.93 3406.96 4382.97 5279.07 5172.96 14185.10 14955.60 12394.60 12708.50 12731.80 11208.70 5826.44 5821.46 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
Embree Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon Obj Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 50 100 150 200 250 SE +/- 0.29, N = 4 SE +/- 0.35, N = 3 SE +/- 0.09, N = 3 SE +/- 0.22, N = 4 SE +/- 0.08, N = 3 SE +/- 0.76, N = 3 SE +/- 0.09, N = 3 SE +/- 0.89, N = 15 SE +/- 0.10, N = 3 SE +/- 0.03, N = 3 SE +/- 1.72, N = 15 SE +/- 0.11, N = 4 SE +/- 0.02, N = 4 SE +/- 1.58, N = 15 SE +/- 0.07, N = 4 SE +/- 3.26, N = 12 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.22, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.09, N = 3 173.22 97.19 79.38 132.28 64.96 104.84 71.83 112.72 84.80 47.64 210.44 133.48 113.28 175.60 133.93 200.16 64.33 63.34 125.11 76.53 83.73 136.22 Frames Per Second Per Watt
OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon Obj Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.2201 0.4402 0.6603 0.8804 1.1005 0.579 0.523 0.368 0.320 0.263 0.222 0.291 0.240 0.272 0.261 0.602 0.716 0.693 0.575 0.978 0.759 0.642 0.713 0.635 0.746 0.719 0.643 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Embree 4.3 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 66.3 / Avg: 299.17 / Max: 755.1 Min: 26.36 / Avg: 185.86 / Max: 375.76 Min: 61.45 / Avg: 215.69 / Max: 377.02 Min: 164.62 / Avg: 413.97 / Max: 758.06 Min: 73.93 / Avg: 247.01 / Max: 377.15 Min: 193.13 / Avg: 472.12 / Max: 755.04 Min: 86.41 / Avg: 246.7 / Max: 376.83 Min: 187.33 / Avg: 469.55 / Max: 757.04 Min: 101.28 / Avg: 312.13 / Max: 580.75 Min: 54.43 / Avg: 182.65 / Max: 290.73 Min: 65.49 / Avg: 349.82 / Max: 819.75 Min: 32.74 / Avg: 186.36 / Max: 410.63 Min: 28.7 / Avg: 163.54 / Max: 333.81 Min: 56.83 / Avg: 305.41 / Max: 649.39 Min: 19.95 / Avg: 136.96 / Max: 327.05 Min: 36.73 / Avg: 263.84 / Max: 656.51 Min: 17.71 / Avg: 100.16 / Max: 169.93 Min: 17.83 / Avg: 88.8 / Max: 143.53 Min: 104.6 / Avg: 197.13 / Max: 492.74 Min: 43.56 / Avg: 102.53 / Max: 218.97 Min: 43.49 / Avg: 116.43 / Max: 260.73 Min: 106.69 / Avg: 211.77 / Max: 566.07 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 5460 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 3965 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 5248 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 8693 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 6422 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 10387 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 6168 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 10080 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 7491 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 5601 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 6040 Joules per run. 12. EPYC 9684X: Approximate power consumption of 3494 Joules per run. 13. EPYC 9654: Approximate power consumption of 3271 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 5457 Joules per run. 15. EPYC 9754: Approximate power consumption of 2808 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 5101 Joules per run. 17. EPYC 8534P: Approximate power consumption of 2637 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 2368 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 5191 Joules per run. 20. Xeon 6766E: Approximate power consumption of 3007 Joules per run. 21. Xeon 6780E: Approximate power consumption of 3144 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 5082 Joules per run.
Liquid-DSP LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 512 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 500M 1000M 1500M 2000M 2500M SE +/- 14465476.14, N = 3 SE +/- 240370.09, N = 3 SE +/- 1722723.94, N = 3 SE +/- 5630373.98, N = 3 SE +/- 569766.03, N = 3 SE +/- 4238841.56, N = 3 SE +/- 740202.67, N = 3 SE +/- 6728628.72, N = 3 SE +/- 11053858.05, N = 3 SE +/- 4629652.01, N = 3 SE +/- 14870701.99, N = 3 SE +/- 2676440.42, N = 3 SE +/- 520683.31, N = 3 SE +/- 11753202.87, N = 3 SE +/- 1300000.00, N = 3 SE +/- 1650252.51, N = 3 SE +/- 776881.23, N = 3 SE +/- 170391.71, N = 3 SE +/- 2198737.01, N = 3 SE +/- 320537.74, N = 3 SE +/- 409267.64, N = 3 SE +/- 6411708.04, N = 3 2027000000 1178766667 1020833333 1616966667 838530000 1444066667 944550000 1518933333 1061033333 542606667 2394333333 1570400000 1362166667 2129533333 1744700000 1734800000 821013333 741740000 1306733333 848376667 940270000 1437100000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid samples/s Per Watt
OpenBenchmarking.org samples/s Per Watt, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 512 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 1.4M 2.8M 4.2M 5.6M 7M 3272343.49 3805850.46 3267678.46 2571656.77 2666847.49 2269719.80 2982249.17 2388645.74 2190947.55 2257184.32 3603186.16 4387111.54 4853033.94 4001237.14 6413920.52 4657018.09 5998206.24 6532499.05 3182607.79 3974344.33 3349035.56 2808259.47 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Liquid-DSP 1.6 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 70.53 / Avg: 619.43 / Max: 752.7 Min: 25.3 / Avg: 309.72 / Max: 376.79 Min: 60.01 / Avg: 312.4 / Max: 376.93 Min: 157.59 / Avg: 628.76 / Max: 754.2 Min: 74.44 / Avg: 314.43 / Max: 376.72 Min: 210.59 / Avg: 636.23 / Max: 755.25 Min: 77.34 / Avg: 316.72 / Max: 376.86 Min: 198.99 / Avg: 635.9 / Max: 752.9 Min: 104.84 / Avg: 484.28 / Max: 583.22 Min: 53.55 / Avg: 240.39 / Max: 291.06 Min: 67.21 / Avg: 664.5 / Max: 779.27 Min: 35.59 / Avg: 357.96 / Max: 411.45 Min: 29.69 / Avg: 280.68 / Max: 320.8 Min: 53.43 / Avg: 532.22 / Max: 613.02 Min: 20.69 / Avg: 272.02 / Max: 314.58 Min: 40.06 / Avg: 372.51 / Max: 431.46 Min: 17.86 / Avg: 136.88 / Max: 157.55 Min: 17.93 / Avg: 113.55 / Max: 130.59 Min: 108.01 / Avg: 410.59 / Max: 495.66 Min: 43.63 / Avg: 213.46 / Max: 250.49 Min: 43.73 / Avg: 280.76 / Max: 332.63 Min: 109.82 / Avg: 511.74 / Max: 621.27 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 21474 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 10737 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 10934 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 22007 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 11005 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 22056 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 10980 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 21832 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 16950 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 8494 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 23258 Joules per run. 12. EPYC 9684X: Approximate power consumption of 12529 Joules per run. 13. EPYC 9654: Approximate power consumption of 9824 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 18095 Joules per run. 15. EPYC 9754: Approximate power consumption of 9521 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 13038 Joules per run. 17. EPYC 8534P: Approximate power consumption of 4791 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 4012 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 15055 Joules per run. 20. Xeon 6766E: Approximate power consumption of 7756 Joules per run. 21. Xeon 6780E: Approximate power consumption of 10201 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 18423 Joules per run.
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: super-resolution-10 - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 60 120 180 240 300 SE +/- 3.39, N = 3 SE +/- 0.03, N = 3 SE +/- 0.16, N = 3 SE +/- 4.15, N = 15 SE +/- 0.09, N = 3 SE +/- 2.30, N = 4 SE +/- 0.25, N = 3 SE +/- 1.02, N = 3 SE +/- 6.83, N = 12 SE +/- 1.75, N = 3 SE +/- 2.15, N = 12 SE +/- 0.58, N = 3 SE +/- 0.67, N = 3 SE +/- 0.61, N = 3 SE +/- 0.26, N = 3 SE +/- 2.46, N = 15 SE +/- 0.30, N = 3 SE +/- 0.30, N = 3 SE +/- 0.27, N = 3 SE +/- 0.31, N = 3 SE +/- 0.32, N = 3 SE +/- 0.60, N = 15 251.31 259.19 227.42 212.92 217.88 205.89 213.99 199.90 192.81 197.85 119.56 122.95 122.68 95.84 106.13 98.64 106.53 102.97 59.50 59.30 66.20 66.18 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: super-resolution-10 - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 4 8 12 16 20 SE +/- 0.05342, N = 3 SE +/- 0.00044, N = 3 SE +/- 0.00313, N = 3 SE +/- 0.10855, N = 15 SE +/- 0.00187, N = 3 SE +/- 0.05347, N = 4 SE +/- 0.00532, N = 3 SE +/- 0.02558, N = 3 SE +/- 0.28946, N = 12 SE +/- 0.04501, N = 3 SE +/- 0.18371, N = 12 SE +/- 0.03798, N = 3 SE +/- 0.04482, N = 3 SE +/- 0.06617, N = 3 SE +/- 0.02331, N = 3 SE +/- 0.26893, N = 15 SE +/- 0.02616, N = 3 SE +/- 0.02847, N = 3 SE +/- 0.07602, N = 3 SE +/- 0.08782, N = 3 SE +/- 0.07241, N = 3 SE +/- 0.14238, N = 15 3.98013 3.85774 4.39649 4.72530 4.58912 4.85818 4.67269 5.00222 5.29844 5.05427 8.39969 8.13326 8.15092 10.43440 9.42177 10.23106 9.38681 9.71131 16.80620 16.86310 15.10570 15.12740 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.17 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 60 120 180 240 300 Min: 98.64 / Avg: 328.39 / Max: 359.38 Min: 51.72 / Avg: 236.59 / Max: 257.65 Min: 62.01 / Avg: 306.76 / Max: 325.52 Min: 28.38 / Avg: 160.26 / Max: 175.87 Min: 27.15 / Avg: 144.22 / Max: 153.32 Min: 57.88 / Avg: 270.43 / Max: 286.65 Min: 21.68 / Avg: 106.78 / Max: 113.35 Min: 40.2 / Avg: 219.21 / Max: 234.95 Min: 18.73 / Avg: 83.53 / Max: 88.8 Min: 16.93 / Avg: 76.89 / Max: 81.74 Min: 103.86 / Avg: 127.8 / Max: 131.15 Min: 33.7 / Avg: 65.57 / Max: 67.97 Min: 43.48 / Avg: 72.93 / Max: 75.76 Min: 104.68 / Avg: 138.22 / Max: 146.78 1. Xeon Platinum 8380 2P: Approximate power consumption of 21017 Joules per run. 2. Xeon Platinum 8380: Approximate power consumption of 15221 Joules per run. 3. EPYC 9684X 2P: Approximate power consumption of 19556 Joules per run. 4. EPYC 9684X: Approximate power consumption of 10684 Joules per run. 5. EPYC 9654: Approximate power consumption of 9278 Joules per run. 6. EPYC 9654 2P: Approximate power consumption of 17308 Joules per run. 7. EPYC 9754: Approximate power consumption of 6834 Joules per run. 8. EPYC 9754 2P: Approximate power consumption of 14015 Joules per run. 9. EPYC 8534P: Approximate power consumption of 5374 Joules per run. 10. EPYC 8534PN: Approximate power consumption of 4895 Joules per run. 11. Xeon 6766E 2P: Approximate power consumption of 8222 Joules per run. 12. Xeon 6766E: Approximate power consumption of 4218 Joules per run. 13. Xeon 6780E: Approximate power consumption of 4668 Joules per run. 14. Xeon 6780E 2P: Approximate power consumption of 8864 Joules per run.
Liquid-DSP LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 32 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 2000M 4000M 6000M 8000M 10000M SE +/- 6711433.03, N = 3 SE +/- 2516611.48, N = 3 SE +/- 4021608.30, N = 3 SE +/- 10496401.50, N = 3 SE +/- 1320353.49, N = 3 SE +/- 2447674.63, N = 3 SE +/- 1338323.99, N = 3 SE +/- 895048.11, N = 3 SE +/- 7369833.41, N = 3 SE +/- 1266666.67, N = 3 SE +/- 34610274.65, N = 3 SE +/- 11426625.83, N = 3 SE +/- 1419311.26, N = 3 SE +/- 46730658.51, N = 3 SE +/- 3768731.00, N = 3 SE +/- 2936551.27, N = 3 SE +/- 1501110.70, N = 3 SE +/- 1928730.15, N = 3 SE +/- 32054242.22, N = 3 SE +/- 821245.67, N = 3 SE +/- 2601495.30, N = 3 SE +/- 20501246.57, N = 3 6077300000 3167200000 3243800000 6116566667 2381800000 4670966667 2769066667 5367033333 3572233333 1823566667 7935266667 5862466667 5271933333 7513333333 6588200000 6439000000 3062200000 2789600000 6821533333 4301166667 4799133333 7546366667 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid samples/s Per Watt
OpenBenchmarking.org samples/s Per Watt, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 32 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 5M 10M 15M 20M 25M 9752693.41 10180344.31 10249944.70 9661394.05 8576477.66 7263532.04 9061082.03 8335236.32 7299110.00 7475059.61 12478169.67 16171511.91 17844515.21 13431732.69 22727990.09 16713460.67 21992105.60 23304528.15 17638157.23 21409914.84 18436155.38 15839180.07 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Liquid-DSP 1.6 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 70.49 / Avg: 623.14 / Max: 733.57 Min: 25.92 / Avg: 311.11 / Max: 357.53 Min: 59.61 / Avg: 316.47 / Max: 377.01 Min: 160.12 / Avg: 633.09 / Max: 754.38 Min: 74.86 / Avg: 277.71 / Max: 312.01 Min: 186.6 / Avg: 643.07 / Max: 754.55 Min: 78.49 / Avg: 305.6 / Max: 341.63 Min: 204.52 / Avg: 643.9 / Max: 752.56 Min: 101.34 / Avg: 489.41 / Max: 581.58 Min: 52.43 / Avg: 243.95 / Max: 291.4 Min: 65.54 / Avg: 635.93 / Max: 742.68 Min: 34.34 / Avg: 362.52 / Max: 411.45 Min: 30.54 / Avg: 295.44 / Max: 336.72 Min: 59.09 / Avg: 559.37 / Max: 644.46 Min: 21.58 / Avg: 289.87 / Max: 330.19 Min: 40.61 / Avg: 385.26 / Max: 440.96 Min: 18.82 / Avg: 139.24 / Max: 159.66 Min: 16.68 / Avg: 119.7 / Max: 139.58 Min: 104.79 / Avg: 386.75 / Max: 438.06 Min: 43.68 / Avg: 200.9 / Max: 230.57 Min: 43.63 / Avg: 260.31 / Max: 300.33 Min: 107.72 / Avg: 476.44 / Max: 538.02 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 21394 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 10681 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 10760 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 21736 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 9627 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 21864 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 10492 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 21892 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 16803 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 8457 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 21834 Joules per run. 12. EPYC 9684X: Approximate power consumption of 12446 Joules per run. 13. EPYC 9654: Approximate power consumption of 10143 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 19019 Joules per run. 15. EPYC 9754: Approximate power consumption of 9952 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 13099 Joules per run. 17. EPYC 8534P: Approximate power consumption of 4781 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 4070 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 13278 Joules per run. 20. Xeon 6766E: Approximate power consumption of 6897 Joules per run. 21. Xeon 6780E: Approximate power consumption of 9024 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 16358 Joules per run.
ASTC Encoder ASTC Encoder (astcenc) is for the Adaptive Scalable Texture Compression (ASTC) format commonly used with OpenGL, OpenGL ES, and Vulkan graphics APIs. This test profile does a coding test of both compression/decompression. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org MT/s, More Is Better ASTC Encoder 4.7 Preset: Medium Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 SE +/- 1.56, N = 7 SE +/- 1.17, N = 6 SE +/- 0.16, N = 6 SE +/- 2.79, N = 6 SE +/- 0.03, N = 6 SE +/- 0.52, N = 6 SE +/- 0.08, N = 6 SE +/- 0.77, N = 6 SE +/- 2.26, N = 5 SE +/- 0.32, N = 4 SE +/- 3.11, N = 7 SE +/- 0.63, N = 7 SE +/- 0.20, N = 7 SE +/- 3.54, N = 6 SE +/- 0.39, N = 7 SE +/- 0.52, N = 6 SE +/- 0.07, N = 6 SE +/- 0.07, N = 6 SE +/- 1.77, N = 5 SE +/- 0.18, N = 5 SE +/- 0.13, N = 6 SE +/- 2.01, N = 5 550.02 327.78 333.99 484.55 247.30 441.65 284.33 483.10 216.97 126.44 508.09 500.77 449.11 491.53 527.80 462.24 294.62 273.67 338.15 284.46 314.62 363.38 1. (CXX) g++ options: -O3 -flto -pthread MT/s Per Watt
OpenBenchmarking.org MT/s Per Watt, More Is Better ASTC Encoder 4.7 Preset: Medium Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 1.1363 2.2726 3.4089 4.5452 5.6815 1.983 2.012 1.923 1.414 1.167 1.094 1.373 1.215 0.741 0.720 1.966 3.488 3.553 2.099 5.050 2.377 3.926 3.989 2.084 3.191 3.076 2.048 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ASTC Encoder 4.7 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 75.77 / Avg: 277.37 / Max: 691.02 Min: 26.56 / Avg: 162.88 / Max: 364.95 Min: 60.47 / Avg: 173.64 / Max: 368.66 Min: 149.65 / Avg: 342.67 / Max: 671.28 Min: 73.51 / Avg: 211.87 / Max: 372.54 Min: 202.14 / Avg: 403.63 / Max: 727.09 Min: 46.45 / Avg: 207.12 / Max: 368.04 Min: 188.21 / Avg: 397.48 / Max: 724.85 Min: 94.9 / Avg: 291.19 / Max: 532.11 Min: 49.69 / Avg: 175.72 / Max: 288.95 Min: 60.92 / Avg: 258.49 / Max: 596.25 Min: 32.4 / Avg: 143.57 / Max: 393.87 Min: 27.98 / Avg: 126.4 / Max: 324.02 Min: 57.21 / Avg: 234.22 / Max: 515.92 Min: 20.85 / Avg: 104.51 / Max: 314.72 Min: 38.51 / Avg: 194.48 / Max: 419.92 Min: 16.05 / Avg: 75.04 / Max: 166.06 Min: 15.15 / Avg: 68.61 / Max: 143.04 Min: 103.94 / Avg: 162.27 / Max: 347.6 Min: 43.61 / Avg: 89.14 / Max: 212.79 Min: 43.4 / Avg: 102.28 / Max: 269.1 Min: 105.97 / Avg: 177.44 / Max: 411 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 2774 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 1819 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 2084 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 3712 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 2613 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 4305 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 2451 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 4240 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 3960 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 2855 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 2659 Joules per run. 12. EPYC 9684X: Approximate power consumption of 1395 Joules per run. 13. EPYC 9654: Approximate power consumption of 1246 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 2381 Joules per run. 15. EPYC 9754: Approximate power consumption of 1090 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 2237 Joules per run. 17. EPYC 8534P: Approximate power consumption of 876 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 812 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 2207 Joules per run. 20. Xeon 6766E: Approximate power consumption of 1194 Joules per run. 21. Xeon 6780E: Approximate power consumption of 1279 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 2307 Joules per run.
WRF WRF, the Weather Research and Forecasting Model, is a "next-generation mesoscale numerical weather prediction system designed for both atmospheric research and operational forecasting applications. It features two dynamical cores, a data assimilation system, and a software architecture supporting parallel computation and system extensibility." Learn more via the OpenBenchmarking.org test page.
NAS Parallel Benchmarks NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: MG.C Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 50K 100K 150K 200K 250K SE +/- 1422.07, N = 7 SE +/- 406.29, N = 9 SE +/- 152.92, N = 9 SE +/- 1262.04, N = 9 SE +/- 436.97, N = 10 SE +/- 1415.96, N = 9 SE +/- 382.59, N = 10 SE +/- 1298.67, N = 9 SE +/- 233.83, N = 9 SE +/- 53.56, N = 9 SE +/- 7207.31, N = 15 SE +/- 1372.89, N = 15 SE +/- 1153.71, N = 15 SE +/- 2707.72, N = 14 SE +/- 884.47, N = 9 SE +/- 1776.37, N = 11 SE +/- 167.65, N = 8 SE +/- 301.54, N = 8 220893.78 107321.89 83448.70 163333.21 85910.95 172614.10 86407.46 171436.47 110742.15 57317.66 244738.81 134994.14 116725.04 194942.32 125567.07 245447.72 63930.64 62449.55 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6 Total Mop/s Per Watt
OpenBenchmarking.org Total Mop/s Per Watt, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: MG.C Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 300 600 900 1200 1500 757.48 858.24 517.49 496.64 499.08 476.05 480.22 454.47 446.48 378.76 928.22 1119.20 1070.68 823.46 1265.55 988.65 906.46 953.72 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better NAS Parallel Benchmarks 3.4 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 130 260 390 520 650 Min: 70.18 / Avg: 291.62 / Max: 590.65 Min: 25.53 / Avg: 125.05 / Max: 346.36 Min: 59.14 / Avg: 161.26 / Max: 333.63 Min: 142.29 / Avg: 328.87 / Max: 698.64 Min: 72.77 / Avg: 172.14 / Max: 347.7 Min: 183.3 / Avg: 362.6 / Max: 714.29 Min: 73.21 / Avg: 179.93 / Max: 359.94 Min: 193.92 / Avg: 377.22 / Max: 729.73 Min: 99.93 / Avg: 248.03 / Max: 546.61 Min: 52.21 / Avg: 151.33 / Max: 280.05 Min: 62.46 / Avg: 263.66 / Max: 710.66 Min: 29.67 / Avg: 120.62 / Max: 340.18 Min: 27.57 / Avg: 109.02 / Max: 286.49 Min: 55.9 / Avg: 236.74 / Max: 614.68 Min: 21.58 / Avg: 99.22 / Max: 284.09 Min: 40.32 / Avg: 248.27 / Max: 531.63 Min: 17.11 / Avg: 70.53 / Max: 141.22 Min: 16.49 / Avg: 65.48 / Max: 127.89 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 2958 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 917 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 1147 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 2448 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 1153 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 2578 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 1242 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 2724 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 1709 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 1177 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 2127 Joules per run. 12. EPYC 9684X: Approximate power consumption of 772 Joules per run. 13. EPYC 9654: Approximate power consumption of 727 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 1894 Joules per run. 15. EPYC 9754: Approximate power consumption of 750 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 3340 Joules per run. 17. EPYC 8534P: Approximate power consumption of 564 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 516 Joules per run.
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: GPT-2 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 50 100 150 200 250 SE +/- 0.81, N = 3 SE +/- 0.27, N = 3 SE +/- 0.53, N = 3 SE +/- 0.78, N = 3 SE +/- 1.04, N = 3 SE +/- 1.53, N = 3 SE +/- 2.63, N = 3 SE +/- 0.26, N = 3 SE +/- 1.59, N = 3 SE +/- 0.64, N = 3 SE +/- 0.48, N = 3 SE +/- 0.64, N = 3 SE +/- 0.08, N = 3 SE +/- 0.35, N = 3 SE +/- 0.17, N = 3 SE +/- 0.19, N = 3 SE +/- 0.64, N = 3 SE +/- 0.43, N = 3 SE +/- 0.40, N = 3 SE +/- 0.09, N = 3 SE +/- 0.23, N = 3 SE +/- 0.04, N = 3 195.45 248.68 191.56 144.64 191.11 135.98 188.93 136.69 153.54 180.23 110.17 161.50 156.61 109.46 137.19 99.22 128.98 129.65 58.58 131.54 140.03 60.39 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: GPT-2 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 4 8 12 16 20 SE +/- 0.02114, N = 3 SE +/- 0.00434, N = 3 SE +/- 0.01428, N = 3 SE +/- 0.03717, N = 3 SE +/- 0.02823, N = 3 SE +/- 0.08283, N = 3 SE +/- 0.07483, N = 3 SE +/- 0.01417, N = 3 SE +/- 0.06784, N = 3 SE +/- 0.01980, N = 3 SE +/- 0.03939, N = 3 SE +/- 0.02436, N = 3 SE +/- 0.00351, N = 3 SE +/- 0.02885, N = 3 SE +/- 0.00921, N = 3 SE +/- 0.01997, N = 3 SE +/- 0.03809, N = 3 SE +/- 0.02580, N = 3 SE +/- 0.11771, N = 3 SE +/- 0.00515, N = 3 SE +/- 0.01181, N = 3 SE +/- 0.01174, N = 3 5.10948 4.01687 5.21520 6.90619 5.22781 7.34848 5.29027 7.30822 6.50747 5.54379 9.06607 6.18478 6.37780 9.12452 7.28087 10.06660 7.74521 7.70511 17.05530 7.59589 7.13535 16.54180 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.17 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 60 120 180 240 300 Min: 97.1 / Avg: 306.05 / Max: 325.94 Min: 53.03 / Avg: 204.41 / Max: 224.2 Min: 61.69 / Avg: 290.82 / Max: 309 Min: 35.03 / Avg: 153.85 / Max: 164.75 Min: 27.22 / Avg: 134.62 / Max: 143.75 Min: 57.53 / Avg: 262.4 / Max: 276.96 Min: 19.44 / Avg: 102.38 / Max: 109.98 Min: 40 / Avg: 213.81 / Max: 226.08 Min: 16.21 / Avg: 79.24 / Max: 84.5 Min: 15.83 / Avg: 75.69 / Max: 81.06 Min: 103.68 / Avg: 180.17 / Max: 191.33 Min: 43.73 / Avg: 95.8 / Max: 101.7 Min: 43.53 / Avg: 101.74 / Max: 108.09 Min: 94.92 / Avg: 183.21 / Max: 193.59 1. Xeon Platinum 8380 2P: Approximate power consumption of 20097 Joules per run. 2. Xeon Platinum 8380: Approximate power consumption of 13423 Joules per run. 3. EPYC 9684X 2P: Approximate power consumption of 19194 Joules per run. 4. EPYC 9684X: Approximate power consumption of 10051 Joules per run. 5. EPYC 9654: Approximate power consumption of 8795 Joules per run. 6. EPYC 9654 2P: Approximate power consumption of 17144 Joules per run. 7. EPYC 9754: Approximate power consumption of 6757 Joules per run. 8. EPYC 9754 2P: Approximate power consumption of 14040 Joules per run. 9. EPYC 8534P: Approximate power consumption of 5203 Joules per run. 10. EPYC 8534PN: Approximate power consumption of 4996 Joules per run. 11. Xeon 6766E 2P: Approximate power consumption of 12072 Joules per run. 12. Xeon 6766E: Approximate power consumption of 6355 Joules per run. 13. Xeon 6780E: Approximate power consumption of 6749 Joules per run. 14. Xeon 6780E 2P: Approximate power consumption of 12214 Joules per run.
PyTorch This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark]. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: ResNet-152 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 6 12 18 24 30 SE +/- 0.19, N = 5 SE +/- 0.08, N = 3 SE +/- 0.09, N = 3 SE +/- 0.16, N = 4 SE +/- 0.26, N = 3 SE +/- 0.18, N = 3 SE +/- 0.16, N = 3 SE +/- 0.13, N = 8 SE +/- 0.10, N = 3 SE +/- 0.12, N = 3 SE +/- 0.20, N = 12 SE +/- 0.01, N = 3 SE +/- 0.09, N = 3 SE +/- 0.27, N = 9 SE +/- 0.04, N = 3 SE +/- 0.15, N = 12 SE +/- 0.17, N = 3 SE +/- 0.06, N = 3 SE +/- 0.17, N = 9 SE +/- 0.12, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 17.57 27.21 19.41 15.77 19.99 17.91 18.07 14.86 16.68 22.27 8.35 15.86 15.57 8.27 13.05 6.64 15.25 15.11 6.47 13.39 14.53 7.10 batches/sec Per Watt
OpenBenchmarking.org batches/sec Per Watt, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: ResNet-152 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0351 0.0702 0.1053 0.1404 0.1755 0.034 0.113 0.080 0.033 0.076 0.031 0.067 0.026 0.056 0.111 0.020 0.069 0.081 0.022 0.084 0.022 0.146 0.156 0.020 0.096 0.092 0.020 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better PyTorch 2.2.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 110 220 330 440 550 Min: 79.16 / Avg: 511.35 / Max: 559.55 Min: 33.7 / Avg: 239.78 / Max: 273.27 Min: 58.34 / Avg: 242.81 / Max: 264.97 Min: 162.11 / Avg: 476.49 / Max: 563.05 Min: 73.95 / Avg: 262.34 / Max: 291.94 Min: 196.88 / Avg: 571.95 / Max: 613.16 Min: 73.16 / Avg: 270.76 / Max: 301.09 Min: 196.56 / Avg: 578.74 / Max: 617.41 Min: 102.12 / Avg: 295.35 / Max: 320.3 Min: 55.11 / Avg: 200.49 / Max: 223.6 Min: 61.36 / Avg: 418.43 / Max: 475.94 Min: 30.38 / Avg: 228.52 / Max: 247.96 Min: 27.2 / Avg: 192.05 / Max: 207.21 Min: 55.84 / Avg: 369.03 / Max: 409.77 Min: 19.56 / Avg: 155.97 / Max: 167.94 Min: 20.22 / Avg: 296.81 / Max: 327.42 Min: 16.21 / Avg: 104.37 / Max: 113.9 Min: 16.2 / Avg: 97.09 / Max: 104.85 Min: 54.23 / Avg: 317.38 / Max: 347.71 Min: 43.54 / Avg: 139.02 / Max: 150.49 Min: 43.41 / Avg: 158.21 / Max: 172.64 Min: 107.67 / Avg: 362.4 / Max: 382.35 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 37226 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 11669 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 15864 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 37524 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 17227 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 40608 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 21571 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 49193 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 22053 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 11628 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 58789 Joules per run. 12. EPYC 9684X: Approximate power consumption of 17596 Joules per run. 13. EPYC 9654: Approximate power consumption of 15044 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 52443 Joules per run. 15. EPYC 9754: Approximate power consumption of 14454 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 52041 Joules per run. 17. EPYC 8534P: Approximate power consumption of 8454 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 7929 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 58927 Joules per run. 20. Xeon 6766E: Approximate power consumption of 12789 Joules per run. 21. Xeon 6780E: Approximate power consumption of 13448 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 61125 Joules per run.
LULESH LULESH is the Livermore Unstructured Lagrangian Explicit Shock Hydrodynamics. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org z/s, More Is Better LULESH 2.0.3 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 15K 30K 45K 60K 75K SE +/- 359.29, N = 3 SE +/- 437.51, N = 4 SE +/- 182.38, N = 15 SE +/- 272.44, N = 4 SE +/- 211.12, N = 6 SE +/- 206.20, N = 5 SE +/- 217.67, N = 6 SE +/- 207.54, N = 5 SE +/- 188.07, N = 8 SE +/- 53.94, N = 5 SE +/- 675.87, N = 3 SE +/- 194.65, N = 15 SE +/- 372.12, N = 3 SE +/- 349.39, N = 15 SE +/- 244.17, N = 3 SE +/- 427.75, N = 3 SE +/- 372.63, N = 12 SE +/- 373.78, N = 12 SE +/- 55.60, N = 3 SE +/- 254.25, N = 6 SE +/- 314.85, N = 4 SE +/- 91.45, N = 3 70826.73 38433.97 23072.30 43724.06 23848.54 52102.67 25831.84 53269.47 21389.82 17348.43 54678.49 27287.26 26082.71 48760.82 24218.83 46126.08 16949.59 16855.89 42946.26 26024.60 26864.11 44136.53 1. (CXX) g++ options: -O3 -fopenmp -lm -lmpi_cxx -lmpi z/s Per Watt
OpenBenchmarking.org z/s Per Watt, More Is Better LULESH 2.0.3 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 40 80 120 160 200 143.95 155.84 105.60 88.38 100.41 97.72 103.89 100.20 50.91 84.83 122.54 130.21 143.77 123.49 134.50 122.60 149.38 162.52 144.08 167.31 153.17 134.87 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better LULESH 2.0.3 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 69.2 / Avg: 492.01 / Max: 729.97 Min: 22.84 / Avg: 246.63 / Max: 365.09 Min: 50.79 / Avg: 218.49 / Max: 329.56 Min: 165.01 / Avg: 494.73 / Max: 717.17 Min: 73.71 / Avg: 237.51 / Max: 333.91 Min: 198.01 / Avg: 533.2 / Max: 722.21 Min: 73.96 / Avg: 248.64 / Max: 365.61 Min: 194.87 / Avg: 531.65 / Max: 728.1 Min: 100.66 / Avg: 420.13 / Max: 555.76 Min: 53.1 / Avg: 204.51 / Max: 281.83 Min: 68.15 / Avg: 446.2 / Max: 721.49 Min: 31.6 / Avg: 209.57 / Max: 345.61 Min: 27.74 / Avg: 181.42 / Max: 285.77 Min: 55.4 / Avg: 394.86 / Max: 598.6 Min: 21.79 / Avg: 180.07 / Max: 311.6 Min: 41.83 / Avg: 376.23 / Max: 647.63 Min: 19.22 / Avg: 113.47 / Max: 157.81 Min: 17.36 / Avg: 103.72 / Max: 135.92 Min: 105.26 / Avg: 298.06 / Max: 439.37 Min: 43.63 / Avg: 155.54 / Max: 229.09 Min: 43.51 / Avg: 175.39 / Max: 270.27 Min: 107.92 / Avg: 327.25 / Max: 513.74 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 10496 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 4254 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 2840 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 8410 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 2929 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 7678 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 2901 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 7656 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 10661 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 3108 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 10709 Joules per run. 12. EPYC 9684X: Approximate power consumption of 4652 Joules per run. 13. EPYC 9654: Approximate power consumption of 4112 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 10161 Joules per run. 15. EPYC 9754: Approximate power consumption of 7863 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 16930 Joules per run. 17. EPYC 8534P: Approximate power consumption of 3612 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 3310 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 14208 Joules per run. 20. Xeon 6766E: Approximate power consumption of 6196 Joules per run. 21. Xeon 6780E: Approximate power consumption of 6753 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 15053 Joules per run.
Embree Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 50 100 150 200 250 SE +/- 0.26, N = 8 SE +/- 0.13, N = 6 SE +/- 0.05, N = 5 SE +/- 0.13, N = 7 SE +/- 0.04, N = 5 SE +/- 0.63, N = 6 SE +/- 0.11, N = 5 SE +/- 1.20, N = 15 SE +/- 0.29, N = 6 SE +/- 0.04, N = 4 SE +/- 2.04, N = 8 SE +/- 0.07, N = 7 SE +/- 0.03, N = 6 SE +/- 1.54, N = 8 SE +/- 0.12, N = 7 SE +/- 1.88, N = 7 SE +/- 0.03, N = 5 SE +/- 0.05, N = 5 SE +/- 0.10, N = 6 SE +/- 0.04, N = 5 SE +/- 0.05, N = 5 SE +/- 0.16, N = 7 199.61 112.66 91.99 152.75 75.47 125.75 83.49 129.75 99.24 55.42 231.43 155.12 132.49 185.71 156.39 208.31 75.21 73.91 138.85 84.71 92.88 151.25 Frames Per Second Per Watt
OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.194 0.388 0.582 0.776 0.97 0.508 0.494 0.428 0.323 0.276 0.246 0.312 0.253 0.258 0.253 0.564 0.662 0.735 0.518 0.862 0.620 0.613 0.706 0.457 0.550 0.520 0.453 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Embree 4.3 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 66.59 / Avg: 393.21 / Max: 754.66 Min: 24.21 / Avg: 228.28 / Max: 376.12 Min: 60.02 / Avg: 215.03 / Max: 377.71 Min: 166.53 / Avg: 472.72 / Max: 754.96 Min: 66.39 / Avg: 273.07 / Max: 377.18 Min: 200.84 / Avg: 511.17 / Max: 752.67 Min: 74.25 / Avg: 267.87 / Max: 377.44 Min: 185.96 / Avg: 511.91 / Max: 753.56 Min: 102.21 / Avg: 383.99 / Max: 581.28 Min: 54.93 / Avg: 219.18 / Max: 290.54 Min: 59.43 / Avg: 410.15 / Max: 817.39 Min: 31.26 / Avg: 234.18 / Max: 410.22 Min: 28.26 / Avg: 180.38 / Max: 335.4 Min: 55.21 / Avg: 358.56 / Max: 646.17 Min: 20.65 / Avg: 181.41 / Max: 329.67 Min: 42.62 / Avg: 335.83 / Max: 642.99 Min: 18.74 / Avg: 122.78 / Max: 171.96 Min: 16.8 / Avg: 104.66 / Max: 145.45 Min: 105.4 / Avg: 303.74 / Max: 488.69 Min: 43.66 / Avg: 153.94 / Max: 217.83 Min: 43.49 / Avg: 178.58 / Max: 261.5 Min: 108.43 / Avg: 333.95 / Max: 567.53 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 3441 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 2625 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 3527 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 4795 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 3987 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 5623 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 3697 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 5563 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 4800 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 4000 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 3538 Joules per run. 12. EPYC 9684X: Approximate power consumption of 2241 Joules per run. 13. EPYC 9654: Approximate power consumption of 2165 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 3406 Joules per run. 15. EPYC 9754: Approximate power consumption of 1762 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 3118 Joules per run. 17. EPYC 8534P: Approximate power consumption of 1817 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1549 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 3291 Joules per run. 20. Xeon 6766E: Approximate power consumption of 2124 Joules per run. 21. Xeon 6780E: Approximate power consumption of 2322 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 3483 Joules per run.
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 70 140 210 280 350 SE +/- 0.40, N = 3 SE +/- 2.52, N = 3 SE +/- 1.80, N = 3 SE +/- 1.01, N = 3 SE +/- 2.40, N = 3 SE +/- 2.72, N = 15 SE +/- 3.31, N = 5 SE +/- 1.78, N = 3 SE +/- 0.64, N = 3 SE +/- 1.65, N = 3 SE +/- 3.21, N = 15 SE +/- 0.95, N = 3 SE +/- 4.35, N = 15 SE +/- 3.84, N = 12 SE +/- 2.12, N = 15 SE +/- 1.44, N = 15 SE +/- 2.24, N = 15 SE +/- 2.40, N = 15 SE +/- 0.44, N = 3 SE +/- 1.47, N = 3 SE +/- 0.67, N = 3 SE +/- 0.05, N = 3 171.23 314.06 315.41 177.76 330.10 174.68 296.80 161.89 222.52 335.15 141.83 243.34 225.31 133.49 160.90 117.62 219.06 211.19 80.42 130.06 143.36 87.09 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 3 6 9 12 15 SE +/- 0.01358, N = 3 SE +/- 0.02572, N = 3 SE +/- 0.01810, N = 3 SE +/- 0.03225, N = 3 SE +/- 0.02187, N = 3 SE +/- 0.09530, N = 15 SE +/- 0.03815, N = 5 SE +/- 0.06816, N = 3 SE +/- 0.01280, N = 3 SE +/- 0.01476, N = 3 SE +/- 0.14799, N = 15 SE +/- 0.01598, N = 3 SE +/- 0.08822, N = 15 SE +/- 0.20624, N = 12 SE +/- 0.07891, N = 15 SE +/- 0.10131, N = 15 SE +/- 0.04633, N = 15 SE +/- 0.05392, N = 15 SE +/- 0.06840, N = 3 SE +/- 0.08614, N = 3 SE +/- 0.03249, N = 3 SE +/- 0.00701, N = 3 5.83954 3.18392 3.17002 5.62517 3.02897 5.74491 3.37034 6.17796 4.49317 2.98306 7.09682 4.10914 4.46135 7.55558 6.22791 8.51808 4.57029 4.74221 12.43450 7.68977 6.97509 11.48200 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.17 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 100 200 300 400 500 Min: 101.4 / Avg: 445.3 / Max: 473.57 Min: 54.43 / Avg: 235.28 / Max: 251.36 Min: 60.4 / Avg: 551.5 / Max: 590.7 Min: 31.68 / Avg: 288.98 / Max: 309.48 Min: 29.39 / Avg: 241.91 / Max: 260.94 Min: 55.26 / Avg: 482.11 / Max: 517.72 Min: 15.87 / Avg: 195.33 / Max: 210.52 Min: 39.76 / Avg: 407.81 / Max: 436.29 Min: 17.38 / Avg: 123.79 / Max: 132.65 Min: 15.97 / Avg: 109.73 / Max: 119.37 Min: 104.79 / Avg: 305.05 / Max: 321.54 Min: 43.68 / Avg: 148.15 / Max: 156.57 Min: 43.64 / Avg: 174.72 / Max: 185.33 Min: 108.03 / Avg: 350.61 / Max: 370.78 1. Xeon Platinum 8380 2P: Approximate power consumption of 28351 Joules per run. 2. Xeon Platinum 8380: Approximate power consumption of 15136 Joules per run. 3. EPYC 9684X 2P: Approximate power consumption of 35112 Joules per run. 4. EPYC 9684X: Approximate power consumption of 18591 Joules per run. 5. EPYC 9654: Approximate power consumption of 15482 Joules per run. 6. EPYC 9654 2P: Approximate power consumption of 30694 Joules per run. 7. EPYC 9754: Approximate power consumption of 12501 Joules per run. 8. EPYC 9754 2P: Approximate power consumption of 26045 Joules per run. 9. EPYC 8534P: Approximate power consumption of 7931 Joules per run. 10. EPYC 8534PN: Approximate power consumption of 7023 Joules per run. 11. Xeon 6766E 2P: Approximate power consumption of 19523 Joules per run. 12. Xeon 6766E: Approximate power consumption of 9531 Joules per run. 13. Xeon 6780E: Approximate power consumption of 11240 Joules per run. 14. Xeon 6780E 2P: Approximate power consumption of 22556 Joules per run.
Kvazaar This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Slow Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 14 28 42 56 70 SE +/- 0.04, N = 4 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.00, N = 3 SE +/- 0.26, N = 5 SE +/- 0.07, N = 4 SE +/- 0.01, N = 4 SE +/- 0.50, N = 5 SE +/- 0.05, N = 4 SE +/- 0.47, N = 8 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.18, N = 3 40.92 24.23 20.23 31.24 17.52 26.00 18.24 28.96 19.71 15.09 62.82 40.00 38.90 61.07 38.47 54.88 23.71 22.46 29.15 18.86 20.87 31.85 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt Frames Per Second Per Watt
OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Slow Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0513 0.1026 0.1539 0.2052 0.2565 0.080 0.087 0.077 0.063 0.063 0.048 0.064 0.052 0.051 0.064 0.135 0.146 0.169 0.149 0.202 0.169 0.199 0.228 0.132 0.177 0.166 0.128 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Kvazaar 2.2 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 Min: 71.05 / Avg: 508.41 / Max: 687.83 Min: 28.15 / Avg: 278.75 / Max: 351.38 Min: 58.28 / Avg: 262.77 / Max: 303.74 Min: 168.67 / Avg: 496.87 / Max: 590.71 Min: 80.03 / Avg: 279.05 / Max: 314.96 Min: 210.38 / Avg: 537.83 / Max: 613.5 Min: 67.53 / Avg: 286.96 / Max: 322.9 Min: 195.26 / Avg: 552.42 / Max: 652.44 Min: 96.13 / Avg: 384.99 / Max: 445.25 Min: 52.23 / Avg: 234.47 / Max: 262.38 Min: 59.79 / Avg: 464.35 / Max: 680.95 Min: 30.18 / Avg: 273.17 / Max: 355.5 Min: 28.16 / Avg: 229.8 / Max: 294.04 Min: 58.04 / Avg: 409.96 / Max: 602.7 Min: 21.44 / Avg: 190.72 / Max: 249.47 Min: 38.94 / Avg: 325.22 / Max: 485.91 Min: 17.7 / Avg: 119.03 / Max: 142.44 Min: 15.1 / Avg: 98.52 / Max: 118.03 Min: 104.31 / Avg: 220.37 / Max: 264.43 Min: 43.61 / Avg: 106.79 / Max: 125.47 Min: 43.47 / Avg: 125.76 / Max: 153.18 Min: 105.65 / Avg: 248.74 / Max: 300.85 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 9787 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 8084 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 8934 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 11925 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 10790 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 14521 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 10617 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 13810 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 13346 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 10317 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 6408 Joules per run. 12. EPYC 9684X: Approximate power consumption of 5259 Joules per run. 13. EPYC 9654: Approximate power consumption of 4539 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 5739 Joules per run. 15. EPYC 9754: Approximate power consumption of 3767 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 4960 Joules per run. 17. EPYC 8534P: Approximate power consumption of 3531 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 3054 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 5509 Joules per run. 20. Xeon 6766E: Approximate power consumption of 3844 Joules per run. 21. Xeon 6780E: Approximate power consumption of 4108 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 5721 Joules per run.
Result
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Medium Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 14 28 42 56 70 SE +/- 0.27, N = 4 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.40, N = 5 SE +/- 0.01, N = 4 SE +/- 0.07, N = 4 SE +/- 0.56, N = 5 SE +/- 0.04, N = 4 SE +/- 0.52, N = 15 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.21, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.23, N = 3 41.58 24.80 20.97 32.04 18.13 26.69 18.84 29.62 20.33 15.51 63.48 40.50 39.58 61.11 39.08 54.57 24.31 23.02 29.15 19.34 21.39 31.70 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt Frames Per Second Per Watt
OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Medium Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0522 0.1044 0.1566 0.2088 0.261 0.082 0.090 0.080 0.065 0.065 0.050 0.066 0.054 0.053 0.066 0.135 0.148 0.181 0.151 0.207 0.169 0.200 0.232 0.135 0.185 0.172 0.130 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Kvazaar 2.2 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 Min: 75.75 / Avg: 509.74 / Max: 682.24 Min: 33.8 / Avg: 276.47 / Max: 362.01 Min: 61.73 / Avg: 263.01 / Max: 306.52 Min: 168.08 / Avg: 490.42 / Max: 593.69 Min: 77.93 / Avg: 280.57 / Max: 315.37 Min: 209.31 / Avg: 533.47 / Max: 617.43 Min: 69.51 / Avg: 286.2 / Max: 325.03 Min: 189.77 / Avg: 550.48 / Max: 652.57 Min: 103.66 / Avg: 385.29 / Max: 444.98 Min: 53 / Avg: 234.37 / Max: 263.04 Min: 66.41 / Avg: 469.54 / Max: 685.47 Min: 34.18 / Avg: 273.99 / Max: 354.7 Min: 26.12 / Avg: 219.12 / Max: 294.65 Min: 56.07 / Avg: 404.28 / Max: 599.6 Min: 20.71 / Avg: 188.76 / Max: 248.4 Min: 38.26 / Avg: 323.31 / Max: 486.48 Min: 17.56 / Avg: 121.69 / Max: 146.12 Min: 15.7 / Avg: 99.33 / Max: 124.48 Min: 104.63 / Avg: 216.52 / Max: 253.59 Min: 43.62 / Avg: 104.69 / Max: 123.24 Min: 43.55 / Avg: 124.03 / Max: 147.77 Min: 106.92 / Avg: 243.13 / Max: 293.72 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 9558 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 7925 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 8679 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 11606 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 10381 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 14582 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 10303 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 13579 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 12971 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 10078 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 6386 Joules per run. 12. EPYC 9684X: Approximate power consumption of 5206 Joules per run. 13. EPYC 9654: Approximate power consumption of 4437 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 5741 Joules per run. 15. EPYC 9754: Approximate power consumption of 3634 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 4914 Joules per run. 17. EPYC 8534P: Approximate power consumption of 3488 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 3013 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 5413 Joules per run. 20. Xeon 6766E: Approximate power consumption of 3699 Joules per run. 21. Xeon 6780E: Approximate power consumption of 3969 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 5673 Joules per run.
PyTorch This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark]. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-152 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 6 12 18 24 30 SE +/- 0.16, N = 3 SE +/- 0.29, N = 3 SE +/- 0.08, N = 3 SE +/- 0.13, N = 7 SE +/- 0.15, N = 3 SE +/- 0.09, N = 3 SE +/- 0.15, N = 3 SE +/- 0.18, N = 4 SE +/- 0.08, N = 3 SE +/- 0.05, N = 3 SE +/- 0.13, N = 9 SE +/- 0.20, N = 3 SE +/- 0.11, N = 3 SE +/- 0.13, N = 9 SE +/- 0.15, N = 3 SE +/- 0.12, N = 9 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 SE +/- 0.06, N = 9 SE +/- 0.04, N = 3 SE +/- 0.19, N = 3 SE +/- 0.04, N = 3 16.00 23.33 20.25 14.08 19.20 16.30 19.58 14.92 14.88 17.70 7.02 14.08 13.95 7.14 11.01 5.71 13.26 13.18 6.11 11.88 13.64 6.61 batches/sec Per Watt
OpenBenchmarking.org batches/sec Per Watt, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-152 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0284 0.0568 0.0852 0.1136 0.142 0.030 0.088 0.076 0.027 0.068 0.027 0.068 0.025 0.043 0.080 0.015 0.057 0.068 0.018 0.067 0.018 0.114 0.126 0.019 0.080 0.080 0.019 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better PyTorch 2.2.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 110 220 330 440 550 Min: 78.85 / Avg: 540.82 / Max: 576.97 Min: 33.57 / Avg: 265.19 / Max: 292.3 Min: 59.27 / Avg: 266.18 / Max: 295.86 Min: 161.77 / Avg: 525.94 / Max: 589.73 Min: 77.22 / Avg: 282.52 / Max: 309.36 Min: 199.23 / Avg: 598.06 / Max: 629.15 Min: 76.6 / Avg: 288.21 / Max: 321.16 Min: 199.11 / Avg: 604.22 / Max: 644.89 Min: 102.28 / Avg: 349.96 / Max: 424.69 Min: 54.09 / Avg: 220.44 / Max: 241.42 Min: 63.41 / Avg: 457.61 / Max: 501.36 Min: 34.62 / Avg: 245.31 / Max: 264.74 Min: 27.5 / Avg: 205.23 / Max: 220.66 Min: 56.85 / Avg: 395.96 / Max: 433.04 Min: 21.41 / Avg: 165.14 / Max: 176.25 Min: 40.42 / Avg: 321.8 / Max: 358.12 Min: 20.38 / Avg: 115.97 / Max: 125.68 Min: 16.06 / Avg: 104.56 / Max: 112.26 Min: 105.8 / Avg: 329.47 / Max: 356.81 Min: 43.61 / Avg: 148.21 / Max: 158.39 Min: 43.46 / Avg: 170.76 / Max: 186.26 Min: 107.99 / Avg: 344.44 / Max: 394.7 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 76436 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 25370 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 31587 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 83774 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 34750 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 82532 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 41598 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 97732 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 52610 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 26527 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 137689 Joules per run. 12. EPYC 9684X: Approximate power consumption of 38023 Joules per run. 13. EPYC 9654: Approximate power consumption of 32221 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 117160 Joules per run. 15. EPYC 9754: Approximate power consumption of 31707 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 118923 Joules per run. 17. EPYC 8534P: Approximate power consumption of 19096 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 17218 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 137572 Joules per run. 20. Xeon 6766E: Approximate power consumption of 27320 Joules per run. 21. Xeon 6780E: Approximate power consumption of 28062 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 226871 Joules per run.
Result
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-152 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 6 12 18 24 30 SE +/- 0.18, N = 3 SE +/- 0.16, N = 3 SE +/- 0.04, N = 3 SE +/- 0.09, N = 3 SE +/- 0.18, N = 7 SE +/- 0.09, N = 3 SE +/- 0.18, N = 7 SE +/- 0.16, N = 3 SE +/- 0.17, N = 3 SE +/- 0.13, N = 3 SE +/- 0.13, N = 9 SE +/- 0.12, N = 3 SE +/- 0.18, N = 3 SE +/- 0.14, N = 9 SE +/- 0.02, N = 3 SE +/- 0.11, N = 9 SE +/- 0.11, N = 3 SE +/- 0.09, N = 3 SE +/- 0.07, N = 3 SE +/- 0.14, N = 3 SE +/- 0.19, N = 3 SE +/- 0.07, N = 3 16.17 23.41 20.46 14.59 19.47 16.68 19.29 14.74 14.76 17.55 7.07 13.95 14.05 7.20 10.91 5.75 13.28 13.28 6.33 11.74 13.61 6.65 batches/sec Per Watt
OpenBenchmarking.org batches/sec Per Watt, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-152 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0286 0.0572 0.0858 0.1144 0.143 0.030 0.088 0.077 0.029 0.069 0.028 0.066 0.024 0.042 0.080 0.016 0.057 0.068 0.018 0.066 0.018 0.114 0.127 0.019 0.079 0.080 0.018 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better PyTorch 2.2.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 110 220 330 440 550 Min: 83.37 / Avg: 541.35 / Max: 576.05 Min: 33.85 / Avg: 264.62 / Max: 291.43 Min: 60.34 / Avg: 265.81 / Max: 296.61 Min: 167.37 / Avg: 511.16 / Max: 589.71 Min: 74.15 / Avg: 282.4 / Max: 310.35 Min: 204.68 / Avg: 599.73 / Max: 629.45 Min: 70.87 / Avg: 291.39 / Max: 322.93 Min: 191.23 / Avg: 602.51 / Max: 639.79 Min: 96.51 / Avg: 349.52 / Max: 424.02 Min: 55.66 / Avg: 220.18 / Max: 241.46 Min: 66.98 / Avg: 454.4 / Max: 498.76 Min: 35.28 / Avg: 245.06 / Max: 264.04 Min: 29.11 / Avg: 205.3 / Max: 221.54 Min: 57.69 / Avg: 396.9 / Max: 434.4 Min: 22.02 / Avg: 164.54 / Max: 175.34 Min: 40.81 / Avg: 321.68 / Max: 356.16 Min: 20.79 / Avg: 116.41 / Max: 125.98 Min: 17.18 / Avg: 104.85 / Max: 112.82 Min: 104.97 / Avg: 340.5 / Max: 358.58 Min: 43.61 / Avg: 148.25 / Max: 158.74 Min: 43.48 / Avg: 170.8 / Max: 185.92 Min: 108.01 / Avg: 376.47 / Max: 395.86 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 75248 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 25315 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 31543 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 79059 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 34856 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 80164 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 38713 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 100218 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 52195 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 26642 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 135007 Joules per run. 12. EPYC 9684X: Approximate power consumption of 38230 Joules per run. 13. EPYC 9654: Approximate power consumption of 32028 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 116336 Joules per run. 15. EPYC 9754: Approximate power consumption of 31976 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 116840 Joules per run. 17. EPYC 8534P: Approximate power consumption of 19091 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 17230 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 120877 Joules per run. 20. Xeon 6766E: Approximate power consumption of 27525 Joules per run. 21. Xeon 6780E: Approximate power consumption of 28125 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 126872 Joules per run.
Result
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-152 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 6 12 18 24 30 SE +/- 0.15, N = 12 SE +/- 0.34, N = 3 SE +/- 0.18, N = 3 SE +/- 0.17, N = 3 SE +/- 0.19, N = 5 SE +/- 0.21, N = 3 SE +/- 0.17, N = 12 SE +/- 0.05, N = 3 SE +/- 0.12, N = 3 SE +/- 0.05, N = 3 SE +/- 0.15, N = 9 SE +/- 0.10, N = 3 SE +/- 0.17, N = 3 SE +/- 0.13, N = 9 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.16, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 SE +/- 0.13, N = 3 SE +/- 0.05, N = 3 16.25 23.49 20.13 14.03 19.01 15.84 19.24 14.96 15.11 17.73 7.08 13.89 13.84 7.04 10.88 5.79 13.19 13.15 6.15 11.95 13.00 6.59 batches/sec Per Watt
OpenBenchmarking.org batches/sec Per Watt, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-152 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0284 0.0568 0.0852 0.1136 0.142 0.030 0.089 0.076 0.027 0.067 0.027 0.066 0.025 0.043 0.080 0.016 0.057 0.068 0.018 0.066 0.018 0.114 0.126 0.019 0.081 0.076 0.018 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better PyTorch 2.2.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 110 220 330 440 550 Min: 76.4 / Avg: 541.7 / Max: 581.39 Min: 34.31 / Avg: 264.8 / Max: 291.45 Min: 59.17 / Avg: 265.52 / Max: 295.66 Min: 161.59 / Avg: 520.21 / Max: 588.55 Min: 73.58 / Avg: 282.03 / Max: 308.67 Min: 211.71 / Avg: 595.73 / Max: 626.88 Min: 77.61 / Avg: 291.69 / Max: 322.84 Min: 193.13 / Avg: 605.19 / Max: 641.47 Min: 100.57 / Avg: 349.16 / Max: 423.16 Min: 55.98 / Avg: 220.28 / Max: 241.66 Min: 64.18 / Avg: 455.72 / Max: 501.58 Min: 32.56 / Avg: 244.28 / Max: 263 Min: 26.78 / Avg: 205 / Max: 221.09 Min: 39.14 / Avg: 396.83 / Max: 432.36 Min: 21.08 / Avg: 164.98 / Max: 175.44 Min: 40.59 / Avg: 320.17 / Max: 358.77 Min: 17.98 / Avg: 115.9 / Max: 125.2 Min: 15.84 / Avg: 103.98 / Max: 111.57 Min: 104.9 / Avg: 330.33 / Max: 356.82 Min: 43.61 / Avg: 148.31 / Max: 158.76 Min: 43.44 / Avg: 170.28 / Max: 183.58 Min: 107.82 / Avg: 374.58 / Max: 394.46 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 75793 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 25156 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 31685 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 83234 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 35141 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 84594 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 39184 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 96024 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 52025 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 26360 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 134488 Joules per run. 12. EPYC 9684X: Approximate power consumption of 38352 Joules per run. 13. EPYC 9654: Approximate power consumption of 32526 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 119577 Joules per run. 15. EPYC 9754: Approximate power consumption of 32116 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 116329 Joules per run. 17. EPYC 8534P: Approximate power consumption of 19084 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 17157 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 139949 Joules per run. 20. Xeon 6766E: Approximate power consumption of 27290 Joules per run. 21. Xeon 6780E: Approximate power consumption of 28948 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 129353 Joules per run.
oneDNN This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Deconvolution Batch shapes_3d - Engine: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.5619 1.1238 1.6857 2.2476 2.8095 SE +/- 0.000902, N = 9 SE +/- 0.000392, N = 9 SE +/- 0.000805, N = 9 SE +/- 0.001274, N = 9 SE +/- 0.000508, N = 9 SE +/- 0.000806, N = 9 SE +/- 0.000927, N = 9 SE +/- 0.001240, N = 9 SE +/- 0.001091, N = 9 SE +/- 0.006599, N = 9 SE +/- 0.002070, N = 9 SE +/- 0.001272, N = 9 SE +/- 0.001484, N = 9 SE +/- 0.001921, N = 9 SE +/- 0.001089, N = 9 SE +/- 0.003127, N = 9 SE +/- 0.000791, N = 9 SE +/- 0.001685, N = 9 SE +/- 0.001467, N = 9 SE +/- 0.001097, N = 9 SE +/- 0.002181, N = 9 SE +/- 0.001365, N = 9 0.624250 0.907161 1.077430 0.736170 1.264070 0.945075 1.196430 0.864358 0.867065 1.422130 1.001914 1.119230 1.154870 1.009473 0.943621 0.829653 1.498350 1.797490 2.497340 2.297120 2.049100 2.245260 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better oneDNN 3.4 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 70.82 / Avg: 355.72 / Max: 740.88 Min: 23.58 / Avg: 173.49 / Max: 373.63 Min: 51.81 / Avg: 187.58 / Max: 359.76 Min: 169.45 / Avg: 409.27 / Max: 716.88 Min: 73.57 / Avg: 201.22 / Max: 367.75 Min: 194.92 / Avg: 425.54 / Max: 706.02 Min: 69.85 / Avg: 202.05 / Max: 376 Min: 187.54 / Avg: 431.59 / Max: 733.22 Min: 98.61 / Avg: 304.22 / Max: 566.32 Min: 48.87 / Avg: 151.05 / Max: 290.31 Min: 62.97 / Avg: 300.29 / Max: 621 Min: 32.75 / Avg: 155.62 / Max: 314.15 Min: 26.3 / Avg: 135.34 / Max: 274.99 Min: 53.59 / Avg: 275.56 / Max: 567.73 Min: 20.19 / Avg: 122.35 / Max: 259.22 Min: 40.43 / Avg: 245.22 / Max: 491.94 Min: 16.93 / Avg: 70.08 / Max: 140.81 Min: 15.81 / Avg: 62.56 / Max: 121.69 Min: 103.52 / Avg: 196.1 / Max: 321.17 Min: 43.57 / Avg: 98.35 / Max: 172.87 Min: 43.45 / Avg: 112.89 / Max: 208.27 Min: 105.63 / Avg: 213.96 / Max: 368.1 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 2569 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 1234 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 1334 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 2956 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 1409 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 3026 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 1414 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 3069 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 2163 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 1057 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 2135 Joules per run. 12. EPYC 9684X: Approximate power consumption of 1107 Joules per run. 13. EPYC 9654: Approximate power consumption of 962 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 1960 Joules per run. 15. EPYC 9754: Approximate power consumption of 870 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 1771 Joules per run. 17. EPYC 8534P: Approximate power consumption of 498 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 445 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 1416 Joules per run. 20. Xeon 6766E: Approximate power consumption of 688 Joules per run. 21. Xeon 6780E: Approximate power consumption of 803 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 1521 Joules per run.
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 70 140 210 280 350 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.12, N = 3 SE +/- 0.02, N = 3 SE +/- 0.09, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 SE +/- 0.16, N = 14 SE +/- 0.08, N = 3 SE +/- 0.45, N = 12 SE +/- 0.10, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 4.48, N = 3 SE +/- 0.66, N = 3 SE +/- 0.65, N = 3 SE +/- 0.86, N = 3 13.15 9.40 13.95 15.96 11.37 17.15 12.72 18.72 26.33 25.91 22.20 13.52 16.32 23.12 22.67 28.10 17.30 18.49 340.26 82.12 75.22 293.36 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 43.35 / Avg: 637.42 / Max: 766.05 Min: 34.54 / Avg: 324.07 / Max: 405.42 Min: 60.51 / Avg: 327.19 / Max: 379.48 Min: 171.01 / Avg: 649.04 / Max: 743.64 Min: 73.68 / Avg: 329.15 / Max: 372.33 Min: 204.87 / Avg: 656.57 / Max: 725.7 Min: 85.86 / Avg: 330.63 / Max: 384.53 Min: 205.34 / Avg: 657.37 / Max: 743.06 Min: 103.92 / Avg: 501.31 / Max: 570.17 Min: 51.5 / Avg: 253.93 / Max: 289.36 Min: 67.53 / Avg: 716.78 / Max: 816.61 Min: 34.79 / Avg: 374.52 / Max: 409.97 Min: 29.75 / Avg: 315.18 / Max: 357.38 Min: 61.14 / Avg: 581.56 / Max: 658.32 Min: 20.78 / Avg: 292.63 / Max: 342.23 Min: 41.91 / Avg: 488.86 / Max: 570.14 Min: 17.46 / Avg: 161.25 / Max: 175.66 Min: 17.49 / Avg: 137.08 / Max: 149.27 Min: 105.02 / Avg: 307.84 / Max: 385.97 Min: 43.71 / Avg: 207.06 / Max: 230.09 Min: 43.5 / Avg: 248.78 / Max: 279.12 Min: 108.4 / Avg: 354.62 / Max: 434.65 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 43770 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 21497 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21704 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 44351 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 21724 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 44647 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 21711 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 44701 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 33588 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16505 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 50891 Joules per run. 12. EPYC 9684X: Approximate power consumption of 24843 Joules per run. 13. EPYC 9654: Approximate power consumption of 21027 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 41291 Joules per run. 15. EPYC 9754: Approximate power consumption of 19948 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 36501 Joules per run. 17. EPYC 8534P: Approximate power consumption of 10643 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 9093 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 24422 Joules per run. 20. Xeon 6766E: Approximate power consumption of 14218 Joules per run. 21. Xeon 6780E: Approximate power consumption of 17000 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 28015 Joules per run.
uvg266 uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Slow Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 10 20 30 40 50 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.12, N = 4 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.21, N = 4 SE +/- 0.04, N = 3 SE +/- 0.23, N = 4 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.18, N = 3 27.11 16.06 15.71 24.71 13.36 19.75 13.89 22.14 13.79 10.93 43.39 29.18 28.01 40.96 29.00 37.13 17.04 15.77 20.46 13.77 15.24 21.63 Frames Per Second Per Watt
OpenBenchmarking.org Frames Per Second Per Watt, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Slow Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0331 0.0662 0.0993 0.1324 0.1655 0.049 0.055 0.054 0.045 0.044 0.034 0.045 0.038 0.033 0.044 0.080 0.092 0.108 0.086 0.127 0.099 0.130 0.147 0.086 0.117 0.109 0.081 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better uvg266 0.4.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 75.78 / Avg: 550.27 / Max: 756.12 Min: 26.18 / Avg: 291.45 / Max: 378.34 Min: 61.29 / Avg: 289.12 / Max: 322.82 Min: 171.75 / Avg: 547.66 / Max: 641.35 Min: 76.03 / Avg: 301.55 / Max: 333.2 Min: 196.37 / Avg: 575.73 / Max: 648.93 Min: 38.16 / Avg: 306.83 / Max: 339.09 Min: 181.76 / Avg: 590.16 / Max: 673.18 Min: 102.97 / Avg: 423.75 / Max: 489.52 Min: 53.14 / Avg: 249.24 / Max: 277.94 Min: 66.68 / Avg: 543.26 / Max: 734.77 Min: 32.45 / Avg: 317.42 / Max: 382.18 Min: 28.73 / Avg: 258.29 / Max: 311.87 Min: 57.99 / Avg: 473.23 / Max: 616.87 Min: 21.98 / Avg: 227.72 / Max: 282.74 Min: 40.4 / Avg: 375.03 / Max: 518.77 Min: 18.85 / Avg: 130.95 / Max: 149.92 Min: 16.27 / Avg: 107.27 / Max: 124.79 Min: 104.27 / Avg: 238.73 / Max: 273.18 Min: 43.62 / Avg: 117.38 / Max: 135.39 Min: 43.49 / Avg: 139.76 / Max: 158.94 Min: 106.34 / Avg: 267.41 / Max: 316.34 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 14674 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 12144 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 12336 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 16065 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 14776 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 19767 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 14421 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 18492 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 20340 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 14705 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 9643 Joules per run. 12. EPYC 9684X: Approximate power consumption of 7724 Joules per run. 13. EPYC 9654: Approximate power consumption of 6630 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 8873 Joules per run. 15. EPYC 9754: Approximate power consumption of 5693 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 7688 Joules per run. 17. EPYC 8534P: Approximate power consumption of 5151 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 4505 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 7958 Joules per run. 20. Xeon 6766E: Approximate power consumption of 5595 Joules per run. 21. Xeon 6780E: Approximate power consumption of 6103 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 8557 Joules per run.
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: super-resolution-10 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 50 100 150 200 250 SE +/- 1.38, N = 3 SE +/- 1.98, N = 3 SE +/- 2.34, N = 3 SE +/- 0.74, N = 3 SE +/- 0.98, N = 3 SE +/- 1.17, N = 3 SE +/- 0.61, N = 3 SE +/- 0.62, N = 3 SE +/- 0.90, N = 3 SE +/- 0.40, N = 3 SE +/- 0.41, N = 3 SE +/- 0.99, N = 3 SE +/- 0.36, N = 3 SE +/- 0.53, N = 3 SE +/- 0.26, N = 3 SE +/- 0.83, N = 3 SE +/- 0.54, N = 3 SE +/- 0.72, N = 3 SE +/- 0.23, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.11, N = 3 214.81 234.54 205.53 188.89 195.71 173.91 190.06 169.85 178.62 176.29 87.26 108.87 110.00 86.92 94.74 78.07 97.05 96.17 60.29 69.07 75.87 65.43 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: super-resolution-10 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 4 8 12 16 20 SE +/- 0.02988, N = 3 SE +/- 0.03569, N = 3 SE +/- 0.05586, N = 3 SE +/- 0.02062, N = 3 SE +/- 0.02534, N = 3 SE +/- 0.03854, N = 3 SE +/- 0.01694, N = 3 SE +/- 0.02155, N = 3 SE +/- 0.02822, N = 3 SE +/- 0.01290, N = 3 SE +/- 0.05412, N = 3 SE +/- 0.08338, N = 3 SE +/- 0.03015, N = 3 SE +/- 0.06993, N = 3 SE +/- 0.02898, N = 3 SE +/- 0.13507, N = 3 SE +/- 0.05765, N = 3 SE +/- 0.07856, N = 3 SE +/- 0.06373, N = 3 SE +/- 0.00867, N = 3 SE +/- 0.00657, N = 3 SE +/- 0.02665, N = 3 4.65431 4.26352 4.86604 5.29287 5.10914 5.74921 5.26075 5.88628 5.59763 5.67175 11.45800 9.18524 9.08955 11.50240 10.55370 12.80930 10.30260 10.39770 16.58280 14.47610 13.17890 15.27840 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.17 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 60 120 180 240 300 Min: 102.14 / Avg: 339.94 / Max: 362.78 Min: 50.48 / Avg: 227.45 / Max: 243.02 Min: 64.69 / Avg: 300.88 / Max: 323.81 Min: 34.49 / Avg: 165.58 / Max: 176.42 Min: 29.43 / Avg: 145.22 / Max: 154.34 Min: 58.04 / Avg: 272.09 / Max: 288.97 Min: 20.2 / Avg: 107.51 / Max: 113.85 Min: 40.67 / Avg: 218.35 / Max: 232.79 Min: 17.58 / Avg: 85.08 / Max: 90.86 Min: 16.21 / Avg: 80.29 / Max: 85.38 Min: 103.7 / Avg: 151.35 / Max: 165.49 Min: 43.65 / Avg: 75.71 / Max: 78.31 Min: 43.53 / Avg: 86.18 / Max: 89.75 Min: 84.94 / Avg: 161.97 / Max: 179.97 1. Xeon Platinum 8380 2P: Approximate power consumption of 21869 Joules per run. 2. Xeon Platinum 8380: Approximate power consumption of 14481 Joules per run. 3. EPYC 9684X 2P: Approximate power consumption of 19357 Joules per run. 4. EPYC 9684X: Approximate power consumption of 10597 Joules per run. 5. EPYC 9654: Approximate power consumption of 9294 Joules per run. 6. EPYC 9654 2P: Approximate power consumption of 17505 Joules per run. 7. EPYC 9754: Approximate power consumption of 6881 Joules per run. 8. EPYC 9754 2P: Approximate power consumption of 14047 Joules per run. 9. EPYC 8534P: Approximate power consumption of 5445 Joules per run. 10. EPYC 8534PN: Approximate power consumption of 5139 Joules per run. 11. Xeon 6766E 2P: Approximate power consumption of 9787 Joules per run. 12. Xeon 6766E: Approximate power consumption of 4871 Joules per run. 13. Xeon 6780E: Approximate power consumption of 5544 Joules per run. 14. Xeon 6780E 2P: Approximate power consumption of 10474 Joules per run.
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.7444 1.4888 2.2332 2.9776 3.722 SE +/- 0.038257, N = 3 SE +/- 0.008053, N = 3 SE +/- 0.008707, N = 3 SE +/- 0.007683, N = 3 SE +/- 0.011894, N = 3 SE +/- 0.027020, N = 13 SE +/- 0.015170, N = 3 SE +/- 0.026516, N = 3 SE +/- 0.019617, N = 15 SE +/- 0.019473, N = 3 SE +/- 0.001170, N = 3 SE +/- 0.020352, N = 15 SE +/- 0.013875, N = 12 SE +/- 0.016597, N = 12 SE +/- 0.018814, N = 3 SE +/- 0.034519, N = 3 SE +/- 0.023203, N = 3 SE +/- 0.018603, N = 15 SE +/- 0.016386, N = 15 SE +/- 0.001935, N = 3 SE +/- 0.002384, N = 3 SE +/- 0.009611, N = 3 3.050850 3.308360 3.039220 2.834980 2.625440 2.174630 2.617210 2.104800 2.892530 2.752420 0.857685 1.251790 1.251350 0.917043 3.131560 2.517090 2.572780 2.254530 1.646740 1.778090 1.941440 1.703650 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 300 600 900 1200 1500 SE +/- 4.07, N = 3 SE +/- 0.74, N = 3 SE +/- 0.94, N = 3 SE +/- 0.96, N = 3 SE +/- 1.73, N = 3 SE +/- 5.57, N = 13 SE +/- 2.21, N = 3 SE +/- 6.06, N = 3 SE +/- 2.36, N = 15 SE +/- 2.55, N = 3 SE +/- 1.59, N = 3 SE +/- 13.72, N = 15 SE +/- 9.04, N = 12 SE +/- 19.12, N = 12 SE +/- 1.91, N = 3 SE +/- 5.48, N = 3 SE +/- 3.54, N = 3 SE +/- 3.59, N = 15 SE +/- 6.08, N = 15 SE +/- 0.61, N = 3 SE +/- 0.63, N = 3 SE +/- 3.30, N = 3 327.88 302.27 329.04 352.74 380.90 460.67 382.11 475.25 345.94 363.35 1165.93 801.96 800.23 1094.26 319.35 397.43 388.74 443.96 608.09 562.40 515.08 587.00 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.17 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 100 200 300 400 500 Min: 99.33 / Avg: 452.18 / Max: 484 Min: 53.76 / Avg: 239.05 / Max: 256.78 Min: 66.22 / Avg: 538.69 / Max: 582.15 Min: 33.01 / Avg: 268.04 / Max: 290.06 Min: 26.58 / Avg: 226.63 / Max: 248.05 Min: 57.08 / Avg: 475.82 / Max: 514.33 Min: 22.2 / Avg: 210.78 / Max: 229.48 Min: 40.33 / Avg: 426.23 / Max: 461.75 Min: 19.36 / Avg: 129.39 / Max: 140.24 Min: 15.82 / Avg: 105.18 / Max: 117.88 Min: 107.09 / Avg: 366.41 / Max: 399.46 Min: 43.69 / Avg: 159.26 / Max: 172.23 Min: 43.63 / Avg: 190.5 / Max: 207.06 Min: 109.34 / Avg: 411.87 / Max: 447.93 1. Xeon Platinum 8380 2P: Approximate power consumption of 29482 Joules per run. 2. Xeon Platinum 8380: Approximate power consumption of 15618 Joules per run. 3. EPYC 9684X 2P: Approximate power consumption of 35733 Joules per run. 4. EPYC 9684X: Approximate power consumption of 17637 Joules per run. 5. EPYC 9654: Approximate power consumption of 14863 Joules per run. 6. EPYC 9654 2P: Approximate power consumption of 31365 Joules per run. 7. EPYC 9754: Approximate power consumption of 13701 Joules per run. 8. EPYC 9754 2P: Approximate power consumption of 27705 Joules per run. 9. EPYC 8534P: Approximate power consumption of 8453 Joules per run. 10. EPYC 8534PN: Approximate power consumption of 6879 Joules per run. 11. Xeon 6766E 2P: Approximate power consumption of 24330 Joules per run. 12. Xeon 6766E: Approximate power consumption of 10511 Joules per run. 13. Xeon 6780E: Approximate power consumption of 12510 Joules per run. 14. Xeon 6780E 2P: Approximate power consumption of 27183 Joules per run.
Aircrack-ng Aircrack-ng is a tool for assessing WiFi/WLAN network security. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org k/s, More Is Better Aircrack-ng 1.7 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X EPYC 9654 EPYC 9754 EPYC 8534P EPYC 8534PN Xeon 6766E Xeon 6780E 40K 80K 120K 160K 200K SE +/- 773.70, N = 3 SE +/- 840.59, N = 3 SE +/- 1953.08, N = 3 SE +/- 1197.41, N = 15 SE +/- 36.42, N = 3 SE +/- 1027.07, N = 15 SE +/- 122.31, N = 3 SE +/- 1131.21, N = 15 SE +/- 1234.47, N = 15 SE +/- 728.55, N = 3 SE +/- 1622.56, N = 3 SE +/- 207.11, N = 3 SE +/- 714.86, N = 3 SE +/- 338.71, N = 3 SE +/- 319.60, N = 3 SE +/- 1379.58, N = 4 SE +/- 888.98, N = 3 64181.29 153584.20 147469.33 53914.93 117588.99 83665.76 134048.96 65663.82 159709.75 101665.47 206619.29 186675.43 177989.89 153818.03 141831.78 114715.79 116716.40 1. (CXX) g++ options: -std=gnu++17 -O3 -fvisibility=hidden -fcommon -rdynamic -lnl-3 -lnl-genl-3 -lpcre -lsqlite3 -lpthread -lz -lssl -lcrypto -lhwloc -ldl -lm -pthread k/s Per Watt
OpenBenchmarking.org k/s Per Watt, More Is Better Aircrack-ng 1.7 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X EPYC 9654 EPYC 9754 EPYC 8534P EPYC 8534PN Xeon 6766E Xeon 6780E 300 600 900 1200 1500 128.68 507.73 479.36 97.52 377.96 142.86 433.27 112.13 333.67 424.59 585.84 702.97 763.99 1057.15 1173.57 725.96 609.64 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Aircrack-ng 1.7 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X EPYC 9654 EPYC 9754 EPYC 8534P EPYC 8534PN Xeon 6766E Xeon 6780E 120 240 360 480 600 Min: 78.32 / Avg: 498.75 / Max: 586.29 Min: 25.19 / Avg: 302.49 / Max: 376.59 Min: 55.34 / Avg: 307.64 / Max: 375.71 Min: 160.46 / Avg: 552.88 / Max: 630.35 Min: 73.18 / Avg: 311.12 / Max: 377.22 Min: 195.2 / Avg: 585.65 / Max: 659.01 Min: 77.17 / Avg: 309.39 / Max: 375.45 Min: 193.67 / Avg: 585.6 / Max: 670.08 Min: 97.38 / Avg: 478.65 / Max: 580.33 Min: 53.68 / Avg: 239.45 / Max: 291.67 Min: 34.08 / Avg: 352.69 / Max: 410.53 Min: 29.99 / Avg: 265.55 / Max: 307.89 Min: 10.09 / Avg: 232.97 / Max: 273.01 Min: 17.23 / Avg: 145.5 / Max: 168.72 Min: 15.46 / Avg: 120.86 / Max: 145.49 Min: 43.62 / Avg: 158.02 / Max: 182.75 Min: 43.53 / Avg: 191.45 / Max: 221.34 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 17789 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 10688 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 10870 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 20715 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 10993 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 21903 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 11035 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 21940 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 16817 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 11254 Joules per run. 11. EPYC 9684X: Approximate power consumption of 12462 Joules per run. 12. EPYC 9654: Approximate power consumption of 12481 Joules per run. 13. EPYC 9754: Approximate power consumption of 8232 Joules per run. 14. EPYC 8534P: Approximate power consumption of 5141 Joules per run. 15. EPYC 8534PN: Approximate power consumption of 4270 Joules per run. 16. Xeon 6766E: Approximate power consumption of 5610 Joules per run. 17. Xeon 6780E: Approximate power consumption of 6765 Joules per run.
EPYC 9684X 2P: The test run did not produce a result.
EPYC 9654 2P: The test run did not produce a result.
EPYC 9754 2P: The test run did not produce a result.
Xeon 6766E 2P: The test run did not produce a result.
Xeon 6780E 2P: The test run did not produce a result.
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 5 10 15 20 25 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 5.18 5.19 6.43 5.72 5.27 5.55 5.77 6.02 5.93 6.56 5.34 5.41 5.85 5.98 6.25 6.60 6.77 7.60 19.23 18.20 16.41 16.98 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 83.99 / Avg: 648.24 / Max: 768.1 Min: 35.16 / Avg: 326.91 / Max: 374.78 Min: 58.3 / Avg: 329.39 / Max: 378.11 Min: 165.34 / Avg: 658.39 / Max: 751.53 Min: 72.13 / Avg: 330.52 / Max: 368.64 Min: 196.21 / Avg: 665.03 / Max: 748.66 Min: 77.72 / Avg: 331.34 / Max: 373.94 Min: 203.86 / Avg: 663.32 / Max: 752.94 Min: 100.5 / Avg: 510.02 / Max: 582.06 Min: 49.75 / Avg: 255.45 / Max: 289.44 Min: 65.72 / Avg: 754.92 / Max: 818.94 Min: 30.34 / Avg: 377.27 / Max: 406.75 Min: 31.29 / Avg: 316.48 / Max: 340.73 Min: 59.24 / Avg: 612.41 / Max: 670.98 Min: 21 / Avg: 311.43 / Max: 339.91 Min: 39.66 / Avg: 604.27 / Max: 668.8 Min: 18.15 / Avg: 159.45 / Max: 171.38 Min: 16.94 / Avg: 130.25 / Max: 140.67 Min: 105.68 / Avg: 456.22 / Max: 521.95 Min: 43.67 / Avg: 229.66 / Max: 249.94 Min: 43.59 / Avg: 299.29 / Max: 327.76 Min: 108.98 / Avg: 585.34 / Max: 658.24 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 42784 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 21358 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21410 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 43235 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 21484 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 43449 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 21427 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 43337 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 33151 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16519 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 49070 Joules per run. 12. EPYC 9684X: Approximate power consumption of 24397 Joules per run. 13. EPYC 9654: Approximate power consumption of 20465 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 40215 Joules per run. 15. EPYC 9754: Approximate power consumption of 20347 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 40285 Joules per run. 17. EPYC 8534P: Approximate power consumption of 10311 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 8466 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 31175 Joules per run. 20. Xeon 6766E: Approximate power consumption of 15081 Joules per run. 21. Xeon 6780E: Approximate power consumption of 19653 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 39999 Joules per run.
Timed Node.js Compilation This test profile times how long it takes to build/compile Node.js itself from source. Node.js is a JavaScript run-time built from the Chrome V8 JavaScript engine while itself is written in C/C++. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Timed Node.js Compilation 21.7.2 Time To Compile Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 90 180 270 360 450 SE +/- 0.12, N = 3 SE +/- 0.52, N = 3 SE +/- 0.71, N = 3 SE +/- 0.48, N = 3 SE +/- 0.53, N = 3 SE +/- 0.84, N = 3 SE +/- 0.74, N = 3 SE +/- 0.52, N = 3 SE +/- 0.68, N = 3 SE +/- 0.22, N = 3 SE +/- 1.19, N = 3 SE +/- 0.50, N = 3 SE +/- 0.59, N = 3 SE +/- 0.18, N = 3 SE +/- 0.72, N = 3 SE +/- 1.51, N = 3 SE +/- 0.17, N = 3 SE +/- 0.19, N = 3 SE +/- 1.20, N = 3 SE +/- 0.15, N = 3 SE +/- 0.51, N = 3 SE +/- 0.60, N = 3 145.41 214.43 254.00 172.99 270.38 175.63 252.65 171.17 303.42 423.63 114.91 147.84 164.02 118.90 186.10 147.74 277.53 288.12 187.65 246.85 228.57 173.09 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Timed Node.js Compilation 21.7.2 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 82.39 / Avg: 529.15 / Max: 756.15 Min: 33.43 / Avg: 295.74 / Max: 377.74 Min: 56.59 / Avg: 305.63 / Max: 376.82 Min: 157.7 / Avg: 555.35 / Max: 756.3 Min: 74.34 / Avg: 318.88 / Max: 376.31 Min: 200.82 / Avg: 601.52 / Max: 753.5 Min: 84.71 / Avg: 317.34 / Max: 376.11 Min: 190.08 / Avg: 584.7 / Max: 754.37 Min: 96.84 / Avg: 455.83 / Max: 582.18 Min: 50.7 / Avg: 248.06 / Max: 290.96 Min: 61.4 / Avg: 490.25 / Max: 822.63 Min: 30.95 / Avg: 289.15 / Max: 411.31 Min: 29.13 / Avg: 242.47 / Max: 351.76 Min: 55.68 / Avg: 430.05 / Max: 696.5 Min: 21.84 / Avg: 210.13 / Max: 338.39 Min: 41.45 / Avg: 361.3 / Max: 676 Min: 18.11 / Avg: 134.67 / Max: 172.23 Min: 16.32 / Avg: 118.09 / Max: 147.17 Min: 104.39 / Avg: 256.25 / Max: 503.96 Min: 43.59 / Avg: 148.97 / Max: 246.66 Min: 43.35 / Avg: 170.44 / Max: 300.92 Min: 106.88 / Avg: 287.54 / Max: 584 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 81312 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 65654 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 80177 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 100889 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 88649 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 110278 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 82613 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 107780 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 141915 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 107078 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 59974 Joules per run. 12. EPYC 9684X: Approximate power consumption of 45107 Joules per run. 13. EPYC 9654: Approximate power consumption of 41705 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 54760 Joules per run. 15. EPYC 9754: Approximate power consumption of 40976 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 56483 Joules per run. 17. EPYC 8534P: Approximate power consumption of 38561 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 35073 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 50653 Joules per run. 20. Xeon 6766E: Approximate power consumption of 38286 Joules per run. 21. Xeon 6780E: Approximate power consumption of 40621 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 52427 Joules per run.
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: T5 Encoder - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 100 200 300 400 500 SE +/- 3.01, N = 3 SE +/- 1.00, N = 3 SE +/- 0.84, N = 3 SE +/- 0.26, N = 3 SE +/- 3.95, N = 15 SE +/- 1.31, N = 3 SE +/- 0.51, N = 3 SE +/- 0.89, N = 3 SE +/- 4.93, N = 15 SE +/- 2.62, N = 15 SE +/- 4.17, N = 15 SE +/- 1.35, N = 3 SE +/- 1.08, N = 3 SE +/- 1.86, N = 3 SE +/- 1.16, N = 3 SE +/- 1.15, N = 3 SE +/- 0.98, N = 13 SE +/- 0.54, N = 3 SE +/- 11.98, N = 15 SE +/- 0.35, N = 3 SE +/- 0.17, N = 3 SE +/- 1.00, N = 3 356.76 460.78 357.36 288.47 219.53 199.08 215.13 185.46 292.52 298.67 263.52 279.64 187.01 167.11 131.00 127.54 127.09 127.21 178.11 207.94 217.45 210.37 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: T5 Encoder - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 2 4 6 8 10 SE +/- 0.02371, N = 3 SE +/- 0.00472, N = 3 SE +/- 0.00659, N = 3 SE +/- 0.00316, N = 3 SE +/- 0.08827, N = 15 SE +/- 0.03283, N = 3 SE +/- 0.01103, N = 3 SE +/- 0.02608, N = 3 SE +/- 0.06148, N = 15 SE +/- 0.03065, N = 15 SE +/- 0.06302, N = 15 SE +/- 0.01718, N = 3 SE +/- 0.03084, N = 3 SE +/- 0.06624, N = 3 SE +/- 0.06745, N = 3 SE +/- 0.07124, N = 3 SE +/- 0.06404, N = 13 SE +/- 0.03354, N = 3 SE +/- 0.56391, N = 15 SE +/- 0.00782, N = 3 SE +/- 0.00392, N = 3 SE +/- 0.02282, N = 3 2.80263 2.16966 2.79694 3.46571 4.57581 5.02267 4.64757 5.39123 3.43125 3.34966 3.80792 3.57543 5.34656 5.98436 7.63337 7.84065 7.87325 7.86015 6.14327 4.80725 4.59703 4.74859 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.17 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 60 120 180 240 300 Min: 99.68 / Avg: 289.97 / Max: 319.08 Min: 52.27 / Avg: 202.48 / Max: 217.49 Min: 34.94 / Avg: 287.83 / Max: 306.6 Min: 34.63 / Avg: 146.68 / Max: 155.53 Min: 26.07 / Avg: 125.08 / Max: 132.3 Min: 58.06 / Avg: 256.93 / Max: 271.34 Min: 20.82 / Avg: 94.1 / Max: 99.49 Min: 40.98 / Avg: 208.45 / Max: 223.35 Min: 16.9 / Avg: 70.5 / Max: 76.74 Min: 15.64 / Avg: 68.55 / Max: 73.08 Min: 75.92 / Avg: 152.85 / Max: 173.61 Min: 43.7 / Avg: 85.81 / Max: 89.61 Min: 43.39 / Avg: 88.68 / Max: 93.08 Min: 105.79 / Avg: 152.81 / Max: 159.65 1. Xeon Platinum 8380 2P: Approximate power consumption of 18848 Joules per run. 2. Xeon Platinum 8380: Approximate power consumption of 13148 Joules per run. 3. EPYC 9684X 2P: Approximate power consumption of 18767 Joules per run. 4. EPYC 9684X: Approximate power consumption of 9534 Joules per run. 5. EPYC 9654: Approximate power consumption of 8130 Joules per run. 6. EPYC 9654 2P: Approximate power consumption of 16700 Joules per run. 7. EPYC 9754: Approximate power consumption of 6148 Joules per run. 8. EPYC 9754 2P: Approximate power consumption of 13549 Joules per run. 9. EPYC 8534P: Approximate power consumption of 4583 Joules per run. 10. EPYC 8534PN: Approximate power consumption of 4433 Joules per run. 11. Xeon 6766E 2P: Approximate power consumption of 10007 Joules per run. 12. Xeon 6766E: Approximate power consumption of 5606 Joules per run. 13. Xeon 6780E: Approximate power consumption of 5794 Joules per run. 14. Xeon 6780E 2P: Approximate power consumption of 10034 Joules per run.
uvg266 uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Medium Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 10 20 30 40 50 SE +/- 0.05, N = 3 SE +/- 0.16, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.46, N = 4 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.23, N = 4 SE +/- 0.05, N = 3 SE +/- 0.28, N = 11 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.23, N = 5 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.16, N = 15 30.37 16.64 17.85 27.65 15.17 22.25 15.68 24.65 16.19 12.56 45.26 32.74 31.44 42.03 32.44 38.12 19.25 17.80 22.03 15.65 17.29 22.59 Frames Per Second Per Watt
OpenBenchmarking.org Frames Per Second Per Watt, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Medium Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0374 0.0748 0.1122 0.1496 0.187 0.057 0.059 0.062 0.051 0.051 0.039 0.051 0.042 0.038 0.051 0.086 0.105 0.150 0.090 0.145 0.105 0.148 0.166 0.094 0.134 0.124 0.087 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better uvg266 0.4.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 76.25 / Avg: 536.26 / Max: 744.89 Min: 26.08 / Avg: 283.27 / Max: 364.78 Min: 60.4 / Avg: 287.16 / Max: 327.69 Min: 168.73 / Avg: 543.59 / Max: 642.52 Min: 76.55 / Avg: 299.38 / Max: 332.83 Min: 208.68 / Avg: 571.96 / Max: 640.22 Min: 74.3 / Avg: 306.72 / Max: 336.87 Min: 190.07 / Avg: 582.58 / Max: 673.85 Min: 103.64 / Avg: 425.24 / Max: 481.28 Min: 52.84 / Avg: 248.57 / Max: 274.13 Min: 66.05 / Avg: 527.19 / Max: 710.22 Min: 34.79 / Avg: 310.62 / Max: 383.33 Min: 29.07 / Avg: 209.83 / Max: 311.67 Min: 56.62 / Avg: 464.69 / Max: 608.77 Min: 22.31 / Avg: 224.13 / Max: 286.22 Min: 40.54 / Avg: 362.19 / Max: 493.12 Min: 18.2 / Avg: 130.37 / Max: 151.17 Min: 16.52 / Avg: 107.55 / Max: 128.61 Min: 104.75 / Avg: 234.71 / Max: 274.07 Min: 43.61 / Avg: 116.67 / Max: 128.84 Min: 43.45 / Avg: 138.99 / Max: 161.82 Min: 107.22 / Avg: 259.74 / Max: 308.25 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 13049 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 11425 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 10912 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 14496 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 13173 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 17731 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 12984 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 16701 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 17435 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 12760 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 9226 Joules per run. 12. EPYC 9684X: Approximate power consumption of 6937 Joules per run. 13. EPYC 9654: Approximate power consumption of 6155 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 8481 Joules per run. 15. EPYC 9754: Approximate power consumption of 5155 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 7244 Joules per run. 17. EPYC 8534P: Approximate power consumption of 4606 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 4087 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 7417 Joules per run. 20. Xeon 6766E: Approximate power consumption of 4939 Joules per run. 21. Xeon 6780E: Approximate power consumption of 5421 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 8017 Joules per run.
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: yolov4 - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 6 12 18 24 30 SE +/- 0.09991, N = 3 SE +/- 0.05084, N = 3 SE +/- 0.04802, N = 3 SE +/- 0.06825, N = 3 SE +/- 0.16821, N = 15 SE +/- 0.29451, N = 15 SE +/- 0.15263, N = 15 SE +/- 0.09595, N = 14 SE +/- 0.06818, N = 3 SE +/- 0.15605, N = 3 SE +/- 0.08454, N = 3 SE +/- 0.12519, N = 3 SE +/- 0.08554, N = 8 SE +/- 0.04207, N = 3 SE +/- 0.05314, N = 3 SE +/- 0.09575, N = 3 SE +/- 0.10588, N = 4 SE +/- 0.09781, N = 5 SE +/- 0.06011, N = 3 SE +/- 0.05969, N = 3 SE +/- 0.09768, N = 3 SE +/- 0.01654, N = 3 16.96720 22.96890 19.85930 15.55550 18.21790 14.48310 16.91660 14.45830 16.41230 20.24950 7.24869 9.73685 9.86018 6.41229 8.29533 6.74977 8.87446 8.75233 7.49940 12.70150 13.82950 8.14615 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: yolov4 - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 30 60 90 120 150 SE +/- 0.35, N = 3 SE +/- 0.10, N = 3 SE +/- 0.12, N = 3 SE +/- 0.28, N = 3 SE +/- 0.55, N = 15 SE +/- 1.43, N = 15 SE +/- 0.55, N = 15 SE +/- 0.47, N = 14 SE +/- 0.25, N = 3 SE +/- 0.38, N = 3 SE +/- 1.60, N = 3 SE +/- 1.34, N = 3 SE +/- 0.88, N = 8 SE +/- 1.03, N = 3 SE +/- 0.77, N = 3 SE +/- 2.08, N = 3 SE +/- 1.36, N = 4 SE +/- 1.32, N = 5 SE +/- 1.08, N = 3 SE +/- 0.37, N = 3 SE +/- 0.51, N = 3 SE +/- 0.25, N = 3 58.94 43.54 50.35 64.29 54.96 69.45 59.18 69.20 60.93 49.39 137.99 102.73 101.47 155.96 120.56 148.21 112.73 114.31 133.36 78.73 72.31 122.75 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.17 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 110 220 330 440 550 Min: 98.37 / Avg: 446.63 / Max: 480.06 Min: 48.27 / Avg: 242.83 / Max: 266.43 Min: 67.43 / Avg: 546.46 / Max: 595.03 Min: 34.28 / Avg: 276.26 / Max: 300.81 Min: 25.1 / Avg: 234.83 / Max: 253.99 Min: 60.04 / Avg: 479.74 / Max: 516.86 Min: 20.25 / Avg: 189.72 / Max: 207.12 Min: 40.24 / Avg: 404.21 / Max: 436.31 Min: 18.9 / Avg: 123.51 / Max: 135.75 Min: 16.87 / Avg: 112.11 / Max: 123.24 Min: 103.87 / Avg: 332.75 / Max: 361.02 Min: 43.64 / Avg: 163.17 / Max: 174.94 Min: 43.43 / Avg: 192.41 / Max: 207.48 Min: 105.31 / Avg: 380 / Max: 411.37 1. Xeon Platinum 8380 2P: Approximate power consumption of 29031 Joules per run. 2. Xeon Platinum 8380: Approximate power consumption of 15865 Joules per run. 3. EPYC 9684X 2P: Approximate power consumption of 35520 Joules per run. 4. EPYC 9684X: Approximate power consumption of 17865 Joules per run. 5. EPYC 9654: Approximate power consumption of 15235 Joules per run. 6. EPYC 9654 2P: Approximate power consumption of 31023 Joules per run. 7. EPYC 9754: Approximate power consumption of 12395 Joules per run. 8. EPYC 9754 2P: Approximate power consumption of 26139 Joules per run. 9. EPYC 8534P: Approximate power consumption of 8090 Joules per run. 10. EPYC 8534PN: Approximate power consumption of 7287 Joules per run. 11. Xeon 6766E 2P: Approximate power consumption of 21850 Joules per run. 12. Xeon 6766E: Approximate power consumption of 10606 Joules per run. 13. Xeon 6780E: Approximate power consumption of 12571 Joules per run. 14. Xeon 6780E 2P: Approximate power consumption of 25080 Joules per run.
Timed Linux Kernel Compilation This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.8 Build: allmodconfig Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 SE +/- 0.56, N = 3 SE +/- 0.72, N = 3 SE +/- 0.80, N = 3 SE +/- 0.86, N = 3 SE +/- 0.61, N = 3 SE +/- 0.56, N = 3 SE +/- 0.67, N = 3 SE +/- 0.73, N = 3 SE +/- 0.92, N = 3 SE +/- 0.35, N = 3 SE +/- 0.98, N = 3 SE +/- 0.37, N = 3 SE +/- 0.49, N = 3 SE +/- 0.49, N = 3 SE +/- 1.05, N = 3 SE +/- 1.31, N = 3 SE +/- 0.91, N = 3 SE +/- 0.78, N = 3 SE +/- 0.81, N = 3 SE +/- 0.76, N = 3 SE +/- 0.67, N = 3 SE +/- 0.90, N = 3 189.74 316.90 362.45 218.57 428.39 246.94 384.06 231.03 356.99 612.78 182.00 290.34 311.83 197.63 337.69 210.20 406.41 438.17 192.10 274.86 251.20 174.27 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Timed Linux Kernel Compilation 6.8 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 150 300 450 600 750 Min: 85.15 / Avg: 585.62 / Max: 755.31 Min: 25.82 / Avg: 317.64 / Max: 378.37 Min: 56.91 / Avg: 323.36 / Max: 378.1 Min: 162.47 / Avg: 610.89 / Max: 756.51 Min: 70.17 / Avg: 330.93 / Max: 375.87 Min: 200.9 / Avg: 639.43 / Max: 753.88 Min: 81.1 / Avg: 330.36 / Max: 377.46 Min: 185.35 / Avg: 634.18 / Max: 755.16 Min: 99.55 / Avg: 491.75 / Max: 583.83 Min: 50.2 / Avg: 256.23 / Max: 291.69 Min: 63.59 / Avg: 621.64 / Max: 829.42 Min: 34.02 / Avg: 348.42 / Max: 413.49 Min: 27.23 / Avg: 282.28 / Max: 331.17 Min: 54.45 / Avg: 525.29 / Max: 678.52 Min: 19.75 / Avg: 262.8 / Max: 335.9 Min: 40.54 / Avg: 484.57 / Max: 689.98 Min: 16.91 / Avg: 150.79 / Max: 171.19 Min: 16.08 / Avg: 129.6 / Max: 144.82 Min: 104.5 / Avg: 339.12 / Max: 521.39 Min: 43.57 / Avg: 201.59 / Max: 252.67 Min: 43.47 / Avg: 255.14 / Max: 329.17 Min: 106.41 / Avg: 416.56 / Max: 664.2 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 118490 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 104399 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 121368 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 141727 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 145718 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 166040 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 130824 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 154530 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 181782 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 160230 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 121842 Joules per run. 12. EPYC 9684X: Approximate power consumption of 105921 Joules per run. 13. EPYC 9654: Approximate power consumption of 91929 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 111186 Joules per run. 15. EPYC 9754: Approximate power consumption of 92857 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 109513 Joules per run. 17. EPYC 8534P: Approximate power consumption of 63736 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 58837 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 71668 Joules per run. 20. Xeon 6766E: Approximate power consumption of 58662 Joules per run. 21. Xeon 6780E: Approximate power consumption of 67953 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 80397 Joules per run.
TensorFlow This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: AlexNet Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 13 26 39 52 65 SE +/- 0.45, N = 15 SE +/- 0.66, N = 15 SE +/- 0.08, N = 8 SE +/- 0.44, N = 15 SE +/- 0.76, N = 15 SE +/- 0.57, N = 15 SE +/- 1.22, N = 15 SE +/- 0.52, N = 15 SE +/- 0.33, N = 15 SE +/- 0.05, N = 7 SE +/- 0.10, N = 6 SE +/- 0.07, N = 7 SE +/- 0.18, N = 7 SE +/- 0.17, N = 15 SE +/- 0.48, N = 15 SE +/- 0.15, N = 9 SE +/- 0.05, N = 7 SE +/- 0.04, N = 7 SE +/- 0.12, N = 15 SE +/- 0.07, N = 6 SE +/- 0.08, N = 7 SE +/- 0.19, N = 5 30.76 35.50 56.53 37.57 48.28 37.76 43.67 33.21 37.26 42.05 19.92 26.23 32.56 19.88 35.08 18.59 34.51 34.35 16.24 29.56 31.99 18.34 images/sec Per Watt
OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: AlexNet Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.1287 0.2574 0.3861 0.5148 0.6435 0.111 0.286 0.374 0.106 0.274 0.094 0.234 0.080 0.154 0.340 0.065 0.181 0.275 0.071 0.375 0.083 0.538 0.572 0.087 0.404 0.407 0.094 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.16.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 Min: 77.54 / Avg: 276.92 / Max: 490.49 Min: 26.69 / Avg: 124.1 / Max: 239.48 Min: 59.91 / Avg: 151.32 / Max: 308.57 Min: 146.77 / Avg: 355.03 / Max: 612.45 Min: 75.83 / Avg: 176.45 / Max: 326.47 Min: 190.72 / Avg: 403 / Max: 643.72 Min: 73.08 / Avg: 186.7 / Max: 334.25 Min: 187.03 / Avg: 414.71 / Max: 652.72 Min: 97.99 / Avg: 242.28 / Max: 449.95 Min: 49.46 / Avg: 123.85 / Max: 241.53 Min: 62.19 / Avg: 307.72 / Max: 505.41 Min: 32.86 / Avg: 144.8 / Max: 258 Min: 26.55 / Avg: 118.55 / Max: 230.07 Min: 56.56 / Avg: 280.47 / Max: 458.42 Min: 19.64 / Avg: 93.48 / Max: 194.83 Min: 38.63 / Avg: 224.78 / Max: 359.48 Min: 16.75 / Avg: 64.2 / Max: 124.93 Min: 15.49 / Avg: 60.05 / Max: 115.86 Min: 104 / Avg: 187.73 / Max: 277.66 Min: 43.59 / Avg: 73.23 / Max: 123.49 Min: 43.45 / Avg: 78.62 / Max: 138.98 Min: 105.47 / Avg: 195.16 / Max: 299.02 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 2658 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 1109 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 1229 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 3243 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 1494 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 3788 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 1630 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 3981 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 2277 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 1097 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 3590 Joules per run. 12. EPYC 9684X: Approximate power consumption of 1489 Joules per run. 13. EPYC 9654: Approximate power consumption of 1135 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 3291 Joules per run. 15. EPYC 9754: Approximate power consumption of 910 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 2847 Joules per run. 17. EPYC 8534P: Approximate power consumption of 633 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 592 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 2666 Joules per run. 20. Xeon 6766E: Approximate power consumption of 793 Joules per run. 21. Xeon 6780E: Approximate power consumption of 809 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 2615 Joules per run.
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 160 320 480 640 800 SE +/- 0.33, N = 3 SE +/- 0.69, N = 3 SE +/- 0.28, N = 3 SE +/- 0.00, N = 3 SE +/- 0.15, N = 3 SE +/- 0.40, N = 3 SE +/- 0.47, N = 3 SE +/- 0.35, N = 3 SE +/- 0.22, N = 3 SE +/- 3.13, N = 3 SE +/- 0.43, N = 3 SE +/- 0.43, N = 3 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 SE +/- 0.18, N = 3 SE +/- 0.03, N = 3 SE +/- 0.18, N = 3 SE +/- 0.12, N = 3 SE +/- 1.58, N = 3 SE +/- 0.99, N = 3 SE +/- 1.47, N = 3 SE +/- 1.63, N = 3 234.24 224.64 356.38 283.11 236.52 256.63 257.50 278.52 207.84 415.89 233.63 471.98 510.10 253.63 551.07 275.53 592.22 654.83 719.83 692.79 618.97 630.23 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 74.99 / Avg: 625.11 / Max: 757.77 Min: 35.2 / Avg: 319.39 / Max: 384.58 Min: 58.75 / Avg: 323.68 / Max: 377.26 Min: 166.52 / Avg: 639.29 / Max: 750.58 Min: 73.05 / Avg: 326.77 / Max: 376.97 Min: 204.33 / Avg: 649.97 / Max: 743.7 Min: 82.85 / Avg: 327.08 / Max: 376.47 Min: 200.71 / Avg: 649.1 / Max: 748.61 Min: 102.18 / Avg: 501.41 / Max: 578.17 Min: 50.07 / Avg: 251.32 / Max: 290.45 Min: 67.22 / Avg: 740.61 / Max: 819.79 Min: 35.31 / Avg: 374.05 / Max: 411.15 Min: 28.86 / Avg: 317.58 / Max: 349.47 Min: 53.33 / Avg: 629.45 / Max: 695.56 Min: 20.35 / Avg: 295.9 / Max: 332.78 Min: 42.88 / Avg: 582.16 / Max: 663.93 Min: 18.22 / Avg: 153 / Max: 168.49 Min: 17.81 / Avg: 126.81 / Max: 139.78 Min: 105.04 / Avg: 434 / Max: 540.8 Min: 43.56 / Avg: 225.98 / Max: 269.62 Min: 43.45 / Avg: 297.23 / Max: 353.99 Min: 107.91 / Avg: 568.65 / Max: 711.11 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 44800 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 21719 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 22010 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 45816 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 22112 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 45931 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 22242 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 45870 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 33595 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16755 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 50115 Joules per run. 12. EPYC 9684X: Approximate power consumption of 25310 Joules per run. 13. EPYC 9654: Approximate power consumption of 21490 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 42593 Joules per run. 15. EPYC 9754: Approximate power consumption of 20417 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 40752 Joules per run. 17. EPYC 8534P: Approximate power consumption of 10353 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 8623 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 32261 Joules per run. 20. Xeon 6766E: Approximate power consumption of 15668 Joules per run. 21. Xeon 6780E: Approximate power consumption of 20608 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 41701 Joules per run.
Xcompact3d Incompact3d Xcompact3d Incompact3d is a Fortran-MPI based, finite difference high-performance code for solving the incompressible Navier-Stokes equation and as many as you need scalar transport equations. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Xcompact3d Incompact3d 2021-03-11 Input: X3D-benchmarking input.i3d Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 120 240 360 480 600 SE +/- 0.37, N = 3 SE +/- 2.51, N = 3 SE +/- 3.88, N = 4 SE +/- 0.05, N = 3 SE +/- 1.25, N = 3 SE +/- 0.04, N = 3 SE +/- 0.14, N = 3 SE +/- 0.01, N = 3 SE +/- 1.19, N = 3 SE +/- 0.13, N = 3 SE +/- 2.20, N = 12 SE +/- 3.06, N = 9 SE +/- 4.73, N = 3 SE +/- 3.26, N = 9 SE +/- 5.39, N = 3 SE +/- 9.13, N = 9 SE +/- 0.92, N = 3 SE +/- 0.22, N = 3 171.38 323.25 357.01 196.81 407.59 189.69 351.64 187.22 292.03 558.38 167.13 309.85 466.55 248.87 534.06 253.32 567.29 568.25 1. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Xcompact3d Incompact3d 2021-03-11 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 140 280 420 560 700 Min: 77.71 / Avg: 675.14 / Max: 722.78 Min: 23.89 / Avg: 333.9 / Max: 356.36 Min: 59.93 / Avg: 344.75 / Max: 358.18 Min: 158.32 / Avg: 681.46 / Max: 722.98 Min: 73.01 / Avg: 342.5 / Max: 356.35 Min: 203.67 / Avg: 685.84 / Max: 731.99 Min: 80.13 / Avg: 345.35 / Max: 367.23 Min: 201.23 / Avg: 686.09 / Max: 746.29 Min: 101.33 / Avg: 531.6 / Max: 556.64 Min: 52.82 / Avg: 267.65 / Max: 283.3 Min: 66.18 / Avg: 750.96 / Max: 804.8 Min: 33.87 / Avg: 359.91 / Max: 399.74 Min: 30.46 / Avg: 296.94 / Max: 321.61 Min: 56.03 / Avg: 638.9 / Max: 677.63 Min: 11.29 / Avg: 271.32 / Max: 306.5 Min: 38.21 / Avg: 591.17 / Max: 651.55 Min: 19.39 / Avg: 140.74 / Max: 150 Min: 16.95 / Avg: 129.67 / Max: 136.25 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 121975 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 110187 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 125920 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 141289 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 141796 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 135111 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 123521 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 134016 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 158948 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 151490 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 132043 Joules per run. 12. EPYC 9684X: Approximate power consumption of 113971 Joules per run. 13. EPYC 9654: Approximate power consumption of 140452 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 164481 Joules per run. 15. EPYC 9754: Approximate power consumption of 146786 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 157054 Joules per run. 17. EPYC 8534P: Approximate power consumption of 80973 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 74775 Joules per run.
High Performance Conjugate Gradient HPCG is the High Performance Conjugate Gradient and is a new scientific benchmark from Sandia National Lans focused for super-computer testing with modern real-world workloads compared to HPCC. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org GFLOP/s, More Is Better High Performance Conjugate Gradient 3.1 X Y Z: 144 144 144 - RT: 60 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 15 30 45 60 75 SE +/- 0.94, N = 3 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 SE +/- 0.29, N = 3 SE +/- 0.37, N = 3 SE +/- 0.07, N = 3 SE +/- 0.34, N = 9 SE +/- 0.01, N = 3 SE +/- 0.51, N = 3 SE +/- 0.28, N = 5 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 69.30 35.14 31.07 60.85 25.24 54.41 30.59 62.64 30.11 20.41 44.95 27.58 28.32 42.52 23.63 41.87 22.20 22.13 1. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi GFLOP/s Per Watt
OpenBenchmarking.org GFLOP/s Per Watt, More Is Better High Performance Conjugate Gradient 3.1 X Y Z: 144 144 144 - RT: 60 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 0.038 0.076 0.114 0.152 0.19 0.101 0.103 0.090 0.088 0.073 0.079 0.089 0.092 0.057 0.077 0.062 0.084 0.104 0.069 0.099 0.074 0.156 0.169 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better High Performance Conjugate Gradient 3.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 140 280 420 560 700 Min: 78.99 / Avg: 685.14 / Max: 717.63 Min: 24.94 / Avg: 340.38 / Max: 366.08 Min: 62.11 / Avg: 344.43 / Max: 357.3 Min: 162.34 / Avg: 688.79 / Max: 719.93 Min: 74.31 / Avg: 344.79 / Max: 363.36 Min: 192.7 / Avg: 690.6 / Max: 722.1 Min: 76.3 / Avg: 345.19 / Max: 369.22 Min: 208.84 / Avg: 683.79 / Max: 753.27 Min: 101.77 / Avg: 529.99 / Max: 565.31 Min: 52.91 / Avg: 266.5 / Max: 286.68 Min: 67.43 / Avg: 722.2 / Max: 816.31 Min: 33.89 / Avg: 330.25 / Max: 391.86 Min: 28.57 / Avg: 273.24 / Max: 316.28 Min: 55.46 / Avg: 612.13 / Max: 685.77 Min: 16.99 / Avg: 238.17 / Max: 311.47 Min: 42.67 / Avg: 563.2 / Max: 666.57 Min: 18.73 / Avg: 141.98 / Max: 160.79 Min: 18.07 / Avg: 131.23 / Max: 136.75 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 253732 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 122989 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 131457 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 271612 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 129756 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 244012 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 126110 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 248670 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 278539 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 102958 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 586185 Joules per run. 12. EPYC 9684X: Approximate power consumption of 219090 Joules per run. 13. EPYC 9654: Approximate power consumption of 178697 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 529289 Joules per run. 15. EPYC 9754: Approximate power consumption of 248649 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 665513 Joules per run. 17. EPYC 8534P: Approximate power consumption of 80504 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 74580 Joules per run.
Timed LLVM Compilation This test times how long it takes to compile/build the LLVM compiler stack. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 16.0 Build System: Ninja Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 60 120 180 240 300 SE +/- 0.27, N = 3 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 SE +/- 0.15, N = 3 SE +/- 0.19, N = 3 SE +/- 0.17, N = 3 SE +/- 0.36, N = 3 SE +/- 0.79, N = 3 SE +/- 0.37, N = 3 SE +/- 1.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.27, N = 3 SE +/- 0.31, N = 3 SE +/- 0.08, N = 3 SE +/- 0.74, N = 3 SE +/- 0.45, N = 3 SE +/- 0.20, N = 3 SE +/- 0.10, N = 3 SE +/- 1.52, N = 3 SE +/- 0.20, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 106.82 165.05 187.02 122.31 212.48 134.42 197.84 128.07 194.38 298.41 89.28 124.46 135.67 94.81 146.76 101.56 205.01 215.93 138.57 184.20 169.45 125.27 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Timed LLVM Compilation 16.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 81.57 / Avg: 519.72 / Max: 754.2 Min: 33.37 / Avg: 291.41 / Max: 377.45 Min: 58.01 / Avg: 298.24 / Max: 377.21 Min: 162.49 / Avg: 544.93 / Max: 754.95 Min: 74.97 / Avg: 314.74 / Max: 377.51 Min: 201.26 / Avg: 591.84 / Max: 754.62 Min: 83.29 / Avg: 311.03 / Max: 377.86 Min: 206.76 / Avg: 582.56 / Max: 754.19 Min: 106.11 / Avg: 438.51 / Max: 581.89 Min: 51.36 / Avg: 243.86 / Max: 291.49 Min: 69.22 / Avg: 491.18 / Max: 825.37 Min: 33.31 / Avg: 289.22 / Max: 411.83 Min: 28.01 / Avg: 241.32 / Max: 332.83 Min: 52.7 / Avg: 427.31 / Max: 682.72 Min: 21.92 / Avg: 221.05 / Max: 334.41 Min: 41.44 / Avg: 382.15 / Max: 678.1 Min: 16.99 / Avg: 134 / Max: 170.95 Min: 15.37 / Avg: 117.14 / Max: 147.36 Min: 104.24 / Avg: 248.44 / Max: 496.75 Min: 43.51 / Avg: 148.04 / Max: 239.55 Min: 43.38 / Avg: 172.6 / Max: 293.27 Min: 107.08 / Avg: 281.29 / Max: 590.24 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 63578 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 52357 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 60443 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 75745 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 71550 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 88579 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 66146 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 83501 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 92234 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 76573 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 52557 Joules per run. 12. EPYC 9684X: Approximate power consumption of 41069 Joules per run. 13. EPYC 9654: Approximate power consumption of 37003 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 48286 Joules per run. 15. EPYC 9754: Approximate power consumption of 36841 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 46750 Joules per run. 17. EPYC 8534P: Approximate power consumption of 30194 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 27645 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 39998 Joules per run. 20. Xeon 6766E: Approximate power consumption of 30298 Joules per run. 21. Xeon 6780E: Approximate power consumption of 32679 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 41162 Joules per run.
GraphicsMagick This is a test of GraphicsMagick with its OpenMP implementation that performs various imaging tests on a sample high resolution (currently 15400 x 6940) JPEG image. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Enhanced Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 90 180 270 360 450 SE +/- 1.15, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 2.60, N = 3 SE +/- 0.00, N = 3 SE +/- 1.00, N = 3 SE +/- 1.45, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.67, N = 3 SE +/- 0.33, N = 3 SE +/- 1.20, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 SE +/- 1.53, N = 3 374 228 216 342 160 269 181 301 215 123 408 300 264 368 304 403 172 163 350 270 299 389 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp Iterations Per Minute Per Watt
OpenBenchmarking.org Iterations Per Minute Per Watt, More Is Better GraphicsMagick 1.3.43 Operation: Enhanced Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.3308 0.6616 0.9924 1.3232 1.654 0.614 0.696 0.656 0.568 0.484 0.410 0.549 0.466 0.435 0.484 0.742 0.935 1.067 0.815 1.342 1.014 1.348 1.470 1.086 1.391 1.211 0.999 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better GraphicsMagick 1.3.43 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 Min: 74.15 / Avg: 608.66 / Max: 666.76 Min: 28.79 / Avg: 327.64 / Max: 359.97 Min: 61.03 / Avg: 329.43 / Max: 359.83 Min: 161.82 / Avg: 601.76 / Max: 650.47 Min: 73.74 / Avg: 330.74 / Max: 355.56 Min: 198.68 / Avg: 656.05 / Max: 702.16 Min: 75.94 / Avg: 329.68 / Max: 362.6 Min: 202.79 / Avg: 645.53 / Max: 683.28 Min: 101.45 / Avg: 493.87 / Max: 534.32 Min: 52.22 / Avg: 254.21 / Max: 282.55 Min: 64.84 / Avg: 549.68 / Max: 597.34 Min: 33.82 / Avg: 320.71 / Max: 343.53 Min: 26.64 / Avg: 247.53 / Max: 267.87 Min: 59.43 / Avg: 451.41 / Max: 489.55 Min: 20.16 / Avg: 226.47 / Max: 243.63 Min: 40.42 / Avg: 397.41 / Max: 433.85 Min: 18.4 / Avg: 127.55 / Max: 140 Min: 16.93 / Avg: 110.88 / Max: 122.16 Min: 104.13 / Avg: 322.39 / Max: 344.94 Min: 43.58 / Avg: 194.07 / Max: 209.22 Min: 43.55 / Avg: 246.9 / Max: 265.73 Min: 105.4 / Avg: 389.46 / Max: 429.53 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 39157 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 21078 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21193 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 38713 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 21277 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 42206 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 21209 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 41314 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 31773 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16354 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 35363 Joules per run. 12. EPYC 9684X: Approximate power consumption of 20525 Joules per run. 13. EPYC 9654: Approximate power consumption of 15842 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 28739 Joules per run. 15. EPYC 9754: Approximate power consumption of 14570 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 25434 Joules per run. 17. EPYC 8534P: Approximate power consumption of 8163 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 7134 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 20633 Joules per run. 20. Xeon 6766E: Approximate power consumption of 12421 Joules per run. 21. Xeon 6780E: Approximate power consumption of 15884 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 24926 Joules per run.
OpenFOAM OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 200 400 600 800 1000 SE +/- 8.88, N = 3 SE +/- 2.43, N = 3 SE +/- 11.46, N = 3 SE +/- 6.50, N = 15 SE +/- 12.91, N = 15 SE +/- 1.83, N = 3 SE +/- 7.34, N = 3 SE +/- 6.21, N = 5 SE +/- 10.46, N = 15 SE +/- 1.66, N = 3 SE +/- 7.76, N = 15 SE +/- 6.60, N = 3 SE +/- 9.50, N = 15 SE +/- 4.37, N = 15 SE +/- 2.19, N = 3 SE +/- 2.36, N = 11 SE +/- 4.84, N = 4 SE +/- 6.13, N = 3 SE +/- 0.86, N = 3 SE +/- 0.67, N = 3 SE +/- 0.28, N = 3 SE +/- 3.37, N = 3 754.81 908.19 852.33 696.98 728.47 604.76 705.61 581.77 701.72 849.56 446.81 672.92 604.05 444.85 382.10 316.11 443.06 446.69 276.24 445.62 482.21 292.79 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.8143 1.6286 2.4429 3.2572 4.0715 SE +/- 0.01541, N = 3 SE +/- 0.00291, N = 3 SE +/- 0.01594, N = 3 SE +/- 0.01405, N = 15 SE +/- 0.02719, N = 15 SE +/- 0.00498, N = 3 SE +/- 0.01456, N = 3 SE +/- 0.01853, N = 5 SE +/- 0.02289, N = 15 SE +/- 0.00236, N = 3 SE +/- 0.03659, N = 15 SE +/- 0.01470, N = 3 SE +/- 0.02493, N = 15 SE +/- 0.02209, N = 15 SE +/- 0.01501, N = 3 SE +/- 0.02347, N = 11 SE +/- 0.02450, N = 4 SE +/- 0.03117, N = 3 SE +/- 0.01119, N = 3 SE +/- 0.00335, N = 3 SE +/- 0.00120, N = 3 SE +/- 0.03971, N = 3 1.32454 1.10042 1.17292 1.43573 1.37831 1.65270 1.41662 1.71875 1.42849 1.17561 2.24645 1.48596 1.66046 2.25020 2.61653 3.16441 2.25716 2.23868 3.61920 2.24323 2.07288 3.41537 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.17 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 100 200 300 400 500 Min: 51.38 / Avg: 431.96 / Max: 458.85 Min: 54.86 / Avg: 232.56 / Max: 248.24 Min: 65.24 / Avg: 542.12 / Max: 580.41 Min: 35.78 / Avg: 264.82 / Max: 285.07 Min: 26 / Avg: 222.45 / Max: 240.99 Min: 57.3 / Avg: 472.8 / Max: 505.93 Min: 19.01 / Avg: 179.59 / Max: 191.94 Min: 42.05 / Avg: 397.19 / Max: 423.71 Min: 19.26 / Avg: 116.04 / Max: 124.74 Min: 17.14 / Avg: 106.46 / Max: 113.35 Min: 104.87 / Avg: 303.41 / Max: 320.11 Min: 43.72 / Avg: 146.19 / Max: 154.64 Min: 43.58 / Avg: 171.22 / Max: 182.02 Min: 108.14 / Avg: 349.02 / Max: 367.93 1. Xeon Platinum 8380 2P: Approximate power consumption of 27703 Joules per run. 2. Xeon Platinum 8380: Approximate power consumption of 14961 Joules per run. 3. EPYC 9684X 2P: Approximate power consumption of 34551 Joules per run. 4. EPYC 9684X: Approximate power consumption of 16949 Joules per run. 5. EPYC 9654: Approximate power consumption of 14237 Joules per run. 6. EPYC 9654 2P: Approximate power consumption of 30133 Joules per run. 7. EPYC 9754: Approximate power consumption of 11554 Joules per run. 8. EPYC 9754 2P: Approximate power consumption of 25420 Joules per run. 9. EPYC 8534P: Approximate power consumption of 7484 Joules per run. 10. EPYC 8534PN: Approximate power consumption of 6849 Joules per run. 11. Xeon 6766E 2P: Approximate power consumption of 19620 Joules per run. 12. Xeon 6766E: Approximate power consumption of 9405 Joules per run. 13. Xeon 6780E: Approximate power consumption of 11015 Joules per run. 14. Xeon 6780E 2P: Approximate power consumption of 22453 Joules per run.
7-Zip Compression This is a test of 7-Zip compression/decompression with its integrated benchmark feature. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Compression Rating Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 170K 340K 510K 680K 850K SE +/- 709.87, N = 3 SE +/- 1982.97, N = 3 SE +/- 1535.53, N = 3 SE +/- 4200.62, N = 3 SE +/- 1836.55, N = 3 SE +/- 5127.15, N = 3 SE +/- 2258.81, N = 3 SE +/- 3924.87, N = 3 SE +/- 1785.84, N = 3 SE +/- 248.73, N = 3 SE +/- 3075.95, N = 3 SE +/- 1520.59, N = 3 SE +/- 719.89, N = 3 SE +/- 6869.20, N = 3 SE +/- 1188.96, N = 3 SE +/- 2500.52, N = 3 SE +/- 268.94, N = 3 SE +/- 206.69, N = 3 SE +/- 7384.79, N = 3 SE +/- 610.46, N = 3 SE +/- 933.46, N = 3 SE +/- 1102.28, N = 3 674239 441636 388190 592729 314716 491729 342363 525514 391719 243732 741366 579112 549500 761734 575440 776968 331357 319094 591835 413851 438048 611200 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
Parallel BZIP2 Compression This test measures the time needed to compress a file (FreeBSD-13.0-RELEASE-amd64-memstick.img) using Parallel BZIP2 compression. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Parallel BZIP2 Compression 1.1.13 FreeBSD-13.0-RELEASE-amd64-memstick.img Compression Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.7635 1.527 2.2905 3.054 3.8175 SE +/- 0.024402, N = 15 SE +/- 0.023842, N = 15 SE +/- 0.007749, N = 10 SE +/- 0.017240, N = 15 SE +/- 0.023295, N = 15 SE +/- 0.030907, N = 15 SE +/- 0.020941, N = 15 SE +/- 0.028863, N = 15 SE +/- 0.026496, N = 15 SE +/- 0.048155, N = 15 SE +/- 0.015217, N = 15 SE +/- 0.015384, N = 15 SE +/- 0.014512, N = 15 SE +/- 0.019468, N = 15 SE +/- 0.010826, N = 15 SE +/- 0.012053, N = 15 SE +/- 0.023387, N = 15 SE +/- 0.016947, N = 15 SE +/- 0.015355, N = 15 SE +/- 0.012826, N = 10 SE +/- 0.014326, N = 10 SE +/- 0.015943, N = 15 1.432362 1.847537 2.144857 1.469210 2.632077 1.982932 2.287766 1.711296 2.181455 3.393189 1.109446 1.369063 1.422954 1.126329 1.355737 1.068398 2.200497 2.321195 1.857642 2.504621 2.279971 1.718022 1. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Parallel BZIP2 Compression 1.1.13 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 Min: 71.11 / Avg: 201.02 / Max: 594.06 Min: 33.01 / Avg: 124.42 / Max: 372.52 Min: 59.1 / Avg: 149.7 / Max: 374.85 Min: 162.27 / Avg: 288.67 / Max: 640.02 Min: 72.25 / Avg: 174.54 / Max: 371.49 Min: 199.37 / Avg: 345.8 / Max: 682.95 Min: 73.85 / Avg: 174.26 / Max: 374.82 Min: 193.42 / Avg: 340.67 / Max: 703.88 Min: 95.47 / Avg: 220.44 / Max: 552.38 Min: 50.9 / Avg: 141.25 / Max: 290.87 Min: 58 / Avg: 170.11 / Max: 493.47 Min: 32.91 / Avg: 100.67 / Max: 337.76 Min: 26.03 / Avg: 87.61 / Max: 297.16 Min: 52.77 / Avg: 151.26 / Max: 452.63 Min: 21.06 / Avg: 71.78 / Max: 246.91 Min: 39.33 / Avg: 126.08 / Max: 368.96 Min: 15.97 / Avg: 55.16 / Max: 153.03 Min: 16.36 / Avg: 50.15 / Max: 132.7 Min: 103.93 / Avg: 141.47 / Max: 301.99 Min: 43.62 / Avg: 72.77 / Max: 199.71 Min: 43.43 / Avg: 79.98 / Max: 238.53 Min: 104.74 / Avg: 150.21 / Max: 342.71 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 1112 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 738 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 943 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 1655 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 1164 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 2098 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 1115 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 1999 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 1381 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 1055 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 873 Joules per run. 12. EPYC 9684X: Approximate power consumption of 550 Joules per run. 13. EPYC 9654: Approximate power consumption of 491 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 776 Joules per run. 15. EPYC 9754: Approximate power consumption of 392 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 656 Joules per run. 17. EPYC 8534P: Approximate power consumption of 349 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 328 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 830 Joules per run. 20. Xeon 6766E: Approximate power consumption of 480 Joules per run. 21. Xeon 6780E: Approximate power consumption of 512 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 871 Joules per run.
GPAW GPAW is a density-functional theory (DFT) Python code based on the projector-augmented wave (PAW) method and the atomic simulation environment (ASE). Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better GPAW 23.6 Input: Carbon Nanotube Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 20 40 60 80 100 SE +/- 0.10, N = 3 SE +/- 0.12, N = 3 SE +/- 0.24, N = 3 SE +/- 0.55, N = 3 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 SE +/- 0.08, N = 3 SE +/- 0.27, N = 3 SE +/- 0.60, N = 3 SE +/- 0.12, N = 3 SE +/- 0.30, N = 15 SE +/- 0.11, N = 3 SE +/- 0.21, N = 3 SE +/- 0.29, N = 15 SE +/- 0.14, N = 3 SE +/- 0.18, N = 3 SE +/- 0.07, N = 3 SE +/- 0.01, N = 3 38.05 43.05 47.78 41.56 54.38 42.87 48.49 43.91 48.45 76.18 24.13 30.00 34.87 25.84 33.12 27.15 63.80 66.71 1. (CC) gcc options: -shared -lxc -lblas -lmpi CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better GPAW 23.6 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 140 280 420 560 700 Min: 80.11 / Avg: 568.78 / Max: 750.58 Min: 24.08 / Avg: 314.73 / Max: 374.48 Min: 59.13 / Avg: 322.66 / Max: 373.01 Min: 153.52 / Avg: 606.84 / Max: 749.04 Min: 72.36 / Avg: 327.19 / Max: 373.7 Min: 203.73 / Avg: 621.08 / Max: 746.35 Min: 75.93 / Avg: 324.94 / Max: 375.46 Min: 213.42 / Avg: 622.05 / Max: 746.91 Min: 103.43 / Avg: 497.52 / Max: 576.52 Min: 53.47 / Avg: 257.77 / Max: 289.43 Min: 65.21 / Avg: 641.29 / Max: 819.6 Min: 34.27 / Avg: 353.01 / Max: 409.6 Min: 28.47 / Avg: 300.58 / Max: 350.83 Min: 57.4 / Avg: 562.66 / Max: 711.92 Min: 23.61 / Avg: 293.6 / Max: 347.81 Min: 43.78 / Avg: 513.29 / Max: 700.14 Min: 18.71 / Avg: 154.54 / Max: 175.1 Min: 18.16 / Avg: 136.93 / Max: 153.06 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 27301 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 15527 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 17424 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 30747 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 19631 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 31468 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 17655 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 32554 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 27198 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 21051 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 21505 Joules per run. 12. EPYC 9684X: Approximate power consumption of 12709 Joules per run. 13. EPYC 9654: Approximate power consumption of 12424 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 19806 Joules per run. 15. EPYC 9754: Approximate power consumption of 11842 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 21216 Joules per run. 17. EPYC 8534P: Approximate power consumption of 10766 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 9950 Joules per run.
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: GPT-2 - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 60 120 180 240 300 SE +/- 8.14, N = 15 SE +/- 1.19, N = 3 SE +/- 1.50, N = 3 SE +/- 1.05, N = 3 SE +/- 2.01, N = 15 SE +/- 0.58, N = 3 SE +/- 1.88, N = 3 SE +/- 1.08, N = 3 SE +/- 3.16, N = 15 SE +/- 1.97, N = 3 SE +/- 0.46, N = 3 SE +/- 0.70, N = 3 SE +/- 1.37, N = 5 SE +/- 0.13, N = 3 SE +/- 0.15, N = 3 SE +/- 1.43, N = 15 SE +/- 0.28, N = 3 SE +/- 0.63, N = 3 SE +/- 0.47, N = 3 SE +/- 0.47, N = 3 SE +/- 0.44, N = 3 SE +/- 8.91, N = 15 236.65 270.33 222.03 180.03 176.33 141.95 168.86 132.71 194.15 207.93 161.95 162.09 126.82 102.57 89.74 86.69 89.21 88.57 136.39 139.45 148.11 103.89 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: GPT-2 - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 3 6 9 12 15 SE +/- 0.15083, N = 15 SE +/- 0.01631, N = 3 SE +/- 0.03075, N = 3 SE +/- 0.03218, N = 3 SE +/- 0.06596, N = 15 SE +/- 0.02902, N = 3 SE +/- 0.06620, N = 3 SE +/- 0.06105, N = 3 SE +/- 0.08423, N = 15 SE +/- 0.04594, N = 3 SE +/- 0.01742, N = 3 SE +/- 0.02661, N = 3 SE +/- 0.08751, N = 5 SE +/- 0.01221, N = 3 SE +/- 0.01807, N = 3 SE +/- 0.20120, N = 15 SE +/- 0.03478, N = 3 SE +/- 0.07964, N = 3 SE +/- 0.02533, N = 3 SE +/- 0.02403, N = 3 SE +/- 0.02008, N = 3 SE +/- 0.80628, N = 15 4.29531 3.69649 4.49976 5.55101 5.67700 7.04111 5.91961 7.53259 5.16480 4.80418 6.17190 6.16668 7.88584 9.74614 11.13920 11.57740 11.20470 11.28640 7.32610 7.16440 6.74630 10.58571 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.17 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 60 120 180 240 300 Min: 97.22 / Avg: 292.43 / Max: 327.64 Min: 52.71 / Avg: 203.23 / Max: 218.58 Min: 65.9 / Avg: 291.34 / Max: 308.52 Min: 34.75 / Avg: 149.45 / Max: 159.93 Min: 27.83 / Avg: 127.32 / Max: 135.72 Min: 55.76 / Avg: 257.41 / Max: 272.32 Min: 20.73 / Avg: 94.62 / Max: 100.76 Min: 39.34 / Avg: 208.62 / Max: 222.38 Min: 16.03 / Avg: 72.08 / Max: 76.76 Min: 15.72 / Avg: 69.12 / Max: 74.02 Min: 103.86 / Avg: 148.82 / Max: 155.68 Min: 43.72 / Avg: 86.91 / Max: 91.46 Min: 43.54 / Avg: 90.3 / Max: 95.5 Min: 105.25 / Avg: 166.09 / Max: 183.4 1. Xeon Platinum 8380 2P: Approximate power consumption of 19183 Joules per run. 2. Xeon Platinum 8380: Approximate power consumption of 13345 Joules per run. 3. EPYC 9684X 2P: Approximate power consumption of 18937 Joules per run. 4. EPYC 9684X: Approximate power consumption of 9814 Joules per run. 5. EPYC 9654: Approximate power consumption of 8301 Joules per run. 6. EPYC 9654 2P: Approximate power consumption of 16818 Joules per run. 7. EPYC 9754: Approximate power consumption of 6245 Joules per run. 8. EPYC 9754 2P: Approximate power consumption of 13686 Joules per run. 9. EPYC 8534P: Approximate power consumption of 4733 Joules per run. 10. EPYC 8534PN: Approximate power consumption of 4562 Joules per run. 11. Xeon 6766E 2P: Approximate power consumption of 9872 Joules per run. 12. Xeon 6766E: Approximate power consumption of 5765 Joules per run. 13. Xeon 6780E: Approximate power consumption of 5990 Joules per run. 14. Xeon 6780E 2P: Approximate power consumption of 11051 Joules per run.
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 40K 80K 120K 160K 200K SE +/- 1158.60, N = 3 SE +/- 988.12, N = 3 SE +/- 75.30, N = 3 SE +/- 2494.14, N = 3 SE +/- 383.22, N = 3 SE +/- 18.38, N = 3 SE +/- 1761.33, N = 3 SE +/- 1422.88, N = 15 SE +/- 696.52, N = 3 SE +/- 95.54, N = 3 SE +/- 1640.61, N = 7 SE +/- 162.47, N = 3 SE +/- 205.87, N = 3 SE +/- 1922.38, N = 15 SE +/- 89.35, N = 3 SE +/- 1374.23, N = 9 SE +/- 86.99, N = 3 SE +/- 55.52, N = 3 SE +/- 1048.23, N = 3 SE +/- 68.06, N = 3 SE +/- 100.17, N = 3 SE +/- 1067.91, N = 3 128566.81 81279.79 115106.30 189893.31 135075.07 174862.56 140144.01 176900.32 151627.42 61956.93 178488.03 138605.52 133779.62 172688.50 132973.43 166151.42 87511.11 78334.92 75761.50 84584.13 91273.02 76895.29 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Liquid-DSP LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 57 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 1000M 2000M 3000M 4000M 5000M SE +/- 51282832.98, N = 4 SE +/- 5260228.13, N = 3 SE +/- 3116800.35, N = 3 SE +/- 13655808.69, N = 3 SE +/- 2030052.00, N = 3 SE +/- 25888414.40, N = 3 SE +/- 3119294.79, N = 3 SE +/- 14772609.79, N = 3 SE +/- 11686221.71, N = 3 SE +/- 1549551.91, N = 3 SE +/- 11892621.43, N = 3 SE +/- 6778479.02, N = 3 SE +/- 20120967.50, N = 3 SE +/- 4098915.85, N = 3 SE +/- 18691531.06, N = 3 SE +/- 14606429.33, N = 3 SE +/- 3527510.93, N = 3 SE +/- 6398003.16, N = 3 SE +/- 2709448.49, N = 3 SE +/- 6887912.12, N = 3 SE +/- 1909915.65, N = 3 SE +/- 13354940.83, N = 3 4450525000 3503200000 3181266667 3723666667 2670033333 3596400000 2972400000 3896500000 2689033333 1554666667 4759366667 4755333333 4256300000 4280933333 4714500000 4626566667 2982800000 2687066667 3712133333 3736300000 4136766667 4068666667 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid samples/s Per Watt
OpenBenchmarking.org samples/s Per Watt, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 57 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 5M 10M 15M 20M 25M 7209189.04 11273487.11 10089438.81 6447021.00 8437038.99 5639264.93 9312055.82 6058163.97 5516263.53 6364402.84 9563226.72 13085490.53 14722432.57 10089896.41 16705633.01 12234041.51 20620501.38 22733164.52 13110978.99 17916149.91 15275772.40 12284401.92 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Liquid-DSP 1.6 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 69.61 / Avg: 617.34 / Max: 730.41 Min: 24.5 / Avg: 310.75 / Max: 376.14 Min: 32.16 / Avg: 315.31 / Max: 376.7 Min: 158.24 / Avg: 577.58 / Max: 700.7 Min: 75.83 / Avg: 316.47 / Max: 376.18 Min: 204.5 / Avg: 637.74 / Max: 753.77 Min: 79.18 / Avg: 319.2 / Max: 376.38 Min: 195.26 / Avg: 643.18 / Max: 753.46 Min: 101.61 / Avg: 487.47 / Max: 581.03 Min: 51.05 / Avg: 244.28 / Max: 290.35 Min: 60.6 / Avg: 497.67 / Max: 581.47 Min: 35.08 / Avg: 363.41 / Max: 409.45 Min: 29.04 / Avg: 289.1 / Max: 326.36 Min: 57.66 / Avg: 424.28 / Max: 495.38 Min: 21.64 / Avg: 282.21 / Max: 320.93 Min: 40.47 / Avg: 378.17 / Max: 438.15 Min: 17.85 / Avg: 144.65 / Max: 162.72 Min: 17.47 / Avg: 118.2 / Max: 136.58 Min: 104.64 / Avg: 283.13 / Max: 314.71 Min: 43.75 / Avg: 208.54 / Max: 241.22 Min: 43.58 / Avg: 270.81 / Max: 310.28 Min: 107.77 / Avg: 331.21 / Max: 370.24 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 20990 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 10669 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 10826 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 20023 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 10760 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 22108 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 10853 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 21868 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 16737 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 8387 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 16921 Joules per run. 12. EPYC 9684X: Approximate power consumption of 12235 Joules per run. 13. EPYC 9654: Approximate power consumption of 9830 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 14425 Joules per run. 15. EPYC 9754: Approximate power consumption of 9501 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 12858 Joules per run. 17. EPYC 8534P: Approximate power consumption of 4918 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 4058 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 9626 Joules per run. 20. Xeon 6766E: Approximate power consumption of 7160 Joules per run. 21. Xeon 6780E: Approximate power consumption of 9298 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 11371 Joules per run.
Intel Open Image Denoise Open Image Denoise is a denoising library for ray-tracing and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 2.2 Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 1.1453 2.2906 3.4359 4.5812 5.7265 SE +/- 0.03, N = 6 SE +/- 0.00, N = 5 SE +/- 0.00, N = 4 SE +/- 0.01, N = 6 SE +/- 0.00, N = 4 SE +/- 0.02, N = 5 SE +/- 0.00, N = 4 SE +/- 0.02, N = 5 SE +/- 0.00, N = 5 SE +/- 0.00, N = 3 SE +/- 0.00, N = 5 SE +/- 0.02, N = 4 SE +/- 0.01, N = 4 SE +/- 0.01, N = 5 SE +/- 0.03, N = 6 SE +/- 0.01, N = 5 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 4 SE +/- 0.00, N = 4 SE +/- 0.00, N = 4 SE +/- 0.00, N = 5 5.09 3.32 2.71 4.48 2.27 3.49 2.39 3.66 3.10 1.81 3.47 2.66 2.73 3.49 3.16 3.57 1.80 1.69 2.97 1.93 2.11 3.31 Images / Sec Per Watt
OpenBenchmarking.org Images / Sec Per Watt, More Is Better Intel Open Image Denoise 2.2 Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0036 0.0072 0.0108 0.0144 0.018 0.012 0.013 0.010 0.009 0.008 0.006 0.008 0.007 0.008 0.008 0.007 0.009 0.012 0.008 0.015 0.010 0.015 0.016 0.008 0.010 0.009 0.008 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Intel Open Image Denoise 2.2 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 80.74 / Avg: 440.63 / Max: 738.2 Min: 26.77 / Avg: 249.97 / Max: 378.66 Min: 59.91 / Avg: 268.44 / Max: 367.04 Min: 165.7 / Avg: 496.66 / Max: 745.69 Min: 73.66 / Avg: 286.68 / Max: 372.63 Min: 208.03 / Avg: 550.26 / Max: 748.26 Min: 76.35 / Avg: 284.74 / Max: 374.26 Min: 193.7 / Avg: 538.98 / Max: 749.89 Min: 100.45 / Avg: 406.6 / Max: 560.45 Min: 52.95 / Avg: 224.45 / Max: 283.1 Min: 63.03 / Avg: 499.92 / Max: 728.7 Min: 32.55 / Avg: 282.53 / Max: 386.33 Min: 27.41 / Avg: 233.36 / Max: 317.91 Min: 57.66 / Avg: 424.59 / Max: 613.78 Min: 21.62 / Avg: 205.54 / Max: 298.26 Min: 40.05 / Avg: 372.52 / Max: 545.78 Min: 18.74 / Avg: 123.7 / Max: 154.19 Min: 17.42 / Avg: 107.91 / Max: 132.12 Min: 105.15 / Avg: 359.38 / Max: 527.77 Min: 43.72 / Avg: 199.4 / Max: 250.2 Min: 43.54 / Avg: 247.22 / Max: 322.66 Min: 108.16 / Avg: 427.37 / Max: 638.82 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 4847 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 3450 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 4295 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 5877 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 5089 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 7374 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 4912 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 7115 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 5855 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 4788 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 6699 Joules per run. 12. EPYC 9684X: Approximate power consumption of 4591 Joules per run. 13. EPYC 9654: Approximate power consumption of 3675 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 5605 Joules per run. 15. EPYC 9754: Approximate power consumption of 2946 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 4992 Joules per run. 17. EPYC 8534P: Approximate power consumption of 2680 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 2446 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 5750 Joules per run. 20. Xeon 6766E: Approximate power consumption of 4088 Joules per run. 21. Xeon 6780E: Approximate power consumption of 4759 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 6240 Joules per run.
TensorFlow This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: AlexNet Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 400 800 1200 1600 2000 SE +/- 19.23, N = 3 SE +/- 1.84, N = 3 SE +/- 0.51, N = 3 SE +/- 18.52, N = 3 SE +/- 3.89, N = 3 SE +/- 17.88, N = 4 SE +/- 5.13, N = 3 SE +/- 8.55, N = 3 SE +/- 5.91, N = 3 SE +/- 1.47, N = 3 SE +/- 23.15, N = 4 SE +/- 0.49, N = 3 SE +/- 0.67, N = 3 SE +/- 12.71, N = 3 SE +/- 4.07, N = 3 SE +/- 7.97, N = 3 SE +/- 0.35, N = 3 SE +/- 0.57, N = 3 SE +/- 20.10, N = 12 SE +/- 2.03, N = 3 SE +/- 0.86, N = 3 SE +/- 38.99, N = 12 2039.63 1486.12 1278.45 1899.64 1047.96 1604.11 1108.95 1677.62 1470.46 883.00 1897.64 1392.91 1363.33 1862.79 1620.53 1876.66 875.23 796.82 979.89 677.40 732.79 1064.18 images/sec Per Watt
OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: AlexNet Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 2 4 6 8 10 3.903 4.861 4.426 3.147 3.220 2.537 3.409 2.674 3.101 3.517 3.526 4.675 5.294 3.853 6.899 4.569 6.494 6.990 2.406 3.502 3.050 2.310 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.16.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 Min: 84.88 / Avg: 522.57 / Max: 631.68 Min: 33.58 / Avg: 305.73 / Max: 353.3 Min: 60.6 / Avg: 288.85 / Max: 359.42 Min: 161.55 / Avg: 603.65 / Max: 700.57 Min: 73.05 / Avg: 325.43 / Max: 363.64 Min: 200.65 / Avg: 632.22 / Max: 705.95 Min: 83.71 / Avg: 325.32 / Max: 365.52 Min: 209.29 / Avg: 625.4 / Max: 706.28 Min: 99.17 / Avg: 474.18 / Max: 540.4 Min: 53.82 / Avg: 251.06 / Max: 280.69 Min: 64.96 / Avg: 538.13 / Max: 644.98 Min: 32.89 / Avg: 297.93 / Max: 351.95 Min: 29.56 / Avg: 257.54 / Max: 304.86 Min: 59.19 / Avg: 483.44 / Max: 576.3 Min: 21.12 / Avg: 234.91 / Max: 276.8 Min: 42.21 / Avg: 410.73 / Max: 503.82 Min: 19.53 / Avg: 134.77 / Max: 159.36 Min: 17.15 / Avg: 114 / Max: 136.39 Min: 105.98 / Avg: 407.31 / Max: 478.77 Min: 43.65 / Avg: 193.42 / Max: 225.02 Min: 43.52 / Avg: 240.23 / Max: 284.38 Min: 108.97 / Avg: 460.62 / Max: 565.85 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 18116 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 13452 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 16272 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 22134 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 19635 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 26553 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 18652 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 25433 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 21338 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 17742 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 19507 Joules per run. 12. EPYC 9684X: Approximate power consumption of 13903 Joules per run. 13. EPYC 9654: Approximate power consumption of 12362 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 18209 Joules per run. 15. EPYC 9754: Approximate power consumption of 9788 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 15471 Joules per run. 17. EPYC 8534P: Approximate power consumption of 9613 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 8892 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 26441 Joules per run. 20. Xeon 6766E: Approximate power consumption of 17472 Joules per run. 21. Xeon 6780E: Approximate power consumption of 20179 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 27983 Joules per run.
Intel Open Image Denoise Open Image Denoise is a denoising library for ray-tracing and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 2.2 Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.54 1.08 1.62 2.16 2.7 SE +/- 0.01, N = 4 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 4 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 4 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 2.40 1.58 1.29 2.18 1.08 1.72 1.14 1.74 1.48 0.86 1.64 1.28 1.31 1.67 1.50 1.71 0.86 0.80 1.51 0.98 1.07 1.68 Images / Sec Per Watt
OpenBenchmarking.org Images / Sec Per Watt, More Is Better Intel Open Image Denoise 2.2 Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0016 0.0032 0.0048 0.0064 0.008 0.004 0.005 0.004 0.004 0.003 0.003 0.004 0.003 0.003 0.003 0.003 0.004 0.005 0.003 0.006 0.004 0.006 0.007 0.004 0.004 0.004 0.003 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Intel Open Image Denoise 2.2 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 79.35 / Avg: 534.18 / Max: 740.08 Min: 35.29 / Avg: 290 / Max: 378.6 Min: 59.44 / Avg: 304.48 / Max: 364.78 Min: 169.3 / Avg: 573.61 / Max: 745.77 Min: 75.68 / Avg: 314.57 / Max: 370.97 Min: 206.4 / Avg: 605.57 / Max: 749.65 Min: 78.93 / Avg: 313 / Max: 373.31 Min: 198.59 / Avg: 608.01 / Max: 748.72 Min: 104.72 / Avg: 461.16 / Max: 559.61 Min: 53.73 / Avg: 245.89 / Max: 283.33 Min: 66.51 / Avg: 585.9 / Max: 726.86 Min: 35.65 / Avg: 329.68 / Max: 387.49 Min: 26.15 / Avg: 266.61 / Max: 316.67 Min: 60.67 / Avg: 504.98 / Max: 617.56 Min: 22.02 / Avg: 239.18 / Max: 293.59 Min: 40.88 / Avg: 433.56 / Max: 546.1 Min: 17.84 / Avg: 136.47 / Max: 153.36 Min: 17.12 / Avg: 118.45 / Max: 132.79 Min: 105.15 / Avg: 418.44 / Max: 529.24 Min: 43.68 / Avg: 220.35 / Max: 250.91 Min: 43.6 / Avg: 279.34 / Max: 327.38 Min: 108.06 / Avg: 500.21 / Max: 643.27 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 9482 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 6960 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 8525 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 10899 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 10171 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 13524 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 9599 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 13376 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 11529 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 9672 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 13476 Joules per run. 12. EPYC 9684X: Approximate power consumption of 9231 Joules per run. 13. EPYC 9654: Approximate power consumption of 7287 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 11446 Joules per run. 15. EPYC 9754: Approximate power consumption of 5980 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 9827 Joules per run. 17. EPYC 8534P: Approximate power consumption of 5459 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 5014 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 10566 Joules per run. 20. Xeon 6766E: Approximate power consumption of 7859 Joules per run. 21. Xeon 6780E: Approximate power consumption of 9125 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 11672 Joules per run.
Liquid-DSP LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 512 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 4M 8M 12M 16M 20M SE +/- 162096.41, N = 15 SE +/- 9492.69, N = 3 SE +/- 8685.88, N = 3 SE +/- 38670.98, N = 3 SE +/- 5238.74, N = 3 SE +/- 17457.89, N = 3 SE +/- 30179.10, N = 3 SE +/- 7571.88, N = 3 SE +/- 11150.49, N = 3 SE +/- 18478.22, N = 3 SE +/- 234395.65, N = 15 SE +/- 134727.30, N = 3 SE +/- 121304.48, N = 3 SE +/- 124115.99, N = 3 SE +/- 120841.84, N = 4 SE +/- 11050.39, N = 3 SE +/- 3464.10, N = 3 SE +/- 31571.79, N = 3 SE +/- 33.33, N = 3 SE +/- 115.47, N = 3 SE +/- 88.19, N = 3 SE +/- 133.33, N = 3 18200533 18774333 16882333 16843333 16906333 16904667 16885333 16884000 13599000 13608333 13083133 13387333 13394667 13390667 11174500 11273667 11290000 11236333 6280767 6284300 6983933 6969967 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid samples/s Per Watt
OpenBenchmarking.org samples/s Per Watt, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 512 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 50K 100K 150K 200K 250K 92062.08 234762.36 186991.46 72744.48 144779.82 61488.83 136523.06 60089.56 75252.11 145590.23 54322.93 129024.51 146784.94 61154.45 155096.20 63241.27 229953.45 232185.74 59249.32 143435.84 158555.72 64666.31 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Liquid-DSP 1.6 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 60 120 180 240 300 Min: 80.57 / Avg: 197.7 / Max: 288.51 Min: 34.71 / Avg: 79.97 / Max: 86.36 Min: 64.97 / Avg: 90.28 / Max: 123.68 Min: 161.66 / Avg: 231.54 / Max: 318.27 Min: 76.32 / Avg: 116.77 / Max: 126.02 Min: 202.94 / Avg: 274.92 / Max: 318.53 Min: 87.22 / Avg: 123.68 / Max: 135.23 Min: 214.89 / Avg: 280.98 / Max: 313.66 Min: 100.48 / Avg: 180.71 / Max: 198.88 Min: 48.5 / Avg: 93.47 / Max: 100.4 Min: 58.81 / Avg: 240.84 / Max: 263.72 Min: 33.62 / Avg: 103.76 / Max: 113.64 Min: 27.87 / Avg: 91.25 / Max: 99.85 Min: 58.4 / Avg: 218.96 / Max: 238.65 Min: 20.45 / Avg: 72.05 / Max: 78.73 Min: 39.35 / Avg: 178.26 / Max: 197.4 Min: 16.02 / Avg: 49.1 / Max: 53.74 Min: 15.14 / Avg: 48.39 / Max: 52.91 Min: 103.81 / Avg: 106.01 / Max: 108.94 Min: 43.55 / Avg: 43.81 / Max: 45.6 Min: 43.37 / Avg: 44.05 / Max: 45.52 Min: 105.16 / Avg: 107.78 / Max: 109.29 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 6735 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 2746 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 3100 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 8027 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 4009 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 9347 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 4205 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 9553 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 6144 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 3209 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 8173 Joules per run. 12. EPYC 9684X: Approximate power consumption of 3562 Joules per run. 13. EPYC 9654: Approximate power consumption of 3133 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 7445 Joules per run. 15. EPYC 9754: Approximate power consumption of 2468 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 6061 Joules per run. 17. EPYC 8534P: Approximate power consumption of 1686 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1645 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 3640 Joules per run. 20. Xeon 6766E: Approximate power consumption of 1504 Joules per run. 21. Xeon 6780E: Approximate power consumption of 1512 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 3701 Joules per run.
Intel Open Image Denoise Open Image Denoise is a denoising library for ray-tracing and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 2.2 Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 1.1318 2.2636 3.3954 4.5272 5.659 SE +/- 0.03, N = 6 SE +/- 0.00, N = 5 SE +/- 0.00, N = 4 SE +/- 0.03, N = 6 SE +/- 0.00, N = 4 SE +/- 0.01, N = 5 SE +/- 0.00, N = 4 SE +/- 0.04, N = 5 SE +/- 0.01, N = 5 SE +/- 0.00, N = 3 SE +/- 0.00, N = 5 SE +/- 0.00, N = 4 SE +/- 0.01, N = 4 SE +/- 0.01, N = 5 SE +/- 0.02, N = 5 SE +/- 0.01, N = 5 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 4 SE +/- 0.00, N = 4 SE +/- 0.00, N = 4 SE +/- 0.03, N = 5 5.03 3.31 2.71 4.41 2.26 3.51 2.38 3.65 3.08 1.81 3.45 2.64 2.73 3.48 3.12 3.59 1.79 1.69 2.98 1.93 2.11 3.31 Images / Sec Per Watt
OpenBenchmarking.org Images / Sec Per Watt, More Is Better Intel Open Image Denoise 2.2 Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0036 0.0072 0.0108 0.0144 0.018 0.011 0.013 0.010 0.009 0.008 0.006 0.008 0.007 0.008 0.008 0.007 0.009 0.012 0.008 0.015 0.010 0.014 0.016 0.008 0.010 0.009 0.008 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Intel Open Image Denoise 2.2 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 72.33 / Avg: 443.88 / Max: 736.09 Min: 26.29 / Avg: 249.88 / Max: 378.95 Min: 60.35 / Avg: 271.32 / Max: 366.61 Min: 177.66 / Avg: 501.77 / Max: 743.78 Min: 73.14 / Avg: 287.37 / Max: 372.13 Min: 203.58 / Avg: 542.52 / Max: 747.25 Min: 76.26 / Avg: 283.96 / Max: 374.08 Min: 193.14 / Avg: 539.15 / Max: 749.93 Min: 100.7 / Avg: 406.71 / Max: 559.15 Min: 53.39 / Avg: 224.83 / Max: 282.65 Min: 66.11 / Avg: 502.25 / Max: 723.91 Min: 32.59 / Avg: 284.36 / Max: 386.47 Min: 25.93 / Avg: 230.11 / Max: 317.81 Min: 56.38 / Avg: 425.53 / Max: 615.08 Min: 21.86 / Avg: 203.92 / Max: 294.28 Min: 40.47 / Avg: 369.54 / Max: 546.36 Min: 19.01 / Avg: 124.67 / Max: 154.19 Min: 17.3 / Avg: 107.16 / Max: 132.19 Min: 104.93 / Avg: 363.85 / Max: 529.39 Min: 43.68 / Avg: 198.71 / Max: 249.99 Min: 43.49 / Avg: 246.81 / Max: 322.99 Min: 107.69 / Avg: 422.71 / Max: 638.83 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 4883 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 3448 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 4273 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 6021 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 5101 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 7270 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 4898 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 7117 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 5938 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 4796 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 6831 Joules per run. 12. EPYC 9684X: Approximate power consumption of 4479 Joules per run. 13. EPYC 9654: Approximate power consumption of 3682 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 5787 Joules per run. 15. EPYC 9754: Approximate power consumption of 2977 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 4878 Joules per run. 17. EPYC 8534P: Approximate power consumption of 2701 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 2465 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 5731 Joules per run. 20. Xeon 6766E: Approximate power consumption of 4074 Joules per run. 21. Xeon 6780E: Approximate power consumption of 4751 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 6256 Joules per run.
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: bertsquad-12 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 5 10 15 20 25 SE +/- 0.02832, N = 3 SE +/- 0.21736, N = 3 SE +/- 0.04566, N = 3 SE +/- 0.02421, N = 3 SE +/- 0.06023, N = 3 SE +/- 0.09371, N = 3 SE +/- 0.07567, N = 3 SE +/- 0.04124, N = 3 SE +/- 0.12404, N = 3 SE +/- 0.13407, N = 3 SE +/- 0.04604, N = 3 SE +/- 0.08493, N = 3 SE +/- 0.09004, N = 3 SE +/- 0.05052, N = 3 SE +/- 0.05587, N = 3 SE +/- 0.01907, N = 3 SE +/- 0.10485, N = 3 SE +/- 0.10146, N = 4 SE +/- 0.03979, N = 3 SE +/- 0.00728, N = 3 SE +/- 0.02804, N = 3 SE +/- 0.01071, N = 3 15.43410 19.67730 16.09560 14.52800 16.32510 13.73660 15.73940 13.51900 14.94600 16.68630 8.75971 12.28070 12.25490 8.80930 9.65296 7.98402 9.80090 8.87144 6.66718 8.57286 9.50353 7.13917 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: bertsquad-12 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 30 60 90 120 150 SE +/- 0.12, N = 3 SE +/- 0.57, N = 3 SE +/- 0.18, N = 3 SE +/- 0.11, N = 3 SE +/- 0.23, N = 3 SE +/- 0.50, N = 3 SE +/- 0.31, N = 3 SE +/- 0.23, N = 3 SE +/- 0.56, N = 3 SE +/- 0.49, N = 3 SE +/- 0.60, N = 3 SE +/- 0.57, N = 3 SE +/- 0.60, N = 3 SE +/- 0.65, N = 3 SE +/- 0.60, N = 3 SE +/- 0.30, N = 3 SE +/- 1.08, N = 3 SE +/- 1.29, N = 4 SE +/- 0.90, N = 3 SE +/- 0.10, N = 3 SE +/- 0.31, N = 3 SE +/- 0.21, N = 3 64.79 50.83 62.13 68.83 61.25 72.80 63.54 73.97 66.91 59.94 114.16 81.43 81.60 113.52 103.60 125.24 102.05 112.76 149.99 116.64 105.22 140.07 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.17 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 90 180 270 360 450 Min: 103.61 / Avg: 436.17 / Max: 466.43 Min: 53.86 / Avg: 240.25 / Max: 259.56 Min: 68.13 / Avg: 462.27 / Max: 495 Min: 33.93 / Avg: 264.24 / Max: 286.38 Min: 30.08 / Avg: 223.68 / Max: 241.02 Min: 58.35 / Avg: 411.86 / Max: 441.41 Min: 20.48 / Avg: 190.15 / Max: 204.22 Min: 40.61 / Avg: 307.67 / Max: 327.17 Min: 18.28 / Avg: 121.13 / Max: 131.61 Min: 16.6 / Avg: 99.26 / Max: 116.55 Min: 104.24 / Avg: 292.81 / Max: 313.39 Min: 43.69 / Avg: 144.23 / Max: 154.04 Min: 43.61 / Avg: 168.62 / Max: 180.75 Min: 105.38 / Avg: 317.3 / Max: 341.18 1. Xeon Platinum 8380 2P: Approximate power consumption of 28351 Joules per run. 2. Xeon Platinum 8380: Approximate power consumption of 15616 Joules per run. 3. EPYC 9684X 2P: Approximate power consumption of 30202 Joules per run. 4. EPYC 9684X: Approximate power consumption of 17175 Joules per run. 5. EPYC 9654: Approximate power consumption of 14539 Joules per run. 6. EPYC 9654 2P: Approximate power consumption of 26633 Joules per run. 7. EPYC 9754: Approximate power consumption of 12360 Joules per run. 8. EPYC 9754 2P: Approximate power consumption of 19999 Joules per run. 9. EPYC 8534P: Approximate power consumption of 7873 Joules per run. 10. EPYC 8534PN: Approximate power consumption of 6452 Joules per run. 11. Xeon 6766E 2P: Approximate power consumption of 19423 Joules per run. 12. Xeon 6766E: Approximate power consumption of 9471 Joules per run. 13. Xeon 6780E: Approximate power consumption of 11072 Joules per run. 14. Xeon 6780E 2P: Approximate power consumption of 20942 Joules per run.
LAMMPS Molecular Dynamics Simulator LAMMPS is a classical molecular dynamics code, and an acronym for Large-scale Atomic/Molecular Massively Parallel Simulator. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ns/day, More Is Better LAMMPS Molecular Dynamics Simulator 23Jun2022 Model: 20k Atoms Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 14 28 42 56 70 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.07, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.12, N = 3 SE +/- 0.30, N = 3 SE +/- 0.12, N = 3 SE +/- 0.13, N = 3 SE +/- 0.19, N = 3 SE +/- 0.13, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 56.40 37.46 34.89 50.52 28.28 46.71 32.16 51.82 35.70 21.38 62.00 46.89 42.51 57.10 47.99 58.84 27.53 25.33 1. (CXX) g++ options: -O3 -lm -ldl ns/day Per Watt
OpenBenchmarking.org ns/day Per Watt, More Is Better LAMMPS Molecular Dynamics Simulator 23Jun2022 Model: 20k Atoms Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 0.0432 0.0864 0.1296 0.1728 0.216 0.084 0.110 0.102 0.074 0.082 0.068 0.093 0.076 0.067 0.080 0.079 0.117 0.133 0.090 0.151 0.094 0.180 0.192 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better LAMMPS Molecular Dynamics Simulator 23Jun2022 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 140 280 420 560 700 Min: 65.48 / Avg: 673.08 / Max: 752.97 Min: 22.64 / Avg: 341.9 / Max: 376.37 Min: 61.2 / Avg: 343.29 / Max: 376.01 Min: 165.47 / Avg: 680.62 / Max: 754.38 Min: 75.25 / Avg: 345.23 / Max: 374.68 Min: 186.6 / Avg: 685.33 / Max: 753.98 Min: 77.1 / Avg: 344.05 / Max: 376.79 Min: 192.84 / Avg: 682.64 / Max: 752.01 Min: 97.85 / Avg: 530.19 / Max: 581.83 Min: 52.92 / Avg: 266.98 / Max: 289.96 Min: 64.31 / Avg: 785.79 / Max: 819.57 Min: 31.69 / Avg: 399.48 / Max: 409.61 Min: 29.12 / Avg: 318.64 / Max: 329.98 Min: 55.66 / Avg: 633.05 / Max: 669.84 Min: 19.76 / Avg: 318.23 / Max: 330.98 Min: 40.67 / Avg: 624.63 / Max: 672.65 Min: 15.99 / Avg: 153.16 / Max: 156.26 Min: 15.43 / Avg: 132.09 / Max: 137.27 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 108814 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 80803 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 86738 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 121832 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 107137 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 130897 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 94269 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 118552 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 130956 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 109018 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 115511 Joules per run. 12. EPYC 9684X: Approximate power consumption of 75235 Joules per run. 13. EPYC 9654: Approximate power consumption of 66170 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 100445 Joules per run. 15. EPYC 9754: Approximate power consumption of 58873 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 98899 Joules per run. 17. EPYC 8534P: Approximate power consumption of 48757 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 45659 Joules per run.
LuxCoreRender LuxCoreRender is an open-source 3D physically based renderer formerly known as LuxRender. LuxCoreRender supports CPU-based rendering as well as GPU acceleration via OpenCL, NVIDIA CUDA, and NVIDIA OptiX interfaces. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: LuxCore Benchmark - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 3 6 9 12 15 SE +/- 0.17, N = 12 SE +/- 0.11, N = 3 SE +/- 0.04, N = 3 SE +/- 0.12, N = 3 SE +/- 0.03, N = 3 SE +/- 0.22, N = 12 SE +/- 0.05, N = 3 SE +/- 0.16, N = 15 SE +/- 0.07, N = 15 SE +/- 0.06, N = 15 SE +/- 0.12, N = 15 SE +/- 0.04, N = 3 SE +/- 0.10, N = 7 SE +/- 0.11, N = 15 SE +/- 0.16, N = 3 SE +/- 0.08, N = 15 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.10, N = 15 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.08, N = 15 8.88 8.06 7.10 8.82 6.30 6.81 6.82 7.41 6.43 4.29 10.61 12.43 11.34 10.56 12.41 9.65 7.38 6.93 6.41 7.90 8.47 6.74 M samples/sec Per Watt
OpenBenchmarking.org M samples/sec Per Watt, More Is Better LuxCoreRender 2.6 Scene: LuxCore Benchmark - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0119 0.0238 0.0357 0.0476 0.0595 0.014 0.025 0.022 0.014 0.019 0.010 0.021 0.011 0.013 0.017 0.017 0.034 0.040 0.020 0.043 0.021 0.049 0.053 0.022 0.046 0.039 0.020 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better LuxCoreRender 2.6 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 83.65 / Avg: 634.64 / Max: 754.69 Min: 34.18 / Avg: 318.84 / Max: 374.24 Min: 62.21 / Avg: 319.52 / Max: 375.32 Min: 178.58 / Avg: 636.83 / Max: 753.39 Min: 74.54 / Avg: 324.24 / Max: 366.89 Min: 205.6 / Avg: 650.43 / Max: 750.56 Min: 85.32 / Avg: 325.06 / Max: 364.85 Min: 129.79 / Avg: 649.71 / Max: 752.19 Min: 101 / Avg: 492.26 / Max: 580.68 Min: 52.8 / Avg: 250 / Max: 286.38 Min: 38.08 / Avg: 620.51 / Max: 723.33 Min: 34.2 / Avg: 365.21 / Max: 410.93 Min: 28.93 / Avg: 284.2 / Max: 318.53 Min: 58.25 / Avg: 537.06 / Max: 610.46 Min: 23.22 / Avg: 288.11 / Max: 334.63 Min: 40.41 / Avg: 450.3 / Max: 521.1 Min: 18.49 / Avg: 149.9 / Max: 169.31 Min: 17.5 / Avg: 131.25 / Max: 148.58 Min: 104.76 / Avg: 297.7 / Max: 400.24 Min: 43.63 / Avg: 172.93 / Max: 201.7 Min: 43.54 / Avg: 215.89 / Max: 253.56 Min: 107.86 / Avg: 344.5 / Max: 460.96 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 42151 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 21256 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21301 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 42668 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 21508 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 43200 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 21562 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 43227 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 32653 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16517 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 41285 Joules per run. 12. EPYC 9684X: Approximate power consumption of 23739 Joules per run. 13. EPYC 9654: Approximate power consumption of 18879 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 35804 Joules per run. 15. EPYC 9754: Approximate power consumption of 18823 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 30020 Joules per run. 17. EPYC 8534P: Approximate power consumption of 9943 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 8707 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 20085 Joules per run. 20. Xeon 6766E: Approximate power consumption of 11529 Joules per run. 21. Xeon 6780E: Approximate power consumption of 14537 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 23196 Joules per run.
TensorFlow This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: AlexNet Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 400 800 1200 1600 2000 SE +/- 1.86, N = 3 SE +/- 4.27, N = 3 SE +/- 0.54, N = 3 SE +/- 5.06, N = 3 SE +/- 1.21, N = 3 SE +/- 1.15, N = 3 SE +/- 6.82, N = 3 SE +/- 5.81, N = 3 SE +/- 3.03, N = 3 SE +/- 1.28, N = 3 SE +/- 15.82, N = 3 SE +/- 1.54, N = 3 SE +/- 2.58, N = 3 SE +/- 6.01, N = 3 SE +/- 4.01, N = 3 SE +/- 10.23, N = 15 SE +/- 0.99, N = 3 SE +/- 0.41, N = 3 SE +/- 19.06, N = 15 SE +/- 1.03, N = 3 SE +/- 2.12, N = 3 SE +/- 10.51, N = 4 1681.44 1277.46 1205.30 1730.25 986.04 1479.53 1058.99 1528.41 1340.34 852.14 1560.56 1301.26 1278.58 1524.74 1454.71 1403.46 843.63 771.47 857.20 609.67 668.33 1010.93 images/sec Per Watt
OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: AlexNet Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 2 4 6 8 10 3.635 4.749 4.146 3.122 3.205 2.515 3.444 2.593 3.127 3.591 3.248 4.808 5.419 3.535 6.976 3.829 6.684 7.144 2.368 3.524 3.126 2.456 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.16.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 Min: 79.54 / Avg: 462.52 / Max: 594.2 Min: 33.64 / Avg: 268.97 / Max: 332.41 Min: 58.81 / Avg: 290.68 / Max: 351.63 Min: 155.31 / Avg: 554.16 / Max: 691.31 Min: 71.72 / Avg: 307.61 / Max: 356.17 Min: 206.23 / Avg: 588.17 / Max: 702.19 Min: 83.56 / Avg: 307.45 / Max: 358.74 Min: 196.2 / Avg: 589.54 / Max: 703.42 Min: 102.12 / Avg: 428.69 / Max: 526.9 Min: 53.46 / Avg: 237.33 / Max: 279.61 Min: 69.6 / Avg: 480.42 / Max: 618.89 Min: 33.53 / Avg: 270.65 / Max: 335.43 Min: 26.89 / Avg: 235.94 / Max: 296.09 Min: 54.66 / Avg: 428.39 / Max: 556.88 Min: 22.22 / Avg: 206.77 / Max: 269.72 Min: 40.95 / Avg: 366.52 / Max: 481.87 Min: 17.24 / Avg: 126.21 / Max: 154.11 Min: 18.12 / Avg: 108 / Max: 132.76 Min: 105.44 / Avg: 362.01 / Max: 449.07 Min: 43.66 / Avg: 173.02 / Max: 210.79 Min: 43.57 / Avg: 213.83 / Max: 263.13 Min: 108.29 / Avg: 411.57 / Max: 512.05 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 10638 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 7621 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 8527 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 12746 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 10767 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 15293 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 10146 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 14738 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 11860 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 9414 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 12011 Joules per run. 12. EPYC 9684X: Approximate power consumption of 7578 Joules per run. 13. EPYC 9654: Approximate power consumption of 6685 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 10995 Joules per run. 15. EPYC 9754: Approximate power consumption of 5445 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 10043 Joules per run. 17. EPYC 8534P: Approximate power consumption of 5090 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 4680 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 14601 Joules per run. 20. Xeon 6766E: Approximate power consumption of 9228 Joules per run. 21. Xeon 6780E: Approximate power consumption of 10549 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 14508 Joules per run.
Liquid-DSP LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 512 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 300M 600M 900M 1200M 1500M SE +/- 4790383.89, N = 3 SE +/- 2313246.88, N = 3 SE +/- 1740596.96, N = 3 SE +/- 6842108.19, N = 3 SE +/- 681281.47, N = 3 SE +/- 11560043.25, N = 5 SE +/- 1345523.44, N = 3 SE +/- 2123152.79, N = 3 SE +/- 8061118.62, N = 3 SE +/- 912164.70, N = 3 SE +/- 3901424.24, N = 3 SE +/- 2412697.89, N = 3 SE +/- 1047748.91, N = 3 SE +/- 2338327.99, N = 3 SE +/- 814452.78, N = 3 SE +/- 503322.30, N = 3 SE +/- 390953.25, N = 3 SE +/- 431058.13, N = 3 SE +/- 1072572.19, N = 3 SE +/- 305632.31, N = 3 SE +/- 287923.60, N = 3 SE +/- 866544.86, N = 3 1493833333 1152933333 918566667 1126466667 800186667 1091460000 882200000 1206066667 981090000 539226667 1394733333 1368733333 1158166667 1199966667 1369800000 1349800000 809916667 731756667 707053333 719626667 796340000 777940000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid samples/s Per Watt
OpenBenchmarking.org samples/s Per Watt, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 512 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 1.4M 2.8M 4.2M 5.6M 7M 2443783.02 3740373.11 2929507.99 1966021.92 2528910.04 1702250.87 2800439.16 1899608.97 2021740.47 2212405.84 2805690.78 3778092.65 4367851.07 2957086.75 5183635.11 3727692.53 5867538.62 6364836.35 2621658.59 3673478.12 3117578.50 2466244.28 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Liquid-DSP 1.6 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 70.15 / Avg: 611.28 / Max: 739.63 Min: 27.09 / Avg: 308.24 / Max: 376.57 Min: 60 / Avg: 313.56 / Max: 376 Min: 168.69 / Avg: 572.97 / Max: 696.31 Min: 77.21 / Avg: 316.42 / Max: 377.29 Min: 197.48 / Avg: 641.19 / Max: 750.61 Min: 75.73 / Avg: 315.02 / Max: 376.2 Min: 206.37 / Avg: 634.9 / Max: 748.44 Min: 102.29 / Avg: 485.27 / Max: 581.46 Min: 52.09 / Avg: 243.73 / Max: 291.23 Min: 65.97 / Avg: 497.11 / Max: 585.32 Min: 32.21 / Avg: 362.28 / Max: 409.42 Min: 26.08 / Avg: 265.16 / Max: 303.52 Min: 53.51 / Avg: 405.79 / Max: 476.68 Min: 21.47 / Avg: 264.25 / Max: 302.73 Min: 40.86 / Avg: 362.1 / Max: 421.05 Min: 18.57 / Avg: 138.03 / Max: 156.97 Min: 16.09 / Avg: 114.97 / Max: 130.99 Min: 104.69 / Avg: 269.7 / Max: 304.35 Min: 43.64 / Avg: 195.9 / Max: 223.9 Min: 43.62 / Avg: 255.44 / Max: 293.66 Min: 107.89 / Avg: 315.44 / Max: 358.75 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 21191 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 10583 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 10870 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 19863 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 10864 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 22057 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 10921 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 22010 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 16823 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 8368 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 16736 Joules per run. 12. EPYC 9684X: Approximate power consumption of 12318 Joules per run. 13. EPYC 9654: Approximate power consumption of 9104 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 13797 Joules per run. 15. EPYC 9754: Approximate power consumption of 9161 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 12432 Joules per run. 17. EPYC 8534P: Approximate power consumption of 4785 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 3986 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 9439 Joules per run. 20. Xeon 6766E: Approximate power consumption of 6856 Joules per run. 21. Xeon 6780E: Approximate power consumption of 8940 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 10935 Joules per run.
CloverLeaf CloverLeaf is a Lagrangian-Eulerian hydrodynamics benchmark. This test profile currently makes use of CloverLeaf's OpenMP version. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better CloverLeaf 1.3 Input: clover_bm64_short Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 14 28 42 56 70 SE +/- 0.45, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.24, N = 3 SE +/- 0.15, N = 3 SE +/- 0.31, N = 15 SE +/- 0.17, N = 3 SE +/- 0.40, N = 4 SE +/- 0.31, N = 3 SE +/- 0.03, N = 3 SE +/- 0.23, N = 3 SE +/- 1.81, N = 15 SE +/- 2.15, N = 15 SE +/- 1.11, N = 12 SE +/- 2.07, N = 12 SE +/- 0.30, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.33, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.33, N = 3 31.90 39.38 39.48 26.58 41.43 32.25 42.22 32.44 35.29 60.89 22.83 42.17 46.50 30.05 48.36 27.74 57.38 57.54 28.99 38.01 38.01 28.92 1. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better CloverLeaf 1.3 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 75.65 / Avg: 552.24 / Max: 662.73 Min: 32.08 / Avg: 299.62 / Max: 336.85 Min: 57.26 / Avg: 320.54 / Max: 366.56 Min: 166.73 / Avg: 611.92 / Max: 712.51 Min: 76.4 / Avg: 324.2 / Max: 367.03 Min: 195.63 / Avg: 623.99 / Max: 717.07 Min: 74.72 / Avg: 323.64 / Max: 372.82 Min: 199.64 / Avg: 627.92 / Max: 713.69 Min: 102.86 / Avg: 479 / Max: 543.07 Min: 53.35 / Avg: 254.93 / Max: 281.37 Min: 68.07 / Avg: 499.33 / Max: 638.11 Min: 33.05 / Avg: 264.63 / Max: 353.22 Min: 25.91 / Avg: 223.18 / Max: 288.87 Min: 56.35 / Avg: 437.97 / Max: 551.54 Min: 19.77 / Avg: 183.89 / Max: 245.13 Min: 42.14 / Avg: 366.92 / Max: 461.67 Min: 19.22 / Avg: 132.55 / Max: 146.42 Min: 17.1 / Avg: 122.03 / Max: 133.14 Min: 104.9 / Avg: 364.67 / Max: 444.64 Min: 43.65 / Avg: 168.7 / Max: 186.26 Min: 43.45 / Avg: 184.14 / Max: 204.33 Min: 107.36 / Avg: 389.09 / Max: 472.12 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 20433 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 13183 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 14318 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 19581 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 15021 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 23212 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 15211 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 23390 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 19000 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16825 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 13981 Joules per run. 12. EPYC 9684X: Approximate power consumption of 12490 Joules per run. 13. EPYC 9654: Approximate power consumption of 11531 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 15438 Joules per run. 15. EPYC 9754: Approximate power consumption of 9869 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 12108 Joules per run. 17. EPYC 8534P: Approximate power consumption of 8306 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 7688 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 12642 Joules per run. 20. Xeon 6766E: Approximate power consumption of 7310 Joules per run. 21. Xeon 6780E: Approximate power consumption of 7979 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 13489 Joules per run.
LAMMPS Molecular Dynamics Simulator LAMMPS is a classical molecular dynamics code, and an acronym for Large-scale Atomic/Molecular Massively Parallel Simulator. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ns/day, More Is Better LAMMPS Molecular Dynamics Simulator 23Jun2022 Model: Rhodopsin Protein Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 12 24 36 48 60 SE +/- 0.97, N = 15 SE +/- 0.29, N = 15 SE +/- 0.36, N = 15 SE +/- 0.33, N = 8 SE +/- 0.05, N = 11 SE +/- 0.11, N = 9 SE +/- 0.04, N = 11 SE +/- 0.09, N = 8 SE +/- 0.53, N = 15 SE +/- 0.28, N = 15 SE +/- 0.43, N = 7 SE +/- 0.35, N = 15 SE +/- 0.14, N = 11 SE +/- 0.39, N = 7 SE +/- 0.29, N = 10 SE +/- 0.24, N = 5 SE +/- 0.29, N = 15 SE +/- 0.30, N = 15 55.50 34.30 28.72 42.28 27.63 47.51 30.84 52.24 33.54 21.16 53.77 40.00 36.15 50.12 40.39 51.63 24.25 21.94 1. (CXX) g++ options: -O3 -lm -ldl ns/day Per Watt
OpenBenchmarking.org ns/day Per Watt, More Is Better LAMMPS Molecular Dynamics Simulator 23Jun2022 Model: Rhodopsin Protein Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 0.104 0.208 0.312 0.416 0.52 0.196 0.341 0.209 0.119 0.184 0.129 0.209 0.136 0.148 0.186 0.179 0.358 0.372 0.189 0.451 0.204 0.462 0.451 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better LAMMPS Molecular Dynamics Simulator 23Jun2022 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 120 240 360 480 600 Min: 63.52 / Avg: 283.35 / Max: 590.85 Min: 22.32 / Avg: 100.63 / Max: 327.13 Min: 59.51 / Avg: 137.71 / Max: 356.46 Min: 158.94 / Avg: 354.59 / Max: 652.14 Min: 74.62 / Avg: 150.09 / Max: 352.27 Min: 188.46 / Avg: 368.48 / Max: 640.19 Min: 73.75 / Avg: 147.45 / Max: 350.72 Min: 185.06 / Avg: 384.54 / Max: 575.71 Min: 99.81 / Avg: 226.26 / Max: 547.72 Min: 51.92 / Avg: 113.55 / Max: 290.07 Min: 60.69 / Avg: 300.13 / Max: 690.91 Min: 27.48 / Avg: 111.71 / Max: 349.02 Min: 26.87 / Avg: 97.2 / Max: 234.7 Min: 56.67 / Avg: 265.38 / Max: 605.84 Min: 20.56 / Avg: 89.57 / Max: 288.34 Min: 41.5 / Avg: 252.99 / Max: 566.7 Min: 16.36 / Avg: 52.44 / Max: 142.05 Min: 15.52 / Avg: 48.67 / Max: 132.86 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 2739 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 644 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 845 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 2970 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 887 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 2702 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 871 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 3076 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 1463 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 666 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 2830 Joules per run. 12. EPYC 9684X: Approximate power consumption of 663 Joules per run. 13. EPYC 9654: Approximate power consumption of 592 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 2540 Joules per run. 15. EPYC 9754: Approximate power consumption of 609 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 3441 Joules per run. 17. EPYC 8534P: Approximate power consumption of 318 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 295 Joules per run.
PostgreSQL This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 7 14 21 28 35 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.12, N = 3 SE +/- 0.12, N = 12 SE +/- 0.32, N = 12 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.25, N = 12 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.10, N = 3 SE +/- 0.14, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.15, N = 3 30.20 13.26 14.04 14.86 14.29 16.96 13.85 16.66 13.69 16.34 18.16 12.58 12.50 18.06 13.84 16.88 16.32 18.05 28.81 12.63 11.54 26.29 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better PostgreSQL 16 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 110 220 330 440 550 Min: 71.52 / Avg: 361.27 / Max: 515.84 Min: 31.89 / Avg: 275.46 / Max: 347.94 Min: 54.62 / Avg: 299.36 / Max: 354.29 Min: 162.26 / Avg: 519.08 / Max: 620.62 Min: 69.55 / Avg: 311.42 / Max: 350.84 Min: 201.21 / Avg: 553.8 / Max: 622.91 Min: 86.13 / Avg: 315.59 / Max: 351.55 Min: 197.27 / Avg: 561.38 / Max: 632.44 Min: 103.15 / Avg: 454.63 / Max: 533.63 Min: 54.49 / Avg: 239.87 / Max: 290.09 Min: 42.76 / Avg: 483.2 / Max: 581.92 Min: 32.63 / Avg: 299.03 / Max: 361.05 Min: 19.41 / Avg: 254.31 / Max: 305.58 Min: 48.63 / Avg: 431.32 / Max: 519.43 Min: 21.27 / Avg: 207.74 / Max: 251.71 Min: 37.64 / Avg: 361.97 / Max: 439.12 Min: 16.91 / Avg: 135.16 / Max: 158.27 Min: 15.4 / Avg: 110.68 / Max: 134.33 Min: 104.31 / Avg: 242.14 / Max: 314.19 Min: 43.52 / Avg: 150.61 / Max: 191.14 Min: 43.39 / Avg: 172.92 / Max: 212.03 Min: 107.64 / Avg: 262.99 / Max: 345.55 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 51180 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 38748 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 42409 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 74402 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 44014 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 78640 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 44604 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 79904 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 64709 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 34102 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 68614 Joules per run. 12. EPYC 9684X: Approximate power consumption of 42562 Joules per run. 13. EPYC 9654: Approximate power consumption of 36282 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 61140 Joules per run. 15. EPYC 9754: Approximate power consumption of 29845 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 52002 Joules per run. 17. EPYC 8534P: Approximate power consumption of 19419 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 15901 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 35271 Joules per run. 20. Xeon 6766E: Approximate power consumption of 21738 Joules per run. 21. Xeon 6780E: Approximate power consumption of 24785 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 38484 Joules per run.
OpenBenchmarking.org TPS, More Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 20K 40K 60K 80K 100K SE +/- 106.16, N = 3 SE +/- 198.41, N = 3 SE +/- 78.02, N = 3 SE +/- 137.82, N = 3 SE +/- 95.84, N = 3 SE +/- 195.77, N = 3 SE +/- 143.25, N = 3 SE +/- 440.63, N = 3 SE +/- 656.63, N = 3 SE +/- 434.11, N = 12 SE +/- 1059.49, N = 12 SE +/- 87.23, N = 3 SE +/- 232.97, N = 3 SE +/- 865.71, N = 12 SE +/- 242.45, N = 3 SE +/- 58.85, N = 3 SE +/- 175.33, N = 3 SE +/- 299.71, N = 3 SE +/- 163.06, N = 3 SE +/- 186.80, N = 3 SE +/- 232.81, N = 3 SE +/- 221.82, N = 3 33110 75396 71227 67315 69969 58952 72225 60046 73042 61233 55272 79492 79987 55505 72244 59228 61272 55395 34716 79191 86677 38043 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
srsRAN Project srsRAN Project is a complete ORAN-native 5G RAN solution created by Software Radio Systems (SRS). The srsRAN Project radio suite was formerly known as srsLTE and can be used for building your own software-defined radio (SDR) 4G/5G mobile network. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Mbps, More Is Better srsRAN Project 23.10.1-20240325 Test: PUSCH Processor Benchmark, Throughput Thread Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 30 60 90 120 150 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.07, N = 3 129.5 129.5 129.7 129.7 129.7 129.7 129.7 129.7 112.3 112.3 112.2 112.2 112.2 112.2 112.1 112.1 112.1 112.1 49.8 49.8 52.5 52.6 1. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -fno-trapping-math -fno-math-errno -ldl Mbps Per Watt
OpenBenchmarking.org Mbps Per Watt, More Is Better srsRAN Project 23.10.1-20240325 Test: PUSCH Processor Benchmark, Throughput Thread Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.511 1.022 1.533 2.044 2.555 0.564 1.196 0.965 0.426 0.750 0.345 0.736 0.347 0.603 1.201 0.476 1.095 1.257 0.524 1.551 0.637 2.234 2.271 0.467 1.139 1.193 0.487 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better srsRAN Project 23.10.1-20240325 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 70 140 210 280 350 Min: 80.8 / Avg: 229.54 / Max: 284.84 Min: 34.52 / Avg: 108.29 / Max: 130.82 Min: 59.93 / Avg: 134.44 / Max: 153.53 Min: 160.99 / Avg: 304.32 / Max: 339.38 Min: 72.46 / Avg: 172.93 / Max: 196.41 Min: 207.62 / Avg: 375.78 / Max: 415.17 Min: 77.25 / Avg: 176.34 / Max: 199.62 Min: 206.09 / Avg: 373.48 / Max: 412.46 Min: 97.13 / Avg: 186.14 / Max: 224.52 Min: 52.1 / Avg: 93.49 / Max: 102.87 Min: 61.91 / Avg: 235.89 / Max: 267.82 Min: 34.3 / Avg: 102.46 / Max: 115.98 Min: 27.03 / Avg: 89.27 / Max: 101.62 Min: 58.78 / Avg: 213.93 / Max: 242.48 Min: 21.9 / Avg: 72.27 / Max: 82.25 Min: 40.92 / Avg: 175.84 / Max: 200.95 Min: 16.97 / Avg: 50.19 / Max: 57.02 Min: 16.95 / Avg: 49.36 / Max: 56.04 Min: 103.85 / Avg: 106.63 / Max: 109.21 Min: 43.55 / Avg: 43.73 / Max: 45.56 Min: 21.98 / Avg: 44.02 / Max: 45.61 Min: 104.39 / Avg: 107.97 / Max: 110.48 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 5050 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 2382 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 2958 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 6695 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 3747 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 8142 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 3821 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 8217 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 4716 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 2368 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 5976 Joules per run. 12. EPYC 9684X: Approximate power consumption of 2596 Joules per run. 13. EPYC 9654: Approximate power consumption of 2262 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 5348 Joules per run. 15. EPYC 9754: Approximate power consumption of 1831 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 4455 Joules per run. 17. EPYC 8534P: Approximate power consumption of 1271 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1251 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 5758 Joules per run. 20. Xeon 6766E: Approximate power consumption of 2361 Joules per run. 21. Xeon 6780E: Approximate power consumption of 2216 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 5434 Joules per run.
Result
OpenBenchmarking.org Mbps, More Is Better srsRAN Project 23.10.1-20240325 Test: PDSCH Processor Benchmark, Throughput Thread Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 160 320 480 640 800 SE +/- 1.89, N = 8 SE +/- 1.34, N = 8 SE +/- 1.17, N = 8 SE +/- 2.57, N = 8 SE +/- 1.64, N = 8 SE +/- 3.86, N = 8 SE +/- 1.27, N = 8 SE +/- 5.02, N = 8 SE +/- 2.08, N = 7 SE +/- 3.57, N = 7 SE +/- 5.52, N = 8 SE +/- 3.13, N = 8 SE +/- 1.71, N = 8 SE +/- 3.72, N = 8 SE +/- 0.80, N = 7 SE +/- 4.48, N = 7 SE +/- 3.14, N = 7 SE +/- 1.24, N = 7 SE +/- 0.32, N = 5 SE +/- 0.32, N = 5 SE +/- 0.24, N = 5 SE +/- 0.66, N = 5 755.5 742.9 680.2 675.5 702.6 651.9 705.5 663.8 490.3 484.8 664.7 680.7 684.7 673.4 596.2 576.8 557.9 563.6 293.1 299.4 333.2 323.7 1. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -fno-trapping-math -fno-math-errno -ldl Mbps Per Watt
OpenBenchmarking.org Mbps Per Watt, More Is Better srsRAN Project 23.10.1-20240325 Test: PDSCH Processor Benchmark, Throughput Thread Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 4 8 12 16 20 4.074 8.929 6.116 2.598 5.085 2.035 4.788 2.065 2.998 5.866 3.639 8.628 9.795 4.162 10.675 4.200 13.548 14.524 2.726 6.807 7.249 2.979 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better srsRAN Project 23.10.1-20240325 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 70 140 210 280 350 Min: 80.15 / Avg: 185.44 / Max: 287.05 Min: 24.93 / Avg: 83.2 / Max: 132.66 Min: 62.63 / Avg: 111.22 / Max: 152.68 Min: 161.37 / Avg: 259.97 / Max: 337.8 Min: 73.91 / Avg: 138.16 / Max: 195.36 Min: 204.49 / Avg: 320.28 / Max: 415.75 Min: 85.93 / Avg: 147.34 / Max: 200.38 Min: 199.86 / Avg: 321.38 / Max: 411.1 Min: 98.94 / Avg: 163.54 / Max: 216.84 Min: 51.21 / Avg: 82.65 / Max: 104.34 Min: 63.99 / Avg: 182.65 / Max: 268.9 Min: 30.33 / Avg: 78.89 / Max: 117.61 Min: 28.33 / Avg: 69.9 / Max: 103.51 Min: 56.59 / Avg: 161.78 / Max: 243.41 Min: 20.14 / Avg: 55.85 / Max: 81.57 Min: 38.06 / Avg: 137.34 / Max: 200.95 Min: 18.39 / Avg: 41.18 / Max: 58.06 Min: 13.69 / Avg: 38.81 / Max: 55.52 Min: 103.98 / Avg: 107.54 / Max: 109.81 Min: 43.56 / Avg: 43.98 / Max: 45.49 Min: 43.52 / Avg: 45.97 / Max: 48.12 Min: 104.77 / Avg: 108.64 / Max: 112.06 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 1484 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 676 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 945 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 2210 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 1123 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 2682 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 1197 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 2651 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 1635 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 838 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 1553 Joules per run. 12. EPYC 9684X: Approximate power consumption of 680 Joules per run. 13. EPYC 9654: Approximate power consumption of 594 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 1375 Joules per run. 15. EPYC 9754: Approximate power consumption of 519 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 1275 Joules per run. 17. EPYC 8534P: Approximate power consumption of 388 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 360 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 1527 Joules per run. 20. Xeon 6766E: Approximate power consumption of 625 Joules per run. 21. Xeon 6780E: Approximate power consumption of 607 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 1434 Joules per run.
OpenRadioss OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: INIVOL and Fluid Structure Interaction Drop Container Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 40 80 120 160 200 SE +/- 0.30, N = 3 SE +/- 0.12, N = 3 SE +/- 0.19, N = 3 SE +/- 0.17, N = 3 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.09, N = 3 SE +/- 0.50, N = 3 SE +/- 0.23, N = 3 SE +/- 0.43, N = 3 SE +/- 0.93, N = 3 SE +/- 0.57, N = 3 SE +/- 0.14, N = 3 SE +/- 0.46, N = 3 SE +/- 0.12, N = 3 SE +/- 0.37, N = 3 SE +/- 0.63, N = 3 100.00 128.74 140.43 107.36 160.56 114.29 146.03 110.56 135.56 204.21 79.42 94.76 100.24 85.89 106.54 90.85 176.87 187.03 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OpenRadioss 2023.09.15 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 140 280 420 560 700 Min: 67.07 / Avg: 633.7 / Max: 776.53 Min: 23.22 / Avg: 328.15 / Max: 377.07 Min: 60.99 / Avg: 331.72 / Max: 375.56 Min: 175.02 / Avg: 647.82 / Max: 749.74 Min: 72.45 / Avg: 335.98 / Max: 368.12 Min: 204.9 / Avg: 661.11 / Max: 752.72 Min: 75.87 / Avg: 334.64 / Max: 374.39 Min: 215.12 / Avg: 658.11 / Max: 751.86 Min: 99.13 / Avg: 505.66 / Max: 581.63 Min: 52.13 / Avg: 259.44 / Max: 290.81 Min: 65.3 / Avg: 702.37 / Max: 819.28 Min: 34.68 / Avg: 370.43 / Max: 409.62 Min: 27.14 / Avg: 303.45 / Max: 345.2 Min: 57.91 / Avg: 595.98 / Max: 703.76 Min: 21.72 / Avg: 297.41 / Max: 340.37 Min: 41.48 / Avg: 554.53 / Max: 680.58 Min: 18.75 / Avg: 147.36 / Max: 159.1 Min: 18.08 / Avg: 129.32 / Max: 137.09 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 71397 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 45613 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 49979 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 77954 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 57340 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 83521 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 52203 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 80728 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 74837 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 55866 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 65789 Joules per run. 12. EPYC 9684X: Approximate power consumption of 39389 Joules per run. 13. EPYC 9654: Approximate power consumption of 33885 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 59598 Joules per run. 15. EPYC 9754: Approximate power consumption of 35888 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 61183 Joules per run. 17. EPYC 8534P: Approximate power consumption of 27851 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 25735 Joules per run.
Liquid-DSP LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 512 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 200M 400M 600M 800M 1000M SE +/- 7562646.32, N = 8 SE +/- 1515552.70, N = 3 SE +/- 940265.92, N = 3 SE +/- 3717554.45, N = 3 SE +/- 1611276.24, N = 3 SE +/- 4432294.36, N = 3 SE +/- 1289603.73, N = 3 SE +/- 6141471.96, N = 3 SE +/- 749718.47, N = 3 SE +/- 147685.85, N = 3 SE +/- 3039034.93, N = 3 SE +/- 752558.60, N = 3 SE +/- 1678355.68, N = 3 SE +/- 2261241.06, N = 3 SE +/- 673003.22, N = 3 SE +/- 958772.36, N = 3 SE +/- 822739.33, N = 3 SE +/- 2292977.20, N = 3 SE +/- 584646.14, N = 3 SE +/- 271682.00, N = 3 SE +/- 124677.36, N = 3 SE +/- 3610015.39, N = 3 883701250 783770000 744410000 799496667 632396667 732560000 689003333 757176667 646513333 503253333 849340000 850586667 811373333 824583333 709650000 709393333 633860000 577263333 349746667 359576667 398566667 384406667 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid samples/s Per Watt
OpenBenchmarking.org samples/s Per Watt, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 512 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 1.2M 2.4M 3.6M 4.8M 6M 1705499.35 2577646.65 2362548.08 1519282.71 1991130.78 1151612.89 2174337.88 1184768.10 1510160.81 2067133.31 1904459.88 2753902.96 3317050.16 2172222.16 3748079.60 2394875.44 5046791.28 5458880.22 1767425.56 2885618.69 2545869.67 1718163.34 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Liquid-DSP 1.6 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 67.01 / Avg: 518.15 / Max: 711.65 Min: 26.5 / Avg: 304.06 / Max: 370.78 Min: 61.24 / Avg: 315.09 / Max: 375.37 Min: 164.45 / Avg: 526.23 / Max: 645.98 Min: 79.61 / Avg: 317.61 / Max: 374.24 Min: 195.75 / Avg: 636.12 / Max: 707.28 Min: 80.39 / Avg: 316.88 / Max: 376.81 Min: 148.91 / Avg: 639.09 / Max: 734.49 Min: 103.26 / Avg: 428.11 / Max: 542.37 Min: 52.9 / Avg: 243.45 / Max: 291.14 Min: 65.79 / Avg: 445.97 / Max: 506.44 Min: 34.73 / Avg: 308.87 / Max: 353.22 Min: 28.29 / Avg: 244.61 / Max: 277.01 Min: 59.09 / Avg: 379.6 / Max: 439.61 Min: 18.89 / Avg: 189.34 / Max: 213.55 Min: 39.32 / Avg: 296.21 / Max: 332.18 Min: 17.47 / Avg: 125.6 / Max: 142.49 Min: 16.94 / Avg: 105.75 / Max: 120.76 Min: 104.54 / Avg: 197.88 / Max: 220.13 Min: 43.66 / Avg: 124.61 / Max: 137.3 Min: 43.52 / Avg: 156.55 / Max: 174.71 Min: 107.13 / Avg: 223.73 / Max: 248.1 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 17747 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 10440 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 10818 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 18243 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 10905 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 21416 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 10774 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 21942 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 14698 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 8277 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 15163 Joules per run. 12. EPYC 9684X: Approximate power consumption of 10501 Joules per run. 13. EPYC 9654: Approximate power consumption of 8398 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 13033 Joules per run. 15. EPYC 9754: Approximate power consumption of 6437 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 10071 Joules per run. 17. EPYC 8534P: Approximate power consumption of 4354 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 3631 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 6860 Joules per run. 20. Xeon 6766E: Approximate power consumption of 4320 Joules per run. 21. Xeon 6780E: Approximate power consumption of 5427 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 7756 Joules per run.
NWChem NWChem is an open-source high performance computational chemistry package. Per NWChem's documentation, "NWChem aims to provide its users with computational chemistry tools that are scalable both in their ability to treat large scientific computational chemistry problems efficiently, and in their use of available parallel computing resources from high-performance parallel supercomputers to conventional workstation clusters." Learn more via the OpenBenchmarking.org test page.
Kvazaar This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Very Fast Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 20 40 60 80 100 SE +/- 0.36, N = 5 SE +/- 0.04, N = 4 SE +/- 0.08, N = 4 SE +/- 0.45, N = 5 SE +/- 0.06, N = 4 SE +/- 0.33, N = 4 SE +/- 0.08, N = 4 SE +/- 0.29, N = 4 SE +/- 0.18, N = 4 SE +/- 0.06, N = 3 SE +/- 0.28, N = 6 SE +/- 0.32, N = 6 SE +/- 0.62, N = 6 SE +/- 0.71, N = 6 SE +/- 0.21, N = 5 SE +/- 0.63, N = 15 SE +/- 0.07, N = 5 SE +/- 0.07, N = 4 SE +/- 0.36, N = 15 SE +/- 0.04, N = 4 SE +/- 0.00, N = 4 SE +/- 0.50, N = 15 65.38 38.02 50.03 67.64 40.23 51.91 41.34 52.23 44.11 31.25 74.03 78.15 76.83 72.68 68.56 59.01 54.60 51.51 36.40 41.86 46.18 38.92 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt Frames Per Second Per Watt
OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Very Fast Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.1332 0.2664 0.3996 0.5328 0.666 0.175 0.183 0.212 0.156 0.162 0.109 0.163 0.109 0.129 0.152 0.219 0.359 0.406 0.241 0.470 0.249 0.507 0.592 0.213 0.449 0.429 0.210 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Kvazaar 2.2 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 110 220 330 440 550 Min: 73.01 / Avg: 374.34 / Max: 560.15 Min: 28.31 / Avg: 207.87 / Max: 283.73 Min: 60.42 / Avg: 235.64 / Max: 301.41 Min: 162.16 / Avg: 433.41 / Max: 581.27 Min: 74.97 / Avg: 248.42 / Max: 303.88 Min: 190.55 / Avg: 476.69 / Max: 591.36 Min: 71.86 / Avg: 253.88 / Max: 311.53 Min: 187.97 / Avg: 480.56 / Max: 609.82 Min: 100.56 / Avg: 342.63 / Max: 431.07 Min: 53.82 / Avg: 205.21 / Max: 244.22 Min: 66.01 / Avg: 338.64 / Max: 489.89 Min: 32 / Avg: 217.45 / Max: 322.84 Min: 28.16 / Avg: 189.32 / Max: 280.14 Min: 58.8 / Avg: 302.06 / Max: 438.45 Min: 21.76 / Avg: 145.81 / Max: 208.59 Min: 39.35 / Avg: 237.06 / Max: 332.11 Min: 17.32 / Avg: 107.72 / Max: 144.07 Min: 15.21 / Avg: 87.02 / Max: 118.81 Min: 104.11 / Avg: 170.72 / Max: 196.41 Min: 43.56 / Avg: 93.24 / Max: 111.07 Min: 43.47 / Avg: 107.62 / Max: 131.78 Min: 106.42 / Avg: 185.19 / Max: 224.67 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 5016 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 4157 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 3829 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 5721 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 4782 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 7508 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 4760 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 7449 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 6082 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 4788 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 4177 Joules per run. 12. EPYC 9684X: Approximate power consumption of 2573 Joules per run. 13. EPYC 9654: Approximate power consumption of 2272 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 3776 Joules per run. 15. EPYC 9754: Approximate power consumption of 1866 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 3414 Joules per run. 17. EPYC 8534P: Approximate power consumption of 1616 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1371 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 3528 Joules per run. 20. Xeon 6766E: Approximate power consumption of 1725 Joules per run. 21. Xeon 6780E: Approximate power consumption of 1830 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 3642 Joules per run.
GraphicsMagick This is a test of GraphicsMagick with its OpenMP implementation that performs various imaging tests on a sample high resolution (currently 15400 x 6940) JPEG image. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Swirl Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 150 300 450 600 750 SE +/- 0.58, N = 3 SE +/- 0.88, N = 3 SE +/- 1.15, N = 3 SE +/- 1.76, N = 3 SE +/- 0.58, N = 3 SE +/- 1.33, N = 3 SE +/- 0.67, N = 3 SE +/- 0.67, N = 3 SE +/- 4.41, N = 3 SE +/- 0.33, N = 3 SE +/- 0.67, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.88, N = 3 SE +/- 2.33, N = 3 SE +/- 4.91, N = 3 SE +/- 1.15, N = 3 SE +/- 3.00, N = 3 689 529 502 617 394 509 432 558 403 278 583 546 511 553 535 567 379 363 474 504 566 517 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp Iterations Per Minute Per Watt
OpenBenchmarking.org Iterations Per Minute Per Watt, More Is Better GraphicsMagick 1.3.43 Operation: Swirl Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.7398 1.4796 2.2194 2.9592 3.699 1.307 1.724 1.617 1.137 1.193 0.851 1.341 0.964 0.943 1.097 1.298 2.036 2.290 1.445 2.779 1.710 3.093 3.288 1.923 3.279 2.944 1.872 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better GraphicsMagick 1.3.43 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 110 220 330 440 550 Min: 80.88 / Avg: 527.29 / Max: 574.8 Min: 25.3 / Avg: 306.84 / Max: 336.43 Min: 59.04 / Avg: 310.53 / Max: 334.67 Min: 159.26 / Avg: 542.66 / Max: 585.44 Min: 72.86 / Avg: 330.14 / Max: 351.19 Min: 191.82 / Avg: 598.34 / Max: 636.3 Min: 70.83 / Avg: 322.19 / Max: 348.63 Min: 192.72 / Avg: 578.67 / Max: 624.15 Min: 104.89 / Avg: 427.21 / Max: 467.28 Min: 52.31 / Avg: 253.3 / Max: 271.57 Min: 62.97 / Avg: 449.12 / Max: 484.89 Min: 34.46 / Avg: 268.23 / Max: 288.18 Min: 30.38 / Avg: 223.17 / Max: 243.96 Min: 56.5 / Avg: 382.8 / Max: 426.76 Min: 21.51 / Avg: 192.51 / Max: 206.12 Min: 40.54 / Avg: 331.64 / Max: 362.33 Min: 18.54 / Avg: 122.54 / Max: 132.44 Min: 17.2 / Avg: 110.39 / Max: 118.71 Min: 104.8 / Avg: 246.46 / Max: 265.1 Min: 43.71 / Avg: 153.73 / Max: 166.75 Min: 43.48 / Avg: 192.24 / Max: 208.39 Min: 107.08 / Avg: 276.13 / Max: 303.23 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 33747 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 19638 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 19977 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 34911 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 21239 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 38094 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 20620 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 36842 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 27484 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16211 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 28444 Joules per run. 12. EPYC 9684X: Approximate power consumption of 17077 Joules per run. 13. EPYC 9654: Approximate power consumption of 14283 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 25137 Joules per run. 15. EPYC 9754: Approximate power consumption of 12257 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 21336 Joules per run. 17. EPYC 8534P: Approximate power consumption of 7802 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 7065 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 15773 Joules per run. 20. Xeon 6766E: Approximate power consumption of 9890 Joules per run. 21. Xeon 6780E: Approximate power consumption of 12367 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 17765 Joules per run.
Liquid-DSP LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 32 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 900M 1800M 2700M 3600M 4500M SE +/- 13813198.20, N = 3 SE +/- 2236316.42, N = 3 SE +/- 1858314.65, N = 3 SE +/- 26633124.74, N = 3 SE +/- 400000.00, N = 3 SE +/- 4598671.31, N = 3 SE +/- 1342054.81, N = 3 SE +/- 2403700.85, N = 3 SE +/- 3557152.42, N = 3 SE +/- 3178574.10, N = 3 SE +/- 4250882.26, N = 3 SE +/- 841295.30, N = 3 SE +/- 2714365.08, N = 3 SE +/- 3186603.90, N = 3 SE +/- 4056818.68, N = 3 SE +/- 384418.75, N = 3 SE +/- 3138116.92, N = 3 SE +/- 2003607.86, N = 3 SE +/- 3194265.70, N = 3 SE +/- 920748.49, N = 3 SE +/- 2023198.79, N = 3 SE +/- 517472.49, N = 3 3520766667 3148233333 3200600000 3558600000 2351900000 3254033333 2739633333 3337066667 3044700000 1797400000 4407900000 4353533333 4032733333 4063333333 3791566667 3794133333 3047066667 2767933333 3607900000 3671966667 4102200000 4021033333 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid samples/s Per Watt
OpenBenchmarking.org samples/s Per Watt, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 32 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 5M 10M 15M 20M 25M 6353287.78 10144782.58 10135010.79 6918246.02 8304651.14 5098423.00 8871933.76 5205818.86 6260399.40 7357841.69 8852490.97 11993608.96 14392112.20 9803609.24 15541749.24 10891038.63 21706213.46 23574098.60 14282136.05 20349128.58 17724724.88 13659351.74 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Liquid-DSP 1.6 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 75.15 / Avg: 554.16 / Max: 686.41 Min: 27.32 / Avg: 310.33 / Max: 359.1 Min: 62.65 / Avg: 315.8 / Max: 377.95 Min: 144.18 / Avg: 514.38 / Max: 660.61 Min: 74.4 / Avg: 283.2 / Max: 376.87 Min: 189.62 / Avg: 638.24 / Max: 714.51 Min: 80.13 / Avg: 308.8 / Max: 366.56 Min: 196.59 / Avg: 641.03 / Max: 736.11 Min: 104.18 / Avg: 486.34 / Max: 574.85 Min: 52.85 / Avg: 244.28 / Max: 291.62 Min: 66.83 / Avg: 497.93 / Max: 572.66 Min: 35.34 / Avg: 362.99 / Max: 409.42 Min: 28.95 / Avg: 280.2 / Max: 318.02 Min: 56.36 / Avg: 414.47 / Max: 483.6 Min: 21.67 / Avg: 243.96 / Max: 276.65 Min: 40.25 / Avg: 348.37 / Max: 393.82 Min: 16.53 / Avg: 140.38 / Max: 157.26 Min: 16.54 / Avg: 117.41 / Max: 138.28 Min: 104.22 / Avg: 252.62 / Max: 279.84 Min: 43.66 / Avg: 180.45 / Max: 204.69 Min: 43.44 / Avg: 231.44 / Max: 260.99 Min: 107.24 / Avg: 294.38 / Max: 328.07 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 19211 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 10655 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 10842 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 17660 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 9629 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 21913 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 10602 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 21795 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 16374 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 8387 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 16930 Joules per run. 12. EPYC 9684X: Approximate power consumption of 12463 Joules per run. 13. EPYC 9654: Approximate power consumption of 9527 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 14230 Joules per run. 15. EPYC 9754: Approximate power consumption of 8295 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 11961 Joules per run. 17. EPYC 8534P: Approximate power consumption of 4726 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 4031 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 8589 Joules per run. 20. Xeon 6766E: Approximate power consumption of 6195 Joules per run. 21. Xeon 6780E: Approximate power consumption of 7946 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 10107 Joules per run.
CloverLeaf CloverLeaf is a Lagrangian-Eulerian hydrodynamics benchmark. This test profile currently makes use of CloverLeaf's OpenMP version. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better CloverLeaf 1.3 Input: clover_bm16 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 110 220 330 440 550 SE +/- 2.02, N = 3 SE +/- 0.54, N = 3 SE +/- 0.13, N = 3 SE +/- 0.74, N = 3 SE +/- 1.43, N = 3 SE +/- 1.56, N = 3 SE +/- 2.03, N = 3 SE +/- 2.11, N = 9 SE +/- 3.41, N = 3 SE +/- 1.58, N = 3 SE +/- 0.59, N = 3 SE +/- 2.24, N = 3 SE +/- 3.79, N = 9 SE +/- 0.12, N = 3 SE +/- 4.99, N = 9 SE +/- 1.02, N = 3 SE +/- 0.79, N = 3 SE +/- 1.08, N = 3 SE +/- 1.60, N = 12 SE +/- 0.11, N = 3 SE +/- 0.00, N = 3 SE +/- 2.04, N = 3 378.05 410.59 328.47 214.80 351.29 263.33 357.57 269.20 295.30 512.36 223.54 245.82 334.30 266.10 400.52 349.67 495.25 498.22 226.60 314.88 313.50 236.81 1. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better CloverLeaf 1.3 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 76.61 / Avg: 524.03 / Max: 570.93 Min: 33.19 / Avg: 289.13 / Max: 310.83 Min: 57.58 / Avg: 346.05 / Max: 371.34 Min: 171.76 / Avg: 685.99 / Max: 712.37 Min: 71.71 / Avg: 345.92 / Max: 368.64 Min: 198.24 / Avg: 677.8 / Max: 709.86 Min: 75.8 / Avg: 346.15 / Max: 373.49 Min: 200.21 / Avg: 680.25 / Max: 711.02 Min: 105.53 / Avg: 529.36 / Max: 542.31 Min: 48.92 / Avg: 267.62 / Max: 276.86 Min: 66.27 / Avg: 538.72 / Max: 566.53 Min: 34.9 / Avg: 301.76 / Max: 361.01 Min: 28.5 / Avg: 250.17 / Max: 287.09 Min: 57.96 / Avg: 483.81 / Max: 500.79 Min: 19.15 / Avg: 200.7 / Max: 237.69 Min: 42.42 / Avg: 388.45 / Max: 400.3 Min: 18.26 / Avg: 143.82 / Max: 147.88 Min: 18.03 / Avg: 132.66 / Max: 136.36 Min: 105.62 / Avg: 440.67 / Max: 468.45 Min: 43.58 / Avg: 186.46 / Max: 191.98 Min: 43.52 / Avg: 205.96 / Max: 212.24 Min: 107.68 / Avg: 466.63 / Max: 492.37 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 200007 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 119603 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 114774 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 150460 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 122685 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 180972 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 124846 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 185480 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 158279 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 137915 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 121929 Joules per run. 12. EPYC 9684X: Approximate power consumption of 75239 Joules per run. 13. EPYC 9654: Approximate power consumption of 84308 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 129983 Joules per run. 15. EPYC 9754: Approximate power consumption of 80950 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 136735 Joules per run. 17. EPYC 8534P: Approximate power consumption of 71572 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 66418 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 101538 Joules per run. 20. Xeon 6766E: Approximate power consumption of 59418 Joules per run. 21. Xeon 6780E: Approximate power consumption of 65291 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 112457 Joules per run.
libavif avifenc This is a test of the AOMedia libavif library testing the encoding of a JPEG image to AV1 Image Format (AVIF). Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 0 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 30 60 90 120 150 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 SE +/- 0.32, N = 3 SE +/- 0.05, N = 3 SE +/- 0.15, N = 3 SE +/- 0.29, N = 3 SE +/- 0.22, N = 3 SE +/- 0.32, N = 3 SE +/- 0.18, N = 3 SE +/- 0.52, N = 3 SE +/- 0.01, N = 3 SE +/- 0.12, N = 3 SE +/- 0.01, N = 3 SE +/- 0.11, N = 3 SE +/- 0.13, N = 3 SE +/- 0.06, N = 3 SE +/- 0.19, N = 3 SE +/- 0.18, N = 3 SE +/- 0.22, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.18, N = 3 60.53 64.48 69.93 67.38 76.92 69.65 73.06 68.44 88.07 100.46 63.40 61.63 61.99 62.89 73.27 74.69 75.86 78.24 143.80 140.86 126.97 129.91 1. (CXX) g++ options: -O3 -fPIC -lm CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better libavif avifenc 1.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 77.6 / Avg: 391.09 / Max: 728.04 Min: 34.78 / Avg: 197.77 / Max: 373.2 Min: 61.27 / Avg: 218.41 / Max: 375.95 Min: 152.89 / Avg: 425.04 / Max: 708.08 Min: 75.95 / Avg: 254.61 / Max: 372.81 Min: 205.63 / Avg: 494.12 / Max: 704.89 Min: 69.59 / Avg: 253.47 / Max: 376.81 Min: 208.88 / Avg: 485.4 / Max: 727.55 Min: 96.24 / Avg: 285.14 / Max: 552.25 Min: 49.17 / Avg: 165.96 / Max: 290.88 Min: 62.98 / Avg: 324.3 / Max: 548.71 Min: 30.24 / Avg: 180.87 / Max: 389.03 Min: 29.48 / Avg: 156.52 / Max: 318.36 Min: 58.14 / Avg: 295.3 / Max: 499.26 Min: 19.55 / Avg: 121.7 / Max: 248.44 Min: 39.64 / Avg: 234.99 / Max: 370.06 Min: 17.01 / Avg: 85.23 / Max: 156.74 Min: 16.02 / Avg: 77.61 / Max: 131.52 Min: 104.01 / Avg: 131.11 / Max: 231.48 Min: 43.56 / Avg: 65.01 / Max: 148.96 Min: 43.39 / Avg: 72.37 / Max: 182.54 Min: 105.44 / Avg: 139.04 / Max: 263.97 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 25421 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 13646 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 16162 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 30462 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 20623 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 36071 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 19602 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 35111 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 26328 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 17371 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 21728 Joules per run. 12. EPYC 9684X: Approximate power consumption of 11817 Joules per run. 13. EPYC 9654: Approximate power consumption of 10383 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 19588 Joules per run. 15. EPYC 9754: Approximate power consumption of 9371 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 18486 Joules per run. 17. EPYC 8534P: Approximate power consumption of 6819 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 6364 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 19405 Joules per run. 20. Xeon 6766E: Approximate power consumption of 9404 Joules per run. 21. Xeon 6780E: Approximate power consumption of 9504 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 18631 Joules per run.
Result
OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 2 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 20 40 60 80 100 SE +/- 0.09, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.16, N = 3 SE +/- 0.21, N = 3 SE +/- 0.22, N = 3 SE +/- 0.31, N = 3 SE +/- 0.06, N = 3 SE +/- 0.25, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.43, N = 3 SE +/- 0.06, N = 3 SE +/- 0.13, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.07, N = 3 SE +/- 0.01, N = 3 SE +/- 0.41, N = 3 SE +/- 0.09, N = 3 33.65 34.79 37.75 37.31 41.13 38.65 39.88 38.14 47.51 52.23 35.32 34.04 34.15 35.40 40.35 41.92 41.66 42.61 79.20 76.47 69.34 71.97 1. (CXX) g++ options: -O3 -fPIC -lm CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better libavif avifenc 1.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 77.42 / Avg: 350.42 / Max: 724.52 Min: 34.19 / Avg: 161.32 / Max: 375.73 Min: 58.97 / Avg: 196.29 / Max: 374.92 Min: 149.52 / Avg: 390.93 / Max: 714.36 Min: 71.37 / Avg: 235.53 / Max: 369.9 Min: 207.34 / Avg: 461.85 / Max: 707.44 Min: 80.19 / Avg: 235.72 / Max: 375.98 Min: 195.24 / Avg: 458.52 / Max: 733.31 Min: 97.78 / Avg: 258.88 / Max: 544.31 Min: 50.37 / Avg: 150.68 / Max: 290.84 Min: 63.92 / Avg: 296.47 / Max: 540.97 Min: 32.31 / Avg: 157.68 / Max: 383.9 Min: 28.7 / Avg: 137.31 / Max: 316.42 Min: 57.84 / Avg: 267.46 / Max: 494.12 Min: 20.27 / Avg: 107.23 / Max: 247.8 Min: 39.83 / Avg: 217.6 / Max: 369.6 Min: 16.88 / Avg: 75.22 / Max: 155.11 Min: 14.11 / Avg: 69.45 / Max: 130.44 Min: 103.94 / Avg: 125.3 / Max: 229.12 Min: 43.58 / Avg: 59.56 / Max: 150.24 Min: 43.42 / Avg: 65.19 / Max: 183.13 Min: 105.72 / Avg: 131.77 / Max: 264.67 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 13316 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 6291 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 8244 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 16158 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 10678 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 19706 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 10371 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 19410 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 13289 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 8488 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 11661 Joules per run. 12. EPYC 9684X: Approximate power consumption of 6045 Joules per run. 13. EPYC 9654: Approximate power consumption of 5218 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 10520 Joules per run. 15. EPYC 9754: Approximate power consumption of 4754 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 9937 Joules per run. 17. EPYC 8534P: Approximate power consumption of 3460 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 3241 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 10442 Joules per run. 20. Xeon 6766E: Approximate power consumption of 4785 Joules per run. 21. Xeon 6780E: Approximate power consumption of 4781 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 10014 Joules per run.
SVT-AV1 This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 4 - Input: Bosphorus 4K Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 2 4 6 8 10 SE +/- 0.044, N = 3 SE +/- 0.005, N = 3 SE +/- 0.030, N = 3 SE +/- 0.049, N = 3 SE +/- 0.027, N = 3 SE +/- 0.015, N = 3 SE +/- 0.047, N = 3 SE +/- 0.042, N = 3 SE +/- 0.014, N = 3 SE +/- 0.014, N = 3 SE +/- 0.040, N = 3 SE +/- 0.021, N = 3 SE +/- 0.019, N = 3 SE +/- 0.046, N = 3 SE +/- 0.024, N = 3 SE +/- 0.004, N = 3 SE +/- 0.007, N = 3 SE +/- 0.015, N = 3 SE +/- 0.023, N = 3 SE +/- 0.002, N = 3 SE +/- 0.003, N = 3 SE +/- 0.041, N = 3 7.360 7.876 7.061 6.698 6.490 5.991 6.572 6.052 5.437 5.438 8.513 8.595 8.422 8.349 7.283 7.153 6.939 6.727 3.710 3.972 4.350 4.040 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq Frames Per Second Per Watt
OpenBenchmarking.org Frames Per Second Per Watt, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 4 - Input: Bosphorus 4K Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0205 0.041 0.0615 0.082 0.1025 0.022 0.040 0.034 0.018 0.027 0.013 0.027 0.013 0.021 0.031 0.029 0.054 0.060 0.032 0.067 0.033 0.084 0.091 0.027 0.056 0.055 0.028 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better SVT-AV1 2.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 110 220 330 440 550 Min: 78.08 / Avg: 333.26 / Max: 452.51 Min: 34.17 / Avg: 196.16 / Max: 355 Min: 59.43 / Avg: 204.79 / Max: 319.21 Min: 168.49 / Avg: 378.27 / Max: 506.21 Min: 73.83 / Avg: 242.37 / Max: 350.93 Min: 198.73 / Avg: 457.13 / Max: 618.95 Min: 73.14 / Avg: 245.81 / Max: 351.66 Min: 209.94 / Avg: 456.54 / Max: 621.56 Min: 97.29 / Avg: 264.19 / Max: 369.25 Min: 52.81 / Avg: 173.53 / Max: 276.87 Min: 64.63 / Avg: 294.39 / Max: 468.18 Min: 33.04 / Avg: 159.73 / Max: 314.08 Min: 26.67 / Avg: 140.24 / Max: 261.59 Min: 57.39 / Avg: 264.94 / Max: 394.93 Min: 20.56 / Avg: 108.62 / Max: 213.33 Min: 40.1 / Avg: 214.15 / Max: 316.2 Min: 16.63 / Avg: 82.61 / Max: 136.8 Min: 15.18 / Avg: 74.03 / Max: 115.16 Min: 104.17 / Avg: 135.78 / Max: 199.44 Min: 43.55 / Avg: 71.01 / Max: 131.44 Min: 43.43 / Avg: 78.63 / Max: 157.97 Min: 105.45 / Avg: 146.79 / Max: 227.06 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 9998 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 5362 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 6144 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 12105 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 7837 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 16457 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 7866 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 16587 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 9863 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 6363 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 7949 Joules per run. 12. EPYC 9684X: Approximate power consumption of 4260 Joules per run. 13. EPYC 9654: Approximate power consumption of 3787 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 7153 Joules per run. 15. EPYC 9754: Approximate power consumption of 3331 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 6639 Joules per run. 17. EPYC 8534P: Approximate power consumption of 2616 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 2418 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 7151 Joules per run. 20. Xeon 6766E: Approximate power consumption of 3456 Joules per run. 21. Xeon 6780E: Approximate power consumption of 3539 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 7144 Joules per run.
uvg266 uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Very Fast Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 14 28 42 56 70 SE +/- 0.16, N = 5 SE +/- 0.08, N = 3 SE +/- 0.01, N = 4 SE +/- 0.50, N = 5 SE +/- 0.12, N = 4 SE +/- 0.39, N = 4 SE +/- 0.02, N = 4 SE +/- 0.38, N = 9 SE +/- 0.18, N = 4 SE +/- 0.06, N = 3 SE +/- 0.12, N = 5 SE +/- 0.13, N = 5 SE +/- 0.13, N = 5 SE +/- 0.55, N = 5 SE +/- 0.18, N = 5 SE +/- 0.43, N = 15 SE +/- 0.08, N = 4 SE +/- 0.06, N = 4 SE +/- 0.34, N = 15 SE +/- 0.01, N = 4 SE +/- 0.06, N = 4 SE +/- 0.43, N = 15 53.66 35.10 49.42 54.88 39.56 44.75 40.82 46.25 40.69 30.17 55.05 62.70 62.02 53.44 54.46 46.00 50.04 44.92 27.33 40.73 44.44 28.43 Frames Per Second Per Watt
OpenBenchmarking.org Frames Per Second Per Watt, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Very Fast Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.1087 0.2174 0.3261 0.4348 0.5435 0.132 0.160 0.193 0.121 0.147 0.090 0.150 0.092 0.110 0.138 0.154 0.269 0.310 0.167 0.346 0.185 0.445 0.483 0.157 0.389 0.369 0.152 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better uvg266 0.4.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 110 220 330 440 550 Min: 77.02 / Avg: 407.69 / Max: 581.55 Min: 27.1 / Avg: 218.83 / Max: 315.11 Min: 59.83 / Avg: 256.47 / Max: 330.75 Min: 161.1 / Avg: 454.5 / Max: 579.21 Min: 76.83 / Avg: 268.38 / Max: 326.31 Min: 193.43 / Avg: 495.22 / Max: 603.09 Min: 73.99 / Avg: 272.27 / Max: 334.62 Min: 191.29 / Avg: 503.31 / Max: 608.25 Min: 103.41 / Avg: 370.67 / Max: 458.86 Min: 53.16 / Avg: 217.91 / Max: 258.49 Min: 57.76 / Avg: 357.6 / Max: 478.64 Min: 33.4 / Avg: 232.88 / Max: 324.16 Min: 28.57 / Avg: 200.36 / Max: 279.14 Min: 52.01 / Avg: 320.69 / Max: 430.96 Min: 18.78 / Avg: 157.17 / Max: 216.69 Min: 39.54 / Avg: 249.19 / Max: 335.92 Min: 17.76 / Avg: 112.52 / Max: 149.73 Min: 17.16 / Avg: 92.93 / Max: 127.1 Min: 104.1 / Avg: 174.26 / Max: 196.44 Min: 43.61 / Avg: 104.71 / Max: 124.97 Min: 43.47 / Avg: 120.53 / Max: 150.37 Min: 106.09 / Avg: 187.3 / Max: 229.82 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 6360 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 4741 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 4232 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 7090 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 5166 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 8790 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 5105 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 8556 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 6857 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 5303 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 5435 Joules per run. 12. EPYC 9684X: Approximate power consumption of 3214 Joules per run. 13. EPYC 9654: Approximate power consumption of 2725 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 5003 Joules per run. 15. EPYC 9754: Approximate power consumption of 2358 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 4303 Joules per run. 17. EPYC 8534P: Approximate power consumption of 1828 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1650 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 4577 Joules per run. 20. Xeon 6766E: Approximate power consumption of 1963 Joules per run. 21. Xeon 6780E: Approximate power consumption of 2139 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 4757 Joules per run.
ASKAP ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Million Grid Points Per Second, More Is Better ASKAP 1.0 Test: tConvolve MT - Degridding Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 4K 8K 12K 16K 20K SE +/- 322.56, N = 3 SE +/- 3.76, N = 3 SE +/- 889.21, N = 3 SE +/- 212.00, N = 12 SE +/- 128.32, N = 3 SE +/- 267.65, N = 5 SE +/- 25.80, N = 3 SE +/- 345.37, N = 3 SE +/- 34.17, N = 3 SE +/- 0.54, N = 3 9893.32 7425.22 16906.20 14143.10 14217.10 11941.30 9839.64 13455.00 7382.43 7421.23 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp Million Grid Points Per Second Per Watt
OpenBenchmarking.org Million Grid Points Per Second Per Watt, More Is Better ASKAP 1.0 Test: tConvolve MT - Degridding Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 20 40 60 80 100 30.49 40.39 46.19 76.92 89.45 36.68 76.56 50.18 79.95 85.73 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ASKAP 1.0 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 120 240 360 480 600 Min: 103.44 / Avg: 324.5 / Max: 557.49 Min: 52.13 / Avg: 183.83 / Max: 281.05 Min: 66.87 / Avg: 365.98 / Max: 703.86 Min: 33.59 / Avg: 183.88 / Max: 366.01 Min: 28.79 / Avg: 158.94 / Max: 298.53 Min: 56.13 / Avg: 325.56 / Max: 537.83 Min: 22.06 / Avg: 128.52 / Max: 260.19 Min: 41.03 / Avg: 268.12 / Max: 506.15 Min: 18.79 / Avg: 92.34 / Max: 148.64 Min: 16.96 / Avg: 86.56 / Max: 131.98 1. Xeon Platinum 8380 2P: Approximate power consumption of 84478 Joules per run. 2. Xeon Platinum 8380: Approximate power consumption of 25614 Joules per run. 3. EPYC 9684X 2P: Approximate power consumption of 150783 Joules per run. 4. EPYC 9684X: Approximate power consumption of 38813 Joules per run. 5. EPYC 9654: Approximate power consumption of 34597 Joules per run. 6. EPYC 9654 2P: Approximate power consumption of 144095 Joules per run. 7. EPYC 9754: Approximate power consumption of 44082 Joules per run. 8. EPYC 9754 2P: Approximate power consumption of 176601 Joules per run. 9. EPYC 8534P: Approximate power consumption of 20068 Joules per run. 10. EPYC 8534PN: Approximate power consumption of 18755 Joules per run.
TensorFlow This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: GoogLeNet Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 80 160 240 320 400 SE +/- 0.21, N = 3 SE +/- 1.12, N = 3 SE +/- 1.62, N = 3 SE +/- 2.37, N = 3 SE +/- 1.94, N = 3 SE +/- 3.52, N = 5 SE +/- 0.83, N = 3 SE +/- 2.38, N = 3 SE +/- 1.42, N = 3 SE +/- 0.49, N = 3 SE +/- 2.47, N = 3 SE +/- 1.66, N = 3 SE +/- 4.22, N = 3 SE +/- 2.41, N = 3 SE +/- 3.84, N = 4 SE +/- 1.18, N = 3 SE +/- 0.30, N = 3 SE +/- 0.44, N = 3 SE +/- 2.29, N = 3 SE +/- 0.29, N = 3 SE +/- 0.64, N = 3 SE +/- 0.21, N = 3 291.37 319.76 380.14 331.76 333.73 341.51 335.58 308.95 347.72 282.50 248.03 330.26 354.59 227.22 314.67 176.00 276.93 256.79 168.10 214.14 232.51 190.80 images/sec Per Watt
OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: GoogLeNet Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.5164 1.0328 1.5492 2.0656 2.582 0.683 1.411 1.378 0.633 1.142 0.606 1.153 0.553 0.853 1.261 0.503 1.274 1.568 0.513 1.603 0.502 2.169 2.295 0.550 1.360 1.240 0.565 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.16.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 Min: 83.13 / Avg: 426.33 / Max: 534.67 Min: 33.87 / Avg: 226.63 / Max: 286.57 Min: 60.91 / Avg: 275.93 / Max: 349.1 Min: 157.05 / Avg: 524.23 / Max: 643.88 Min: 77.16 / Avg: 292.25 / Max: 352.1 Min: 207.32 / Avg: 563.45 / Max: 671.04 Min: 76.86 / Avg: 291.07 / Max: 351.95 Min: 188.75 / Avg: 558.65 / Max: 667.23 Min: 98.08 / Avg: 407.6 / Max: 516.03 Min: 52.71 / Avg: 224.1 / Max: 274.4 Min: 65.57 / Avg: 493.46 / Max: 594.88 Min: 33.26 / Avg: 259.15 / Max: 327.64 Min: 26.86 / Avg: 226.08 / Max: 291.32 Min: 60.41 / Avg: 443.22 / Max: 530.84 Min: 21.15 / Avg: 196.33 / Max: 257.11 Min: 41.18 / Avg: 350.5 / Max: 413.71 Min: 19.2 / Avg: 127.66 / Max: 158.33 Min: 17.15 / Avg: 111.89 / Max: 138.4 Min: 104.39 / Avg: 305.84 / Max: 369.61 Min: 43.67 / Avg: 157.46 / Max: 196.46 Min: 43.56 / Avg: 187.52 / Max: 236.56 Min: 105.79 / Avg: 337.98 / Max: 420.56 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 13785 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 6648 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 7266 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 15552 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 8378 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 16227 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 8247 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 17318 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 11549 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 7395 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 17929 Joules per run. 12. EPYC 9684X: Approximate power consumption of 7515 Joules per run. 13. EPYC 9654: Approximate power consumption of 6179 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 17433 Joules per run. 15. EPYC 9754: Approximate power consumption of 6086 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 17408 Joules per run. 17. EPYC 8534P: Approximate power consumption of 4340 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 3991 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 16006 Joules per run. 20. Xeon 6766E: Approximate power consumption of 6666 Joules per run. 21. Xeon 6780E: Approximate power consumption of 7376 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 15885 Joules per run.
Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: AlexNet Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 200 400 600 800 1000 SE +/- 2.22, N = 5 SE +/- 6.22, N = 5 SE +/- 0.51, N = 5 SE +/- 7.98, N = 5 SE +/- 1.95, N = 5 SE +/- 6.39, N = 13 SE +/- 2.31, N = 5 SE +/- 7.35, N = 5 SE +/- 3.70, N = 5 SE +/- 0.27, N = 4 SE +/- 7.66, N = 5 SE +/- 1.37, N = 5 SE +/- 1.31, N = 5 SE +/- 8.87, N = 4 SE +/- 2.99, N = 5 SE +/- 7.43, N = 15 SE +/- 0.45, N = 4 SE +/- 0.16, N = 4 SE +/- 5.44, N = 15 SE +/- 0.70, N = 3 SE +/- 0.97, N = 3 SE +/- 5.91, N = 15 858.84 819.89 969.62 996.47 841.68 932.59 852.36 940.40 904.36 690.09 738.31 868.54 942.19 727.77 924.80 658.97 673.42 617.03 464.80 443.74 482.06 520.01 images/sec Per Watt
OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: AlexNet Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 2 4 6 8 10 2.404 4.145 4.375 2.269 3.341 1.898 3.374 1.919 2.677 3.481 1.857 4.332 5.439 2.065 6.238 2.236 6.508 6.664 1.740 3.355 3.051 1.794 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.16.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 Min: 76.02 / Avg: 357.25 / Max: 522.13 Min: 33.53 / Avg: 197.79 / Max: 292.33 Min: 58.85 / Avg: 221.64 / Max: 332.07 Min: 156.12 / Avg: 439.21 / Max: 636.86 Min: 72.44 / Avg: 251.93 / Max: 351.73 Min: 196.31 / Avg: 491.23 / Max: 676.71 Min: 75.5 / Avg: 252.6 / Max: 351.73 Min: 186.67 / Avg: 489.99 / Max: 671.14 Min: 99.68 / Avg: 337.77 / Max: 509.02 Min: 53.17 / Avg: 198.24 / Max: 276.92 Min: 64.28 / Avg: 397.64 / Max: 581.36 Min: 32.91 / Avg: 200.48 / Max: 302.35 Min: 27.88 / Avg: 173.22 / Max: 270.57 Min: 59.14 / Avg: 352.38 / Max: 512.39 Min: 21.07 / Avg: 148.26 / Max: 241.29 Min: 40.23 / Avg: 294.77 / Max: 430.69 Min: 17.62 / Avg: 103.47 / Max: 147.02 Min: 15.55 / Avg: 92.59 / Max: 128.11 Min: 104.81 / Avg: 267.11 / Max: 360.8 Min: 43.64 / Avg: 132.25 / Max: 173.77 Min: 43.45 / Avg: 158.02 / Max: 214.1 Min: 107.28 / Avg: 289.41 / Max: 402.43 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 5216 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 2888 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 2970 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 6061 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 3678 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 6839 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 3688 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 6860 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 4864 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 3271 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 6442 Joules per run. 12. EPYC 9684X: Approximate power consumption of 2847 Joules per run. 13. EPYC 9654: Approximate power consumption of 2390 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 5726 Joules per run. 15. EPYC 9754: Approximate power consumption of 2165 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 5267 Joules per run. 17. EPYC 8534P: Approximate power consumption of 1785 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1690 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 6090 Joules per run. 20. Xeon 6766E: Approximate power consumption of 3042 Joules per run. 21. Xeon 6780E: Approximate power consumption of 3371 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 6078 Joules per run.
Y-Cruncher Y-Cruncher is a multi-threaded Pi benchmark capable of computing Pi to trillions of digits. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Y-Cruncher 0.8.3 Pi Digits To Calculate: 1B Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 3 6 9 12 15 SE +/- 0.010, N = 6 SE +/- 0.030, N = 5 SE +/- 0.005, N = 5 SE +/- 0.007, N = 6 SE +/- 0.045, N = 5 SE +/- 0.122, N = 15 SE +/- 0.026, N = 5 SE +/- 0.142, N = 12 SE +/- 0.010, N = 5 SE +/- 0.011, N = 4 SE +/- 0.012, N = 4 SE +/- 0.008, N = 4 SE +/- 0.008, N = 5 SE +/- 0.012, N = 4 SE +/- 0.007, N = 4 SE +/- 0.049, N = 4 SE +/- 0.005, N = 4 SE +/- 0.001, N = 4 SE +/- 0.007, N = 4 SE +/- 0.018, N = 4 SE +/- 0.020, N = 4 SE +/- 0.002, N = 4 5.110 6.701 7.047 5.008 8.300 6.334 7.959 6.266 7.744 10.712 8.992 7.471 6.743 8.196 6.928 7.915 10.205 10.427 7.967 11.198 10.386 7.468 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Y-Cruncher 0.8.3 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 76.49 / Avg: 362.82 / Max: 745.4 Min: 32.02 / Avg: 198.74 / Max: 364.57 Min: 30.38 / Avg: 222.94 / Max: 366.15 Min: 166.8 / Avg: 424.33 / Max: 738.75 Min: 76.02 / Avg: 255.33 / Max: 373.96 Min: 191.23 / Avg: 496.54 / Max: 748.22 Min: 73.1 / Avg: 254.54 / Max: 371.3 Min: 193.6 / Avg: 493.66 / Max: 748.88 Min: 98.98 / Avg: 352.71 / Max: 555.83 Min: 53.53 / Avg: 195.15 / Max: 284.61 Min: 66.34 / Avg: 404.17 / Max: 643.66 Min: 32.32 / Avg: 212.59 / Max: 399.38 Min: 28.49 / Avg: 178.56 / Max: 342.72 Min: 58.9 / Avg: 351.79 / Max: 591.63 Min: 21.57 / Avg: 148.59 / Max: 323.95 Min: 40.66 / Avg: 284.7 / Max: 529.69 Min: 16.07 / Avg: 105.12 / Max: 171.94 Min: 16.4 / Avg: 94.34 / Max: 147.45 Min: 104.12 / Avg: 272.77 / Max: 508.32 Min: 43.6 / Avg: 141.11 / Max: 252.27 Min: 43.37 / Avg: 168.68 / Max: 308.71 Min: 105.25 / Avg: 293.09 / Max: 598.55 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 4535 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 2584 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 3121 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 5587 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 3626 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 6720 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 3564 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 6747 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 5220 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 3415 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 7275 Joules per run. 12. EPYC 9684X: Approximate power consumption of 3295 Joules per run. 13. EPYC 9654: Approximate power consumption of 2714 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 5980 Joules per run. 15. EPYC 9754: Approximate power consumption of 2489 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 5409 Joules per run. 17. EPYC 8534P: Approximate power consumption of 1971 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1793 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 4569 Joules per run. 20. Xeon 6766E: Approximate power consumption of 2646 Joules per run. 21. Xeon 6780E: Approximate power consumption of 2952 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 4836 Joules per run.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Y-Cruncher 0.8.3 Pi Digits To Calculate: 500M Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 1.1648 2.3296 3.4944 4.6592 5.824 SE +/- 0.004, N = 7 SE +/- 0.008, N = 7 SE +/- 0.003, N = 7 SE +/- 0.002, N = 8 SE +/- 0.010, N = 7 SE +/- 0.064, N = 15 SE +/- 0.023, N = 15 SE +/- 0.074, N = 15 SE +/- 0.006, N = 7 SE +/- 0.003, N = 6 SE +/- 0.007, N = 5 SE +/- 0.003, N = 6 SE +/- 0.003, N = 6 SE +/- 0.003, N = 5 SE +/- 0.005, N = 6 SE +/- 0.015, N = 5 SE +/- 0.006, N = 6 SE +/- 0.008, N = 6 SE +/- 0.004, N = 6 SE +/- 0.005, N = 6 SE +/- 0.007, N = 6 SE +/- 0.004, N = 6 2.659 3.391 3.267 2.364 3.781 3.110 3.704 2.961 3.724 4.874 4.510 4.312 3.850 4.329 3.968 4.100 5.077 5.165 3.629 5.177 4.770 3.411 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Y-Cruncher 0.8.3 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 81.75 / Avg: 285.35 / Max: 686.94 Min: 31.93 / Avg: 151.06 / Max: 346.25 Min: 57.55 / Avg: 181.21 / Max: 363.23 Min: 164.95 / Avg: 367.73 / Max: 733.59 Min: 74.95 / Avg: 212.09 / Max: 370.6 Min: 197.01 / Avg: 434.63 / Max: 747.05 Min: 70.98 / Avg: 211.16 / Max: 373.06 Min: 189.46 / Avg: 425.51 / Max: 749.34 Min: 97.45 / Avg: 293.71 / Max: 562.12 Min: 52.29 / Avg: 167.23 / Max: 285.41 Min: 66.18 / Avg: 327.67 / Max: 622.14 Min: 32.78 / Avg: 173.58 / Max: 352.72 Min: 27.89 / Avg: 146.25 / Max: 317.02 Min: 53.19 / Avg: 293.51 / Max: 558.3 Min: 20.76 / Avg: 118.84 / Max: 272.84 Min: 37.77 / Avg: 238.41 / Max: 478.35 Min: 16.15 / Avg: 86.13 / Max: 163.32 Min: 16.77 / Avg: 78.49 / Max: 143.84 Min: 104.3 / Avg: 221.86 / Max: 497.5 Min: 43.7 / Avg: 116.04 / Max: 224.06 Min: 43.46 / Avg: 134.29 / Max: 274.09 Min: 106.12 / Avg: 236.59 / Max: 561.92 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 2650 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 1360 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 1631 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 3264 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 1939 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 4143 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 1914 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 4085 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 2853 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 1756 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 4063 Joules per run. 12. EPYC 9684X: Approximate power consumption of 1996 Joules per run. 13. EPYC 9654: Approximate power consumption of 1584 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 3698 Joules per run. 15. EPYC 9754: Approximate power consumption of 1466 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 3385 Joules per run. 17. EPYC 8534P: Approximate power consumption of 1062 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 942 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 2514 Joules per run. 20. Xeon 6766E: Approximate power consumption of 1334 Joules per run. 21. Xeon 6780E: Approximate power consumption of 1477 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 2642 Joules per run.
Liquid-DSP LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 57 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 16M 32M 48M 64M 80M SE +/- 68119.99, N = 3 SE +/- 599433.09, N = 9 SE +/- 666.67, N = 3 SE +/- 3844.19, N = 3 SE +/- 4910.31, N = 3 SE +/- 4163.33, N = 3 SE +/- 5364.49, N = 3 SE +/- 822374.71, N = 4 SE +/- 178712.37, N = 3 SE +/- 15982.63, N = 3 SE +/- 34724.31, N = 3 SE +/- 7423.69, N = 3 SE +/- 12719.19, N = 3 SE +/- 486361.09, N = 3 SE +/- 7937.25, N = 3 SE +/- 8089.77, N = 3 SE +/- 4807.40, N = 3 SE +/- 393224.42, N = 3 SE +/- 2185.81, N = 3 SE +/- 20835.33, N = 3 SE +/- 5206.83, N = 3 SE +/- 11392.00, N = 3 70499000 73140667 67074667 66991333 67130333 67064000 67127667 66266000 53930333 54089667 55415667 55455333 55425333 54954667 46270000 46229667 46210667 45486333 33439333 33444667 37195667 37121333 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid samples/s Per Watt
OpenBenchmarking.org samples/s Per Watt, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 57 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 200K 400K 600K 800K 1000K 310526.31 859261.41 741692.03 287557.79 575880.01 243752.92 539196.73 235014.31 295293.25 572291.34 229312.07 529757.56 604481.01 250729.15 633663.71 256852.19 919805.49 924272.74 315271.07 764093.38 845147.04 344751.30 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Liquid-DSP 1.6 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 60 120 180 240 300 Min: 79.82 / Avg: 227.03 / Max: 288.68 Min: 33.42 / Avg: 85.12 / Max: 133.8 Min: 62.53 / Avg: 90.43 / Max: 122.85 Min: 162.53 / Avg: 232.97 / Max: 292.63 Min: 75.77 / Avg: 116.57 / Max: 125.17 Min: 206.29 / Avg: 275.13 / Max: 324.32 Min: 84.47 / Avg: 124.5 / Max: 135.18 Min: 203.12 / Avg: 281.97 / Max: 319.46 Min: 97.63 / Avg: 182.63 / Max: 203.03 Min: 50.3 / Avg: 94.51 / Max: 101.21 Min: 64.49 / Avg: 241.66 / Max: 264.36 Min: 31.94 / Avg: 104.68 / Max: 114.13 Min: 26.34 / Avg: 91.69 / Max: 100.53 Min: 56.89 / Avg: 219.18 / Max: 239.46 Min: 21.28 / Avg: 73.02 / Max: 80.63 Min: 40.07 / Avg: 179.99 / Max: 198.16 Min: 17.35 / Avg: 50.24 / Max: 54.91 Min: 16 / Avg: 49.21 / Max: 54.17 Min: 103.81 / Avg: 106.07 / Max: 107.92 Min: 43.57 / Avg: 43.77 / Max: 45.58 Min: 43.3 / Avg: 44.01 / Max: 45.17 Min: 104.74 / Avg: 107.68 / Max: 108.89 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 7795 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 2904 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 3105 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 7999 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 4002 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 9446 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 4233 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 9587 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 6210 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 3213 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 8216 Joules per run. 12. EPYC 9684X: Approximate power consumption of 3559 Joules per run. 13. EPYC 9654: Approximate power consumption of 3148 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 7379 Joules per run. 15. EPYC 9754: Approximate power consumption of 2483 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 6120 Joules per run. 17. EPYC 8534P: Approximate power consumption of 1708 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1690 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 3642 Joules per run. 20. Xeon 6766E: Approximate power consumption of 1488 Joules per run. 21. Xeon 6780E: Approximate power consumption of 1496 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 3661 Joules per run.
Timed Linux Kernel Compilation This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.8 Build: defconfig Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 13 26 39 52 65 SE +/- 0.23, N = 7 SE +/- 0.39, N = 4 SE +/- 0.55, N = 3 SE +/- 0.43, N = 3 SE +/- 0.59, N = 3 SE +/- 0.40, N = 4 SE +/- 0.57, N = 3 SE +/- 0.31, N = 5 SE +/- 0.42, N = 5 SE +/- 0.33, N = 3 SE +/- 0.17, N = 13 SE +/- 0.46, N = 3 SE +/- 0.43, N = 3 SE +/- 0.33, N = 3 SE +/- 0.44, N = 3 SE +/- 0.28, N = 7 SE +/- 0.50, N = 4 SE +/- 0.54, N = 4 SE +/- 0.22, N = 14 SE +/- 0.39, N = 6 SE +/- 0.37, N = 6 SE +/- 0.28, N = 8 25.87 34.59 39.45 29.98 43.42 32.14 40.50 30.53 39.41 55.74 25.87 32.89 34.57 27.68 38.53 30.68 44.28 46.35 35.55 41.10 37.64 32.66 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Timed Linux Kernel Compilation 6.8 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 73.91 / Avg: 384.63 / Max: 756.99 Min: 26.35 / Avg: 214.95 / Max: 377.53 Min: 60.49 / Avg: 234.11 / Max: 377.45 Min: 150.36 / Avg: 425.97 / Max: 755.88 Min: 73.73 / Avg: 265.23 / Max: 376.52 Min: 189.61 / Avg: 492.26 / Max: 752.95 Min: 69.92 / Avg: 260.34 / Max: 376.76 Min: 176.87 / Avg: 486.28 / Max: 754.8 Min: 98.92 / Avg: 340.2 / Max: 582.62 Min: 48.64 / Avg: 197.71 / Max: 290.64 Min: 62.86 / Avg: 375.56 / Max: 824.56 Min: 32.62 / Avg: 210.93 / Max: 409.9 Min: 27.91 / Avg: 175.53 / Max: 322.12 Min: 52.83 / Avg: 317.6 / Max: 662.66 Min: 20.78 / Avg: 155.1 / Max: 328.08 Min: 38.17 / Avg: 283.46 / Max: 659.24 Min: 16.1 / Avg: 97.22 / Max: 163.42 Min: 14.06 / Avg: 87.28 / Max: 138.54 Min: 104.46 / Avg: 183.63 / Max: 516.23 Min: 43.51 / Avg: 106.04 / Max: 250.64 Min: 21.97 / Avg: 123.43 / Max: 312.29 Min: 106.91 / Avg: 202.81 / Max: 628.9 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 13242 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 9512 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 11862 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 17891 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 14234 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 20552 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 13277 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 19257 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 16602 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 13181 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 12885 Joules per run. 12. EPYC 9684X: Approximate power consumption of 9422 Joules per run. 13. EPYC 9654: Approximate power consumption of 8133 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 12916 Joules per run. 15. EPYC 9754: Approximate power consumption of 8065 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 11824 Joules per run. 17. EPYC 8534P: Approximate power consumption of 5420 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 5041 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 8224 Joules per run. 20. Xeon 6766E: Approximate power consumption of 5461 Joules per run. 21. Xeon 6780E: Approximate power consumption of 5863 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 8645 Joules per run.
OpenRadioss OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: Cell Phone Drop Test Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 10 20 30 40 50 SE +/- 0.32, N = 3 SE +/- 0.18, N = 3 SE +/- 0.08, N = 3 SE +/- 0.10, N = 3 SE +/- 0.08, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.21, N = 3 SE +/- 0.05, N = 3 SE +/- 0.19, N = 3 SE +/- 0.26, N = 3 SE +/- 0.05, N = 3 SE +/- 0.26, N = 3 SE +/- 0.05, N = 3 SE +/- 0.18, N = 3 SE +/- 0.35, N = 3 26.88 27.90 31.49 28.22 33.75 27.51 31.92 27.63 31.17 43.45 22.52 20.45 22.53 23.53 23.69 27.86 33.23 35.95 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OpenRadioss 2023.09.15 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 140 280 420 560 700 Min: 71.17 / Avg: 504.55 / Max: 754.24 Min: 34.28 / Avg: 272.03 / Max: 374.83 Min: 59.2 / Avg: 289.5 / Max: 374.11 Min: 172.03 / Avg: 545.45 / Max: 745.98 Min: 76.63 / Avg: 302.43 / Max: 377 Min: 199.37 / Avg: 570.84 / Max: 753.68 Min: 77.53 / Avg: 297.92 / Max: 375.01 Min: 206.26 / Avg: 572.24 / Max: 749.99 Min: 97.57 / Avg: 424.07 / Max: 583.23 Min: 52.02 / Avg: 232.77 / Max: 290.08 Min: 60.04 / Avg: 493.1 / Max: 819.11 Min: 33.62 / Avg: 276.69 / Max: 409.57 Min: 30.24 / Avg: 238.37 / Max: 343.81 Min: 58.09 / Avg: 439.02 / Max: 706.97 Min: 19.86 / Avg: 210.23 / Max: 333.55 Min: 41.04 / Avg: 357.25 / Max: 670.96 Min: 19.07 / Avg: 127.55 / Max: 161.94 Min: 18.07 / Avg: 113.05 / Max: 140.62 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 20687 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 10519 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 12159 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 23455 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 13105 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 22834 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 12612 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 23653 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 18942 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 12570 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 21697 Joules per run. 12. EPYC 9684X: Approximate power consumption of 9407 Joules per run. 13. EPYC 9654: Approximate power consumption of 8661 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 19609 Joules per run. 15. EPYC 9754: Approximate power consumption of 8760 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 21316 Joules per run. 17. EPYC 8534P: Approximate power consumption of 5867 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 5577 Joules per run.
TensorFlow This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: GoogLeNet Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 SE +/- 1.52, N = 3 SE +/- 3.68, N = 3 SE +/- 0.34, N = 3 SE +/- 2.62, N = 3 SE +/- 0.41, N = 3 SE +/- 1.14, N = 3 SE +/- 0.37, N = 3 SE +/- 2.46, N = 3 SE +/- 0.25, N = 3 SE +/- 0.12, N = 3 SE +/- 1.60, N = 3 SE +/- 3.05, N = 12 SE +/- 4.02, N = 10 SE +/- 5.11, N = 3 SE +/- 12.03, N = 12 SE +/- 5.63, N = 6 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 1.19, N = 3 SE +/- 0.26, N = 3 SE +/- 0.19, N = 3 SE +/- 1.26, N = 3 577.76 462.78 461.23 576.08 383.57 467.91 398.40 477.33 411.05 290.16 464.78 425.25 470.95 525.84 450.61 588.43 313.50 295.29 354.81 278.05 298.16 378.79 images/sec Per Watt
OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: GoogLeNet Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.5085 1.017 1.5255 2.034 2.5425 0.974 1.511 1.378 0.871 1.137 0.696 1.180 0.710 0.813 1.110 0.747 1.293 1.646 0.960 1.824 1.245 2.098 2.260 0.781 1.298 1.140 0.734 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.16.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 81.09 / Avg: 593.47 / Max: 647.85 Min: 35.37 / Avg: 306.26 / Max: 336.64 Min: 62.15 / Avg: 334.67 / Max: 366.71 Min: 163.66 / Avg: 661.11 / Max: 719.14 Min: 73.74 / Avg: 337.25 / Max: 358.42 Min: 205.47 / Avg: 671.88 / Max: 722 Min: 83.34 / Avg: 337.62 / Max: 362.35 Min: 204.77 / Avg: 672.55 / Max: 725.44 Min: 104.77 / Avg: 505.8 / Max: 538.69 Min: 52.49 / Avg: 261.52 / Max: 277.08 Min: 65.4 / Avg: 622.34 / Max: 677.73 Min: 33.11 / Avg: 328.89 / Max: 367.06 Min: 16.07 / Avg: 286.15 / Max: 318.45 Min: 60.16 / Avg: 547.94 / Max: 597.52 Min: 19.9 / Avg: 247.07 / Max: 298.24 Min: 41.61 / Avg: 472.75 / Max: 541.37 Min: 18.68 / Avg: 149.41 / Max: 158.78 Min: 16.37 / Avg: 130.65 / Max: 139.18 Min: 106.15 / Avg: 454.45 / Max: 503.93 Min: 43.64 / Avg: 214.28 / Max: 238.23 Min: 43.63 / Avg: 261.65 / Max: 298.46 Min: 109.13 / Avg: 515.79 / Max: 577.43 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 63700 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 39814 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 43618 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 71179 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 52499 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 87568 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 50530 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 86087 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 73846 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 52827 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 80904 Joules per run. 12. EPYC 9684X: Approximate power consumption of 45661 Joules per run. 13. EPYC 9654: Approximate power consumption of 36198 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 63379 Joules per run. 15. EPYC 9754: Approximate power consumption of 32675 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 50820 Joules per run. 17. EPYC 8534P: Approximate power consumption of 28138 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 26131 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 78620 Joules per run. 20. Xeon 6766E: Approximate power consumption of 45571 Joules per run. 21. Xeon 6780E: Approximate power consumption of 52068 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 83558 Joules per run.
Numpy Benchmark This is a test to obtain the general Numpy performance. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Score, More Is Better Numpy Benchmark Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 SE +/- 1.42, N = 3 SE +/- 1.84, N = 3 SE +/- 0.33, N = 3 SE +/- 0.26, N = 3 SE +/- 0.60, N = 3 SE +/- 1.13, N = 3 SE +/- 0.79, N = 3 SE +/- 1.30, N = 3 SE +/- 1.52, N = 3 SE +/- 2.23, N = 3 SE +/- 0.60, N = 3 SE +/- 1.85, N = 3 SE +/- 2.28, N = 3 SE +/- 0.38, N = 3 SE +/- 0.96, N = 3 SE +/- 0.25, N = 3 SE +/- 0.72, N = 3 SE +/- 1.34, N = 3 SE +/- 0.30, N = 3 SE +/- 0.37, N = 3 SE +/- 2.24, N = 3 SE +/- 0.47, N = 3 519.89 520.22 455.57 456.18 461.61 435.21 464.72 439.84 394.71 400.64 540.96 542.15 529.80 529.03 425.46 422.76 421.99 418.89 258.49 261.19 284.33 283.52 Score Per Watt
OpenBenchmarking.org Score Per Watt, More Is Better Numpy Benchmark Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 2 4 6 8 10 2.360 5.255 4.183 1.716 3.290 1.343 3.164 1.375 2.071 4.043 2.079 4.854 5.359 2.249 5.405 2.170 7.918 7.962 2.382 5.817 6.244 2.603 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Numpy Benchmark CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 80 160 240 320 400 Min: 78.29 / Avg: 220.31 / Max: 293.25 Min: 33.91 / Avg: 98.99 / Max: 138.69 Min: 59.12 / Avg: 108.92 / Max: 159.89 Min: 168.75 / Avg: 265.77 / Max: 348.44 Min: 73.46 / Avg: 140.29 / Max: 199.25 Min: 137.87 / Avg: 324.03 / Max: 425.17 Min: 82.95 / Avg: 146.89 / Max: 202.52 Min: 203.89 / Avg: 319.82 / Max: 421.94 Min: 99.11 / Avg: 190.58 / Max: 201.58 Min: 48.6 / Avg: 99.09 / Max: 103.63 Min: 64.52 / Avg: 260.26 / Max: 267.94 Min: 32.28 / Avg: 111.7 / Max: 116.99 Min: 26.33 / Avg: 98.86 / Max: 103.35 Min: 57.9 / Avg: 235.19 / Max: 242.43 Min: 20.13 / Avg: 78.72 / Max: 83.54 Min: 38.63 / Avg: 194.78 / Max: 202.23 Min: 16.02 / Avg: 53.3 / Max: 57.51 Min: 14.57 / Avg: 52.61 / Max: 56.75 Min: 104.03 / Avg: 108.54 / Max: 129.89 Min: 21.86 / Avg: 44.9 / Max: 66.76 Min: 43.42 / Avg: 45.54 / Max: 66.48 Min: 53.93 / Avg: 108.91 / Max: 127.19 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 31358 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 13430 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 16483 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 40662 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 21324 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 51197 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 22181 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 51810 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 38877 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 19918 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 40513 Joules per run. 12. EPYC 9684X: Approximate power consumption of 17127 Joules per run. 13. EPYC 9654: Approximate power consumption of 15357 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 36532 Joules per run. 15. EPYC 9754: Approximate power consumption of 14878 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 36749 Joules per run. 17. EPYC 8534P: Approximate power consumption of 9949 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 9820 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 34442 Joules per run. 20. Xeon 6766E: Approximate power consumption of 14129 Joules per run. 21. Xeon 6780E: Approximate power consumption of 13039 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 31258 Joules per run.
FFmpeg This is a benchmark of the FFmpeg multimedia framework. The FFmpeg test profile is making use of a modified version of vbench from Columbia University's Architecture and Design Lab (ARCADE) [http://arcade.cs.columbia.edu/vbench/] that is a benchmark for video-as-a-service workloads. The test profile offers the options of a range of vbench scenarios based on freely distributable video content and offers the options of using the x264 or x265 video encoders for transcoding. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Video On Demand Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 12 24 36 48 60 SE +/- 0.14, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.43, N = 3 SE +/- 0.07, N = 3 SE +/- 0.13, N = 3 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 53.29 53.99 49.84 48.77 47.34 45.29 48.14 46.79 43.80 44.13 55.01 55.56 55.59 52.81 47.33 47.14 46.88 46.93 26.89 27.17 29.95 28.39 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma FPS Per Watt
OpenBenchmarking.org FPS Per Watt, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Video On Demand Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.1577 0.3154 0.4731 0.6308 0.7885 0.168 0.329 0.267 0.133 0.210 0.102 0.211 0.107 0.184 0.303 0.191 0.400 0.452 0.203 0.499 0.224 0.675 0.701 0.229 0.498 0.516 0.222 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better FFmpeg 7.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 90 180 270 360 450 Min: 70.84 / Avg: 317.18 / Max: 370.52 Min: 27.6 / Avg: 164.12 / Max: 212.91 Min: 60.59 / Avg: 186.45 / Max: 226 Min: 163.78 / Avg: 366.29 / Max: 401.74 Min: 78.38 / Avg: 225.58 / Max: 260.03 Min: 207.79 / Avg: 444.37 / Max: 498.92 Min: 85.24 / Avg: 228.49 / Max: 271.74 Min: 214.26 / Avg: 439.08 / Max: 477.53 Min: 100.82 / Avg: 237.65 / Max: 291.56 Min: 51.94 / Avg: 145.51 / Max: 200.88 Min: 64.38 / Avg: 287.45 / Max: 321.56 Min: 33.72 / Avg: 139.07 / Max: 174.07 Min: 28.98 / Avg: 123.07 / Max: 151.95 Min: 56.36 / Avg: 260.19 / Max: 290.84 Min: 19.72 / Avg: 94.92 / Max: 115.72 Min: 40.07 / Avg: 210.54 / Max: 233.66 Min: 15.96 / Avg: 69.48 / Max: 89.87 Min: 16.1 / Avg: 66.97 / Max: 83.84 Min: 103.99 / Avg: 117.45 / Max: 147.92 Min: 43.59 / Avg: 54.51 / Max: 76.42 Min: 29 / Avg: 58.08 / Max: 84.77 Min: 60.98 / Avg: 127.77 / Max: 168.5 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 52228 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 26697 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 32940 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 66055 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 41657 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 85318 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 41508 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 81962 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 47293 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 28714 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 46088 Joules per run. 12. EPYC 9684X: Approximate power consumption of 22158 Joules per run. 13. EPYC 9654: Approximate power consumption of 19609 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 43191 Joules per run. 15. EPYC 9754: Approximate power consumption of 17718 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 39372 Joules per run. 17. EPYC 8534P: Approximate power consumption of 13038 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 12569 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 36839 Joules per run. 20. Xeon 6766E: Approximate power consumption of 16880 Joules per run. 21. Xeon 6780E: Approximate power consumption of 16358 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 37863 Joules per run.
Result
OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Platform Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 12 24 36 48 60 SE +/- 0.15, N = 3 SE +/- 0.14, N = 3 SE +/- 0.16, N = 3 SE +/- 0.12, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.08, N = 3 SE +/- 0.27, N = 3 SE +/- 0.05, N = 3 SE +/- 0.08, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 53.22 53.92 49.79 48.76 47.32 45.95 48.35 46.59 43.55 44.01 55.11 55.38 55.61 52.79 47.31 47.13 46.87 46.86 26.90 27.17 29.94 28.39 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma FPS Per Watt
OpenBenchmarking.org FPS Per Watt, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Platform Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.1575 0.315 0.4725 0.63 0.7875 0.168 0.329 0.267 0.133 0.210 0.104 0.212 0.106 0.184 0.303 0.192 0.399 0.452 0.203 0.498 0.224 0.675 0.700 0.230 0.498 0.516 0.222 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better FFmpeg 7.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 90 180 270 360 450 Min: 68.77 / Avg: 316.56 / Max: 368.13 Min: 27.23 / Avg: 163.84 / Max: 212.24 Min: 62.31 / Avg: 186.7 / Max: 222.86 Min: 161.47 / Avg: 365.67 / Max: 399.89 Min: 76.85 / Avg: 225.5 / Max: 260.64 Min: 205.4 / Avg: 441.78 / Max: 509.36 Min: 81.77 / Avg: 228.19 / Max: 273.56 Min: 212.12 / Avg: 439.49 / Max: 489.04 Min: 100.74 / Avg: 237.01 / Max: 295.05 Min: 49.55 / Avg: 145.35 / Max: 194.36 Min: 61.23 / Avg: 286.98 / Max: 323.54 Min: 28.08 / Avg: 138.95 / Max: 171.83 Min: 27.62 / Avg: 123.14 / Max: 151.27 Min: 57.48 / Avg: 260.25 / Max: 290.76 Min: 20.65 / Avg: 94.97 / Max: 114.96 Min: 39.9 / Avg: 210.51 / Max: 233.46 Min: 15.65 / Avg: 69.43 / Max: 88.73 Min: 15.45 / Avg: 66.97 / Max: 86.23 Min: 56.04 / Avg: 117.19 / Max: 147.2 Min: 43.59 / Avg: 54.55 / Max: 78.03 Min: 43.43 / Avg: 58 / Max: 86.79 Min: 61.79 / Avg: 127.88 / Max: 169.4 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 52232 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 26706 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 32984 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 66186 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 41567 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 84086 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 41303 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 82478 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 47560 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 28828 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 46012 Joules per run. 12. EPYC 9684X: Approximate power consumption of 22140 Joules per run. 13. EPYC 9654: Approximate power consumption of 19621 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 43202 Joules per run. 15. EPYC 9754: Approximate power consumption of 17728 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 39435 Joules per run. 17. EPYC 8534P: Approximate power consumption of 13029 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 12569 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 36680 Joules per run. 20. Xeon 6766E: Approximate power consumption of 16874 Joules per run. 21. Xeon 6780E: Approximate power consumption of 16338 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 37894 Joules per run.
SVT-AV1 This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 8 - Input: Bosphorus 4K Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 20 40 60 80 100 SE +/- 0.79, N = 5 SE +/- 0.22, N = 5 SE +/- 0.20, N = 5 SE +/- 0.46, N = 4 SE +/- 0.26, N = 4 SE +/- 0.58, N = 5 SE +/- 0.29, N = 4 SE +/- 0.44, N = 15 SE +/- 0.52, N = 7 SE +/- 0.09, N = 4 SE +/- 0.63, N = 5 SE +/- 0.42, N = 5 SE +/- 0.56, N = 5 SE +/- 0.40, N = 5 SE +/- 0.38, N = 5 SE +/- 0.31, N = 4 SE +/- 0.11, N = 4 SE +/- 0.67, N = 4 SE +/- 0.35, N = 15 SE +/- 0.03, N = 4 SE +/- 0.02, N = 4 SE +/- 0.34, N = 3 70.43 79.44 70.91 65.22 62.75 54.82 65.36 55.98 59.10 55.24 87.82 86.30 87.99 86.34 78.74 77.60 68.19 64.79 42.86 46.48 50.82 47.25 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq Frames Per Second Per Watt
OpenBenchmarking.org Frames Per Second Per Watt, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 8 - Input: Bosphorus 4K Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.2147 0.4294 0.6441 0.8588 1.0735 0.227 0.439 0.362 0.179 0.278 0.124 0.286 0.126 0.224 0.336 0.321 0.570 0.653 0.349 0.737 0.388 0.879 0.954 0.299 0.595 0.587 0.306 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better SVT-AV1 2.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 100 200 300 400 500 Min: 70.26 / Avg: 309.78 / Max: 476.6 Min: 27.5 / Avg: 181.13 / Max: 316.97 Min: 59.76 / Avg: 195.92 / Max: 293.59 Min: 171.54 / Avg: 364.29 / Max: 488.45 Min: 76.76 / Avg: 226.08 / Max: 319.38 Min: 193.1 / Avg: 442.35 / Max: 576.63 Min: 73.57 / Avg: 228.42 / Max: 325.25 Min: 196.2 / Avg: 442.62 / Max: 580.63 Min: 98.92 / Avg: 263.75 / Max: 406.42 Min: 51.15 / Avg: 164.49 / Max: 247.62 Min: 62.22 / Avg: 273.59 / Max: 425.17 Min: 31.53 / Avg: 151.3 / Max: 266.73 Min: 28.36 / Avg: 134.72 / Max: 238.02 Min: 56.85 / Avg: 247.1 / Max: 379.6 Min: 21.17 / Avg: 106.8 / Max: 187.26 Min: 39.92 / Avg: 200.17 / Max: 302.35 Min: 16.05 / Avg: 77.57 / Max: 129.87 Min: 14.98 / Avg: 67.93 / Max: 107.89 Min: 55.92 / Avg: 143.16 / Max: 199.83 Min: 43.66 / Avg: 78.14 / Max: 117.48 Min: 43.44 / Avg: 86.61 / Max: 139.64 Min: 105.44 / Avg: 154.41 / Max: 213.01 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 4832 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 2572 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 2939 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 6102 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 3730 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 8139 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 3712 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 8085 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 4597 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 2879 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 3994 Joules per run. 12. EPYC 9684X: Approximate power consumption of 2179 Joules per run. 13. EPYC 9654: Approximate power consumption of 1913 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 3558 Joules per run. 15. EPYC 9754: Approximate power consumption of 1645 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 3203 Joules per run. 17. EPYC 8534P: Approximate power consumption of 1299 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1189 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 3226 Joules per run. 20. Xeon 6766E: Approximate power consumption of 1602 Joules per run. 21. Xeon 6780E: Approximate power consumption of 1667 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 3294 Joules per run.
QuantLib QuantLib is an open-source library/framework around quantitative finance for modeling, trading and risk management scenarios. QuantLib is written in C++ with Boost and its built-in benchmark used reports the QuantLib Benchmark Index benchmark score. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org MFLOPS, More Is Better QuantLib 1.32 Configuration: Single-Threaded Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 800 1600 2400 3200 4000 SE +/- 30.36, N = 12 SE +/- 33.58, N = 3 SE +/- 28.42, N = 3 SE +/- 25.40, N = 3 SE +/- 22.17, N = 3 SE +/- 28.11, N = 3 SE +/- 25.35, N = 3 SE +/- 28.57, N = 3 SE +/- 2.82, N = 3 SE +/- 14.88, N = 3 SE +/- 1.14, N = 3 SE +/- 22.39, N = 3 SE +/- 24.27, N = 3 SE +/- 19.83, N = 3 SE +/- 14.83, N = 3 SE +/- 19.30, N = 3 SE +/- 18.64, N = 3 SE +/- 14.40, N = 3 SE +/- 4.34, N = 3 SE +/- 4.87, N = 3 SE +/- 6.88, N = 3 SE +/- 7.35, N = 3 3586.3 3600.5 3209.6 3210.1 3225.7 3207.0 3229.1 3222.8 2558.6 2534.5 3125.4 3114.2 3105.9 3098.5 2596.1 2590.8 2593.3 2593.0 1760.8 1765.6 1960.7 1954.2 1. (CXX) g++ options: -O3 -march=native -fPIE -pie MFLOPS Per Watt
OpenBenchmarking.org MFLOPS Per Watt, More Is Better QuantLib 1.32 Configuration: Single-Threaded Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 11 22 33 44 55 15.01 45.35 31.94 13.29 26.68 11.15 24.92 11.01 13.92 27.32 12.80 29.60 33.74 14.23 34.81 14.07 49.12 50.14 16.48 40.30 43.87 18.09 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better QuantLib 1.32 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 70 140 210 280 350 Min: 75.25 / Avg: 238.94 / Max: 292.83 Min: 31.58 / Avg: 79.4 / Max: 103.91 Min: 55.04 / Avg: 100.48 / Max: 155.72 Min: 161.45 / Avg: 241.52 / Max: 334.35 Min: 69.08 / Avg: 120.93 / Max: 183.43 Min: 202.91 / Avg: 287.73 / Max: 404.53 Min: 80.8 / Avg: 129.58 / Max: 191.82 Min: 208.95 / Avg: 292.75 / Max: 399.59 Min: 100.96 / Avg: 183.87 / Max: 210.8 Min: 47.97 / Avg: 92.78 / Max: 99.62 Min: 66.1 / Avg: 244.1 / Max: 269.19 Min: 32.36 / Avg: 105.22 / Max: 115.88 Min: 29.32 / Avg: 92.05 / Max: 101.3 Min: 57.57 / Avg: 217.74 / Max: 241.62 Min: 20.77 / Avg: 74.58 / Max: 81.84 Min: 40.16 / Avg: 184.09 / Max: 202.33 Min: 17.54 / Avg: 52.79 / Max: 57.91 Min: 17.21 / Avg: 51.72 / Max: 57.08 Min: 52.85 / Avg: 106.82 / Max: 109.76 Min: 43.57 / Avg: 43.81 / Max: 45.53 Min: 43.37 / Avg: 44.69 / Max: 46.71 Min: 104.5 / Avg: 108.03 / Max: 111.66 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 6173 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 2064 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 2914 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 7085 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 3426 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 8152 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 3672 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 8295 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 6497 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 3340 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 7648 Joules per run. 12. EPYC 9684X: Approximate power consumption of 3367 Joules per run. 13. EPYC 9654: Approximate power consumption of 2946 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 7040 Joules per run. 15. EPYC 9754: Approximate power consumption of 2809 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 6995 Joules per run. 17. EPYC 8534P: Approximate power consumption of 1989 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1948 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 5021 Joules per run. 20. Xeon 6766E: Approximate power consumption of 2059 Joules per run. 21. Xeon 6780E: Approximate power consumption of 1907 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 4645 Joules per run.
TensorFlow This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: GoogLeNet Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 110 220 330 440 550 SE +/- 2.68, N = 3 SE +/- 2.30, N = 3 SE +/- 0.24, N = 3 SE +/- 4.87, N = 3 SE +/- 1.67, N = 3 SE +/- 2.29, N = 3 SE +/- 1.91, N = 3 SE +/- 4.80, N = 3 SE +/- 0.69, N = 3 SE +/- 0.16, N = 3 SE +/- 0.51, N = 3 SE +/- 2.76, N = 15 SE +/- 3.87, N = 15 SE +/- 1.02, N = 3 SE +/- 10.93, N = 12 SE +/- 1.11, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 3.73, N = 4 SE +/- 0.31, N = 3 SE +/- 0.07, N = 3 SE +/- 2.49, N = 3 501.39 423.59 448.46 528.93 375.73 447.50 386.00 449.91 402.78 290.27 391.40 406.58 447.61 401.84 462.79 397.44 308.46 287.42 301.46 260.83 281.62 335.38 images/sec Per Watt
OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: GoogLeNet Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.5108 1.0216 1.5324 2.0432 2.554 0.936 1.503 1.385 0.833 1.141 0.684 1.170 0.690 0.832 1.138 0.666 1.305 1.620 0.775 1.896 0.932 2.115 2.270 0.743 1.298 1.147 0.726 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.16.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 82.2 / Avg: 535.58 / Max: 613.03 Min: 33.46 / Avg: 281.92 / Max: 317.12 Min: 58.65 / Avg: 323.79 / Max: 362.41 Min: 161.35 / Avg: 635.04 / Max: 705.2 Min: 73.87 / Avg: 329.22 / Max: 366.78 Min: 201.04 / Avg: 653.82 / Max: 709.07 Min: 79.85 / Avg: 329.98 / Max: 363.65 Min: 201.04 / Avg: 651.98 / Max: 714.73 Min: 103.67 / Avg: 483.98 / Max: 536.18 Min: 53.8 / Avg: 255 / Max: 274.03 Min: 65.43 / Avg: 587.49 / Max: 655.55 Min: 30.3 / Avg: 311.48 / Max: 350.99 Min: 27.68 / Avg: 276.32 / Max: 312.83 Min: 57.21 / Avg: 518.78 / Max: 576.81 Min: 21.26 / Avg: 244.09 / Max: 296.43 Min: 40.92 / Avg: 426.33 / Max: 487.57 Min: 18.95 / Avg: 145.84 / Max: 158.71 Min: 17.59 / Avg: 126.6 / Max: 137.81 Min: 105.28 / Avg: 405.89 / Max: 469.79 Min: 43.66 / Avg: 200.89 / Max: 222.56 Min: 43.42 / Avg: 245.54 / Max: 272.59 Min: 107.92 / Avg: 461.73 / Max: 537.33 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 34813 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 20862 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 22881 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 39584 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 27215 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 46857 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 26618 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 46726 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 38073 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 26775 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 47195 Joules per run. 12. EPYC 9684X: Approximate power consumption of 23921 Joules per run. 13. EPYC 9654: Approximate power consumption of 19508 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 40811 Joules per run. 15. EPYC 9754: Approximate power consumption of 16964 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 34959 Joules per run. 17. EPYC 8534P: Approximate power consumption of 14584 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 13546 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 42821 Joules per run. 20. Xeon 6766E: Approximate power consumption of 23572 Joules per run. 21. Xeon 6780E: Approximate power consumption of 26846 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 43711 Joules per run.
Apache IoTDB Apache IotDB is a time series database and this benchmark is facilitated using the IoT Benchmaark [https://github.com/thulab/iot-benchmark/]. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Average Latency, Fewer Is Better Apache IoTDB 1.2 Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 20 40 60 80 100 SE +/- 0.80, N = 7 SE +/- 0.68, N = 3 SE +/- 0.15, N = 3 SE +/- 1.18, N = 3 SE +/- 0.48, N = 3 SE +/- 1.01, N = 3 SE +/- 0.87, N = 3 SE +/- 1.11, N = 4 SE +/- 0.53, N = 3 SE +/- 0.43, N = 3 SE +/- 0.59, N = 12 SE +/- 0.23, N = 3 SE +/- 0.31, N = 3 SE +/- 0.65, N = 12 SE +/- 0.10, N = 3 SE +/- 0.79, N = 12 SE +/- 0.31, N = 3 SE +/- 0.03, N = 3 SE +/- 1.37, N = 3 SE +/- 0.11, N = 3 SE +/- 0.15, N = 3 SE +/- 0.65, N = 3 82.73 81.73 85.16 92.23 90.02 94.84 89.53 95.39 102.67 100.29 61.46 52.93 53.77 61.07 58.11 66.54 65.66 64.93 107.28 90.31 84.59 101.49 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Apache IoTDB 1.2 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 Min: 77 / Avg: 337.01 / Max: 603.62 Min: 33.72 / Avg: 171.59 / Max: 347.45 Min: 60.93 / Avg: 216.73 / Max: 347.32 Min: 171.93 / Avg: 425.12 / Max: 596.94 Min: 72.55 / Avg: 249.87 / Max: 361.66 Min: 212.09 / Avg: 494.07 / Max: 662.92 Min: 86.91 / Avg: 254.04 / Max: 360.99 Min: 218.55 / Avg: 495.29 / Max: 662.8 Min: 106.1 / Avg: 305.48 / Max: 479.29 Min: 55.72 / Avg: 176.97 / Max: 287.98 Min: 74.41 / Avg: 298.36 / Max: 505.37 Min: 34.95 / Avg: 157 / Max: 310.81 Min: 25.56 / Avg: 138.03 / Max: 271.74 Min: 56.18 / Avg: 264.94 / Max: 455.88 Min: 21.8 / Avg: 110.92 / Max: 210.79 Min: 41.52 / Avg: 220.99 / Max: 367.41 Min: 17.66 / Avg: 82.51 / Max: 146.09 Min: 16.39 / Avg: 76.32 / Max: 126.8 Min: 104.7 / Avg: 186.81 / Max: 319.27 Min: 33.17 / Avg: 80.98 / Max: 175.95 Min: 43.43 / Avg: 87.52 / Max: 193.65 Min: 60.48 / Avg: 192.21 / Max: 328.62 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 67451 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 39352 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 49992 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 107414 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 61718 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 129776 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 62409 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 122214 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 83294 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 47075 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 44779 Joules per run. 12. EPYC 9684X: Approximate power consumption of 26009 Joules per run. 13. EPYC 9654: Approximate power consumption of 22913 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 39411 Joules per run. 15. EPYC 9754: Approximate power consumption of 19855 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 35249 Joules per run. 17. EPYC 8534P: Approximate power consumption of 16172 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 14653 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 55110 Joules per run. 20. Xeon 6766E: Approximate power consumption of 20137 Joules per run. 21. Xeon 6780E: Approximate power consumption of 20831 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 54780 Joules per run.
ClickHouse ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 SE +/- 3.10, N = 5 SE +/- 2.86, N = 6 SE +/- 2.93, N = 3 SE +/- 3.26, N = 3 SE +/- 1.94, N = 3 SE +/- 0.19, N = 3 SE +/- 4.95, N = 3 SE +/- 3.17, N = 12 SE +/- 3.61, N = 3 SE +/- 0.73, N = 3 SE +/- 6.78, N = 3 SE +/- 0.42, N = 3 SE +/- 3.14, N = 3 SE +/- 8.37, N = 3 SE +/- 9.26, N = 3 SE +/- 4.85, N = 5 SE +/- 2.99, N = 3 SE +/- 5.72, N = 3 SE +/- 1.53, N = 3 SE +/- 3.34, N = 3 SE +/- 2.12, N = 3 SE +/- 3.25, N = 3 443.58 455.79 486.05 507.56 465.06 499.18 474.68 467.96 295.43 339.67 528.21 597.73 562.50 529.80 450.12 420.35 337.32 337.44 320.17 381.05 403.96 339.50
Apache IoTDB Apache IotDB is a time series database and this benchmark is facilitated using the IoT Benchmaark [https://github.com/thulab/iot-benchmark/]. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org point/sec, More Is Better Apache IoTDB 1.2 Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 30M 60M 90M 120M 150M SE +/- 862582.24, N = 7 SE +/- 739343.51, N = 3 SE +/- 276414.35, N = 3 SE +/- 928557.10, N = 3 SE +/- 435900.66, N = 3 SE +/- 594234.55, N = 3 SE +/- 782176.98, N = 3 SE +/- 872659.60, N = 4 SE +/- 365828.34, N = 3 SE +/- 306106.55, N = 3 SE +/- 1058559.19, N = 12 SE +/- 538692.55, N = 3 SE +/- 665173.47, N = 3 SE +/- 1249999.63, N = 12 SE +/- 263772.09, N = 3 SE +/- 1225528.40, N = 12 SE +/- 576868.09, N = 3 SE +/- 41021.96, N = 3 SE +/- 769517.20, N = 3 SE +/- 84917.07, N = 3 SE +/- 174748.00, N = 3 SE +/- 207721.96, N = 3 92771639 94616807 90871770 83651785 85744542 80770465 86354518 80139566 75178480 76729495 124947288 144760448 142102254 125595607 131781309 115317834 116879799 117884977 71664005 85117897 90973414 75740139
ClickHouse ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 SE +/- 5.39, N = 5 SE +/- 3.62, N = 6 SE +/- 3.45, N = 3 SE +/- 2.55, N = 3 SE +/- 6.03, N = 3 SE +/- 3.08, N = 3 SE +/- 3.60, N = 3 SE +/- 3.54, N = 12 SE +/- 1.27, N = 3 SE +/- 4.79, N = 3 SE +/- 2.03, N = 3 SE +/- 4.34, N = 3 SE +/- 4.03, N = 3 SE +/- 10.00, N = 3 SE +/- 3.32, N = 3 SE +/- 6.21, N = 5 SE +/- 1.77, N = 3 SE +/- 5.23, N = 3 SE +/- 1.59, N = 3 SE +/- 2.14, N = 3 SE +/- 1.22, N = 3 SE +/- 3.52, N = 3 438.60 458.23 481.66 501.63 470.02 501.07 476.91 471.79 295.06 342.99 526.36 595.19 559.55 525.23 458.96 427.95 338.84 335.46 320.87 379.92 400.52 337.75 Queries Per Minute, Geo Mean Per Watt
OpenBenchmarking.org Queries Per Minute, Geo Mean Per Watt, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 1.1063 2.2126 3.3189 4.4252 5.5315 1.289 2.599 2.341 1.265 1.967 1.068 1.974 1.012 1.043 1.966 1.676 3.709 4.053 1.870 4.182 1.857 4.085 4.366 2.038 4.917 4.737 2.049 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ClickHouse 22.12.3.5 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 77.74 / Avg: 340.3 / Max: 642.4 Min: 26.54 / Avg: 176.29 / Max: 377.99 Min: 52.84 / Avg: 205.71 / Max: 375.59 Min: 157.92 / Avg: 396.39 / Max: 673.71 Min: 70.28 / Avg: 238.9 / Max: 367.38 Min: 199.78 / Avg: 469.37 / Max: 713.86 Min: 77.89 / Avg: 241.61 / Max: 372.85 Min: 199.33 / Avg: 466.07 / Max: 698.95 Min: 101.69 / Avg: 282.88 / Max: 572.19 Min: 52.36 / Avg: 174.43 / Max: 288.3 Min: 64.74 / Avg: 314 / Max: 643.44 Min: 29.83 / Avg: 160.48 / Max: 343.21 Min: 28.3 / Avg: 138.04 / Max: 305.03 Min: 54.72 / Avg: 280.91 / Max: 531.55 Min: 20.77 / Avg: 109.76 / Max: 265.96 Min: 40.81 / Avg: 230.4 / Max: 456.57 Min: 18.06 / Avg: 82.96 / Max: 166.09 Min: 15.83 / Avg: 76.83 / Max: 137.9 Min: 62.49 / Avg: 157.43 / Max: 363.95 Min: 43.57 / Avg: 77.27 / Max: 231.46 Min: 43.42 / Avg: 84.55 / Max: 263.64 Min: 107.74 / Avg: 164.81 / Max: 404.79 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 69558 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 32820 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 40594 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 87339 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 47939 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 104983 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 47516 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 106496 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 71568 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 40178 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 63743 Joules per run. 12. EPYC 9684X: Approximate power consumption of 29474 Joules per run. 13. EPYC 9654: Approximate power consumption of 26320 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 56275 Joules per run. 15. EPYC 9754: Approximate power consumption of 24183 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 55572 Joules per run. 17. EPYC 8534P: Approximate power consumption of 19163 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 18517 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 54629 Joules per run. 20. Xeon 6766E: Approximate power consumption of 22718 Joules per run. 21. Xeon 6780E: Approximate power consumption of 22406 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 52573 Joules per run.
x265 This is a simple test of the x265 encoder run on the CPU with 1080p and 4K options for H.265 video encode performance with x265. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better x265 3.6 Video Input: Bosphorus 4K Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 9 18 27 36 45 SE +/- 0.09, N = 4 SE +/- 0.06, N = 4 SE +/- 0.11, N = 4 SE +/- 0.20, N = 4 SE +/- 0.08, N = 3 SE +/- 0.12, N = 3 SE +/- 0.39, N = 3 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 SE +/- 0.13, N = 3 SE +/- 0.10, N = 3 SE +/- 0.11, N = 3 SE +/- 0.08, N = 3 SE +/- 0.09, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.22, N = 6 SE +/- 0.11, N = 3 SE +/- 0.13, N = 3 SE +/- 0.17, N = 3 39.31 38.93 37.86 37.04 29.05 27.26 31.40 27.90 30.80 29.76 31.95 32.12 31.72 28.81 28.16 28.11 28.13 27.74 22.07 20.22 21.30 19.55 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma Frames Per Second Per Watt
OpenBenchmarking.org Frames Per Second Per Watt, More Is Better x265 3.6 Video Input: Bosphorus 4K Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0765 0.153 0.2295 0.306 0.3825 0.109 0.178 0.161 0.090 0.113 0.059 0.120 0.059 0.103 0.146 0.108 0.195 0.218 0.108 0.250 0.130 0.318 0.340 0.138 0.251 0.242 0.115 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better x265 3.6 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 90 180 270 360 450 Min: 76.83 / Avg: 359.11 / Max: 458.52 Min: 34.21 / Avg: 219.3 / Max: 292.58 Min: 59.53 / Avg: 234.38 / Max: 293.23 Min: 164.29 / Avg: 409.49 / Max: 491.55 Min: 75.63 / Avg: 256.33 / Max: 294.6 Min: 195.59 / Avg: 458.96 / Max: 515.27 Min: 72.13 / Avg: 261.62 / Max: 312.67 Min: 200.11 / Avg: 471.43 / Max: 532.57 Min: 99.99 / Avg: 298.87 / Max: 362.74 Min: 52.94 / Avg: 203.52 / Max: 247.27 Min: 64.95 / Avg: 296.42 / Max: 367.45 Min: 32.43 / Avg: 164.71 / Max: 212.57 Min: 28.94 / Avg: 145.28 / Max: 189.25 Min: 58.57 / Avg: 267.17 / Max: 327.8 Min: 20.91 / Avg: 112.7 / Max: 141.97 Min: 40.31 / Avg: 216.07 / Max: 262.6 Min: 17.3 / Avg: 88.38 / Max: 113.06 Min: 15.46 / Avg: 81.58 / Max: 101.27 Min: 104.34 / Avg: 160.26 / Max: 184.55 Min: 43.65 / Avg: 80.41 / Max: 103.35 Min: 43.45 / Avg: 88.07 / Max: 115.63 Min: 105.18 / Avg: 169.56 / Max: 195.88 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 7092 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 4276 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 4746 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 8702 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 6237 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 12086 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 6192 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 12100 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 7173 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 4952 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 6917 Joules per run. 12. EPYC 9684X: Approximate power consumption of 3733 Joules per run. 13. EPYC 9654: Approximate power consumption of 3390 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 6768 Joules per run. 15. EPYC 9754: Approximate power consumption of 2893 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 5546 Joules per run. 17. EPYC 8534P: Approximate power consumption of 2268 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 2121 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 5075 Joules per run. 20. Xeon 6766E: Approximate power consumption of 2734 Joules per run. 21. Xeon 6780E: Approximate power consumption of 2848 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 5991 Joules per run.
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 14 28 42 56 70 SE +/- 0.27122, N = 3 SE +/- 0.27014, N = 3 SE +/- 0.09731, N = 3 SE +/- 0.09239, N = 3 SE +/- 0.27882, N = 3 SE +/- 0.11901, N = 3 SE +/- 0.20934, N = 3 SE +/- 0.11212, N = 3 SE +/- 0.55506, N = 3 SE +/- 0.10899, N = 3 SE +/- 0.05013, N = 3 SE +/- 0.04145, N = 3 SE +/- 0.03174, N = 3 SE +/- 0.05569, N = 3 SE +/- 0.07716, N = 3 SE +/- 0.06474, N = 3 SE +/- 0.12474, N = 3 SE +/- 0.23936, N = 3 SE +/- 0.04782, N = 3 SE +/- 0.03255, N = 3 SE +/- 0.04131, N = 3 SE +/- 0.02474, N = 15 31.45890 60.40940 46.84910 29.14870 40.72890 32.81410 42.27110 29.19550 38.50250 44.27480 15.05160 29.84930 29.26900 15.00820 24.60950 11.93820 27.31280 26.24750 3.49785 6.24521 6.81330 3.76003 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 60 120 180 240 300 SE +/- 0.28, N = 3 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 SE +/- 0.11, N = 3 SE +/- 0.17, N = 3 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 SE +/- 0.13, N = 3 SE +/- 0.37, N = 3 SE +/- 0.06, N = 3 SE +/- 0.22, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.25, N = 3 SE +/- 0.13, N = 3 SE +/- 0.45, N = 3 SE +/- 0.17, N = 3 SE +/- 0.35, N = 3 SE +/- 3.87, N = 3 SE +/- 0.84, N = 3 SE +/- 0.89, N = 3 SE +/- 1.74, N = 15 31.79 16.55 21.34 34.31 24.55 30.47 23.66 34.25 25.98 22.59 66.44 33.50 34.16 66.63 40.63 83.77 36.61 38.10 285.99 160.13 146.78 266.10 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.17 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 100 200 300 400 500 Min: 102.55 / Avg: 456.44 / Max: 489.76 Min: 51.87 / Avg: 247.61 / Max: 266.6 Min: 62.47 / Avg: 550.79 / Max: 593.02 Min: 34.21 / Avg: 290.09 / Max: 313.77 Min: 30.05 / Avg: 245.24 / Max: 265.47 Min: 55.89 / Avg: 483.5 / Max: 517.8 Min: 21.46 / Avg: 198.94 / Max: 215.69 Min: 35.54 / Avg: 404.89 / Max: 435.36 Min: 19.18 / Avg: 133.31 / Max: 143.64 Min: 16.96 / Avg: 119.46 / Max: 129.05 Min: 104.82 / Avg: 306.33 / Max: 331.18 Min: 43.73 / Avg: 146.66 / Max: 157.5 Min: 43.59 / Avg: 175.34 / Max: 190.81 Min: 107.98 / Avg: 351.03 / Max: 380.24 1. Xeon Platinum 8380 2P: Approximate power consumption of 29669 Joules per run. 2. Xeon Platinum 8380: Approximate power consumption of 16094 Joules per run. 3. EPYC 9684X 2P: Approximate power consumption of 35434 Joules per run. 4. EPYC 9684X: Approximate power consumption of 18759 Joules per run. 5. EPYC 9654: Approximate power consumption of 15859 Joules per run. 6. EPYC 9654 2P: Approximate power consumption of 31266 Joules per run. 7. EPYC 9754: Approximate power consumption of 12865 Joules per run. 8. EPYC 9754 2P: Approximate power consumption of 26318 Joules per run. 9. EPYC 8534P: Approximate power consumption of 8665 Joules per run. 10. EPYC 8534PN: Approximate power consumption of 7765 Joules per run. 11. Xeon 6766E 2P: Approximate power consumption of 20320 Joules per run. 12. Xeon 6766E: Approximate power consumption of 9631 Joules per run. 13. Xeon 6780E: Approximate power consumption of 11456 Joules per run. 14. Xeon 6780E 2P: Approximate power consumption of 23215 Joules per run.
ASKAP ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Mpix/sec, More Is Better ASKAP 1.0 Test: tConvolve MPI - Degridding Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 30K 60K 90K 120K 150K SE +/- 480.95, N = 3 SE +/- 153.57, N = 3 SE +/- 93.91, N = 3 SE +/- 378.22, N = 4 SE +/- 0.00, N = 3 SE +/- 143.60, N = 3 SE +/- 76.47, N = 3 SE +/- 0.00, N = 3 SE +/- 62.13, N = 3 SE +/- 64.71, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 189.10, N = 3 SE +/- 882.91, N = 4 SE +/- 598.81, N = 12 SE +/- 1077.92, N = 14 SE +/- 44.43, N = 3 SE +/- 69.57, N = 3 59139.20 31177.20 17891.60 34614.10 18522.00 36900.50 20561.40 40368.60 12800.40 8429.13 123480.00 64260.20 42172.40 81025.80 28476.60 52639.50 16704.40 15903.40 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 200 400 600 800 1000 SE +/- 1.42, N = 3 SE +/- 0.95, N = 3 SE +/- 0.04, N = 3 SE +/- 0.69, N = 3 SE +/- 1.23, N = 3 SE +/- 1.28, N = 3 SE +/- 0.52, N = 3 SE +/- 0.55, N = 3 SE +/- 0.23, N = 3 SE +/- 0.34, N = 3 SE +/- 2.17, N = 3 SE +/- 5.20, N = 15 SE +/- 7.13, N = 15 SE +/- 5.47, N = 15 SE +/- 13.40, N = 15 SE +/- 20.94, N = 15 SE +/- 0.25, N = 3 SE +/- 0.56, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.05, N = 3 SE +/- 0.34, N = 3 736.23 403.20 298.56 654.84 285.95 568.81 301.30 569.60 175.72 84.30 1095.79 433.06 306.27 750.11 283.18 750.96 197.91 204.05 245.27 126.64 134.77 261.64 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
ASKAP ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Mpix/sec, More Is Better ASKAP 1.0 Test: tConvolve MPI - Gridding Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 30K 60K 90K 120K 150K SE +/- 1080.03, N = 3 SE +/- 219.20, N = 3 SE +/- 76.67, N = 3 SE +/- 412.68, N = 4 SE +/- 99.83, N = 3 SE +/- 194.30, N = 3 SE +/- 0.00, N = 3 SE +/- 802.88, N = 3 SE +/- 46.25, N = 3 SE +/- 47.29, N = 3 SE +/- 19579.11, N = 3 SE +/- 581.17, N = 3 SE +/- 1853.72, N = 3 SE +/- 2386.93, N = 4 SE +/- 685.49, N = 12 SE +/- 1180.69, N = 14 SE +/- 86.77, N = 3 SE +/- 0.00, N = 3 72004.00 37265.90 21314.20 41773.00 21766.50 42939.20 23250.20 45195.10 14497.30 9623.77 121976.90 74389.00 46233.70 86757.70 28854.30 54066.00 16573.20 16399.70 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp Mpix/sec Per Watt
OpenBenchmarking.org Mpix/sec Per Watt, More Is Better ASKAP 1.0 Test: tConvolve MPI - Gridding Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 50 100 150 200 250 128.04 125.14 67.85 66.72 69.96 67.77 75.14 70.87 29.22 38.76 199.37 247.30 188.14 167.00 134.70 109.74 130.96 142.12 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ASKAP 1.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 140 280 420 560 700 Min: 74.42 / Avg: 562.35 / Max: 727.39 Min: 24.59 / Avg: 297.8 / Max: 352.67 Min: 57.81 / Avg: 314.14 / Max: 357.36 Min: 163.2 / Avg: 626.07 / Max: 724.87 Min: 74.39 / Avg: 311.12 / Max: 354.1 Min: 196.26 / Avg: 633.57 / Max: 720.17 Min: 73.2 / Avg: 309.44 / Max: 360.17 Min: 196.89 / Avg: 637.73 / Max: 729.76 Min: 97.93 / Avg: 496.22 / Max: 563.93 Min: 52.74 / Avg: 248.29 / Max: 286.59 Min: 64.2 / Avg: 611.81 / Max: 819.12 Min: 31.29 / Avg: 300.8 / Max: 409.34 Min: 29.47 / Avg: 245.74 / Max: 336.85 Min: 57.21 / Avg: 519.5 / Max: 681.6 Min: 20.61 / Avg: 214.21 / Max: 327.89 Min: 37.58 / Avg: 492.69 / Max: 670.56 Min: 19.03 / Avg: 126.56 / Max: 161.28 Min: 16.5 / Avg: 115.4 / Max: 136.82 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 23431 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 10522 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 13717 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 29112 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 11304 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 24498 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 12687 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 26785 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 27458 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 11669 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 23453 Joules per run. 12. EPYC 9684X: Approximate power consumption of 10328 Joules per run. 13. EPYC 9654: Approximate power consumption of 10485 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 27793 Joules per run. 15. EPYC 9754: Approximate power consumption of 17351 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 48389 Joules per run. 17. EPYC 8534P: Approximate power consumption of 6961 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 6385 Joules per run.
Xmrig Xmrig is an open-source cross-platform CPU/GPU miner for RandomX, KawPow, CryptoNight and AstroBWT. This test profile is setup to measure the Xmrig CPU mining performance. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org H/s, More Is Better Xmrig 6.21 Variant: GhostRider - Hash Count: 1M Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 7K 14K 21K 28K 35K SE +/- 64.69, N = 3 SE +/- 44.68, N = 3 SE +/- 23.16, N = 3 SE +/- 4.03, N = 3 SE +/- 12.93, N = 3 SE +/- 14.02, N = 3 SE +/- 14.78, N = 3 SE +/- 7.44, N = 3 SE +/- 49.14, N = 12 SE +/- 32.20, N = 2 SE +/- 95.10, N = 3 SE +/- 10.36, N = 3 SE +/- 117.32, N = 3 SE +/- 290.50, N = 3 SE +/- 61.27, N = 3 SE +/- 46.94, N = 3 SE +/- 30.53, N = 3 SE +/- 41.94, N = 3 SE +/- 53.95, N = 3 SE +/- 19.74, N = 3 SE +/- 43.00, N = 3 SE +/- 43.14, N = 3 16324.7 8378.3 5808.8 11263.2 5446.8 10975.8 6122.3 12115.0 5230.9 2593.2 31157.8 15786.6 14207.7 26702.7 9320.5 17873.1 4660.0 4564.3 10431.6 5315.7 5753.9 11147.2 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc H/s Per Watt
OpenBenchmarking.org H/s Per Watt, More Is Better Xmrig 6.21 Variant: GhostRider - Hash Count: 1M Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 11 22 33 44 55 25.291 25.015 17.114 16.828 16.636 16.293 17.929 18.002 10.183 9.798 44.082 42.004 46.688 45.051 40.166 36.168 33.466 36.236 28.504 30.621 29.190 27.676 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Xmrig 6.21 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 73.19 / Avg: 645.48 / Max: 743.36 Min: 24.38 / Avg: 334.94 / Max: 357.54 Min: 55.89 / Avg: 339.42 / Max: 349.66 Min: 159.48 / Avg: 669.3 / Max: 730.91 Min: 73.18 / Avg: 327.41 / Max: 335.76 Min: 201.16 / Avg: 673.63 / Max: 702.68 Min: 75.82 / Avg: 341.47 / Max: 356.09 Min: 188.92 / Avg: 672.99 / Max: 738.06 Min: 95.12 / Avg: 513.7 / Max: 535.43 Min: 53.3 / Avg: 264.66 / Max: 271.14 Min: 60.4 / Avg: 706.81 / Max: 819.97 Min: 36 / Avg: 375.84 / Max: 410.13 Min: 30.21 / Avg: 304.31 / Max: 328.13 Min: 54.62 / Avg: 592.72 / Max: 673.62 Min: 21.91 / Avg: 232.05 / Max: 250.74 Min: 38.53 / Avg: 494.18 / Max: 551.71 Min: 17.62 / Avg: 139.24 / Max: 143.75 Min: 15.67 / Avg: 125.96 / Max: 131.33 Min: 103.58 / Avg: 365.97 / Max: 390.52 Min: 43.68 / Avg: 173.6 / Max: 178.87 Min: 43.43 / Avg: 197.12 / Max: 203.16 Min: 104.75 / Avg: 402.77 / Max: 425.84 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 43893 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 55934 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 60191 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 62691 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 61772 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 64220 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 57366 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 58774 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 100685 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 252352 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 26388 Joules per run. 12. EPYC 9684X: Approximate power consumption of 25933 Joules per run. 13. EPYC 9654: Approximate power consumption of 22925 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 25289 Joules per run. 15. EPYC 9754: Approximate power consumption of 25990 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 30145 Joules per run. 17. EPYC 8534P: Approximate power consumption of 30495 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 28131 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 37085 Joules per run. 20. Xeon 6766E: Approximate power consumption of 33620 Joules per run. 21. Xeon 6780E: Approximate power consumption of 35218 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 38398 Joules per run.
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 7 14 21 28 35 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 4 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.08, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 2.48 2.36 3.58 2.50 2.50 2.53 2.67 2.79 8.27 8.58 9.25 9.42 10.09 10.17 10.92 11.20 11.78 13.11 28.24 27.01 24.25 24.77 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 83.6 / Avg: 652.57 / Max: 760.35 Min: 34.78 / Avg: 327.29 / Max: 381.26 Min: 58.8 / Avg: 329.61 / Max: 364.22 Min: 168.91 / Avg: 662.23 / Max: 753.52 Min: 73.64 / Avg: 331.47 / Max: 377.08 Min: 208.01 / Avg: 666.11 / Max: 753.96 Min: 83.9 / Avg: 332.66 / Max: 375.98 Min: 206.25 / Avg: 666.2 / Max: 754.51 Min: 100.48 / Avg: 510.62 / Max: 581.76 Min: 50.92 / Avg: 255.35 / Max: 288.21 Min: 68.11 / Avg: 762.39 / Max: 819.68 Min: 34.9 / Avg: 384.48 / Max: 410.25 Min: 28.34 / Avg: 326.4 / Max: 351.05 Min: 59.07 / Avg: 649.54 / Max: 702.57 Min: 21.95 / Avg: 308.04 / Max: 333.19 Min: 40.68 / Avg: 615.84 / Max: 667.35 Min: 18.69 / Avg: 156.99 / Max: 167.88 Min: 17.61 / Avg: 128.88 / Max: 137.57 Min: 106.03 / Avg: 466.01 / Max: 540.12 Min: 43.68 / Avg: 235.37 / Max: 270.07 Min: 43.61 / Avg: 309.55 / Max: 356.77 Min: 108.97 / Avg: 612 / Max: 711.29 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 42634 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 21274 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21424 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 43045 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 21380 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 43297 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 21401 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 43081 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 32680 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16427 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 49301 Joules per run. 12. EPYC 9684X: Approximate power consumption of 24479 Joules per run. 13. EPYC 9654: Approximate power consumption of 20999 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 42004 Joules per run. 15. EPYC 9754: Approximate power consumption of 19920 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 40030 Joules per run. 17. EPYC 8534P: Approximate power consumption of 10048 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 8291 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 30912 Joules per run. 20. Xeon 6766E: Approximate power consumption of 15299 Joules per run. 21. Xeon 6780E: Approximate power consumption of 20121 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 40392 Joules per run.
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 15 30 45 60 75 SE +/- 0.50579, N = 13 SE +/- 0.82440, N = 3 SE +/- 0.16471, N = 3 SE +/- 0.47575, N = 3 SE +/- 0.69010, N = 15 SE +/- 0.34209, N = 3 SE +/- 0.58786, N = 3 SE +/- 0.20595, N = 3 SE +/- 0.18826, N = 3 SE +/- 0.54692, N = 3 SE +/- 0.56636, N = 15 SE +/- 0.05911, N = 3 SE +/- 0.42374, N = 4 SE +/- 0.31646, N = 15 SE +/- 0.38216, N = 15 SE +/- 0.40826, N = 15 SE +/- 0.06539, N = 3 SE +/- 0.29092, N = 15 SE +/- 0.03571, N = 3 SE +/- 0.02972, N = 3 SE +/- 0.03724, N = 3 SE +/- 0.00992, N = 3 38.42400 66.51620 52.81670 36.24930 47.27030 40.56710 42.27470 33.96210 45.54140 51.01720 23.49600 41.47450 39.25860 23.57860 30.85720 18.01330 30.37430 31.06440 5.58241 9.37294 10.34250 5.95283 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 40 80 120 160 200 SE +/- 0.39, N = 13 SE +/- 0.19, N = 3 SE +/- 0.06, N = 3 SE +/- 0.36, N = 3 SE +/- 0.32, N = 15 SE +/- 0.21, N = 3 SE +/- 0.33, N = 3 SE +/- 0.18, N = 3 SE +/- 0.09, N = 3 SE +/- 0.21, N = 3 SE +/- 0.98, N = 15 SE +/- 0.03, N = 3 SE +/- 0.28, N = 4 SE +/- 0.56, N = 15 SE +/- 0.40, N = 15 SE +/- 1.27, N = 15 SE +/- 0.07, N = 3 SE +/- 0.31, N = 15 SE +/- 1.15, N = 3 SE +/- 0.34, N = 3 SE +/- 0.35, N = 3 SE +/- 0.28, N = 3 26.09 15.04 18.93 27.59 21.22 24.65 23.66 29.44 21.96 19.60 42.89 24.11 25.48 42.51 32.47 55.92 32.92 32.23 179.14 106.69 96.69 167.97 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.17 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 110 220 330 440 550 Min: 99.93 / Avg: 462.76 / Max: 500.69 Min: 53.12 / Avg: 250.25 / Max: 269.16 Min: 58.32 / Avg: 553.19 / Max: 601.27 Min: 34.41 / Avg: 294.42 / Max: 320.91 Min: 25.68 / Avg: 250.64 / Max: 270.41 Min: 56.82 / Avg: 486.07 / Max: 528.33 Min: 20.36 / Avg: 200.16 / Max: 217.19 Min: 37.61 / Avg: 403.98 / Max: 434.7 Min: 17.21 / Avg: 132.4 / Max: 145.89 Min: 16.31 / Avg: 120.57 / Max: 131.45 Min: 103.92 / Avg: 301.78 / Max: 322.43 Min: 43.72 / Avg: 151.02 / Max: 162.14 Min: 43.54 / Avg: 183.75 / Max: 198.81 Min: 107.32 / Avg: 350.27 / Max: 375.87 1. Xeon Platinum 8380 2P: Approximate power consumption of 30233 Joules per run. 2. Xeon Platinum 8380: Approximate power consumption of 16266 Joules per run. 3. EPYC 9684X 2P: Approximate power consumption of 35589 Joules per run. 4. EPYC 9684X: Approximate power consumption of 19039 Joules per run. 5. EPYC 9654: Approximate power consumption of 16166 Joules per run. 6. EPYC 9654 2P: Approximate power consumption of 31303 Joules per run. 7. EPYC 9754: Approximate power consumption of 12957 Joules per run. 8. EPYC 9754 2P: Approximate power consumption of 26097 Joules per run. 9. EPYC 8534P: Approximate power consumption of 8562 Joules per run. 10. EPYC 8534PN: Approximate power consumption of 7813 Joules per run. 11. Xeon 6766E 2P: Approximate power consumption of 19918 Joules per run. 12. Xeon 6766E: Approximate power consumption of 9867 Joules per run. 13. Xeon 6780E: Approximate power consumption of 12066 Joules per run. 14. Xeon 6780E 2P: Approximate power consumption of 23118 Joules per run.
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 70 140 210 280 350 SE +/- 1.63, N = 3 SE +/- 2.50, N = 3 SE +/- 0.53, N = 3 SE +/- 0.73, N = 3 SE +/- 1.74, N = 3 SE +/- 0.47, N = 3 SE +/- 2.72, N = 3 SE +/- 0.73, N = 3 SE +/- 1.30, N = 3 SE +/- 1.73, N = 3 SE +/- 0.54, N = 3 SE +/- 1.50, N = 3 SE +/- 2.31, N = 4 SE +/- 0.54, N = 3 SE +/- 0.53, N = 3 SE +/- 0.66, N = 3 SE +/- 1.54, N = 15 SE +/- 1.50, N = 15 SE +/- 0.26, N = 3 SE +/- 0.27, N = 3 SE +/- 0.32, N = 3 SE +/- 0.27, N = 6 153.92 308.80 313.10 156.46 319.04 166.49 301.14 153.41 192.99 315.03 100.46 178.70 190.38 100.36 153.25 88.37 207.34 203.06 27.47 55.86 64.16 28.40 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 8 16 24 32 40 SE +/- 0.06875, N = 3 SE +/- 0.02630, N = 3 SE +/- 0.00544, N = 3 SE +/- 0.02968, N = 3 SE +/- 0.01698, N = 3 SE +/- 0.01680, N = 3 SE +/- 0.03023, N = 3 SE +/- 0.03080, N = 3 SE +/- 0.03509, N = 3 SE +/- 0.01736, N = 3 SE +/- 0.05309, N = 3 SE +/- 0.04669, N = 3 SE +/- 0.06505, N = 4 SE +/- 0.05293, N = 3 SE +/- 0.02258, N = 3 SE +/- 0.08457, N = 3 SE +/- 0.03641, N = 15 SE +/- 0.03633, N = 15 SE +/- 0.34399, N = 3 SE +/- 0.08701, N = 3 SE +/- 0.07856, N = 3 SE +/- 0.32730, N = 6 6.49693 3.23780 3.19298 6.39031 3.13366 6.00525 3.32030 6.51744 5.18070 3.17360 9.95245 5.59491 5.25321 9.96245 6.52367 11.31480 4.82506 4.92653 36.40090 17.90000 15.58560 35.22660 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.17 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 100 200 300 400 500 Min: 101.46 / Avg: 445.87 / Max: 473.79 Min: 53.36 / Avg: 238.84 / Max: 254.78 Min: 64.35 / Avg: 547.96 / Max: 588.36 Min: 36.05 / Avg: 285.19 / Max: 306.51 Min: 28.74 / Avg: 240.91 / Max: 259.49 Min: 51.2 / Avg: 478.17 / Max: 512.01 Min: 21.2 / Avg: 199.22 / Max: 213.69 Min: 42.14 / Avg: 407.23 / Max: 436.3 Min: 18.11 / Avg: 126.52 / Max: 135.68 Min: 16.2 / Avg: 115 / Max: 124.26 Min: 104.68 / Avg: 302.86 / Max: 321.76 Min: 43.72 / Avg: 144.55 / Max: 152.6 Min: 43.63 / Avg: 170.55 / Max: 180.89 Min: 108.09 / Avg: 347.86 / Max: 369.84 1. Xeon Platinum 8380 2P: Approximate power consumption of 28684 Joules per run. 2. Xeon Platinum 8380: Approximate power consumption of 15286 Joules per run. 3. EPYC 9684X 2P: Approximate power consumption of 35069 Joules per run. 4. EPYC 9684X: Approximate power consumption of 18252 Joules per run. 5. EPYC 9654: Approximate power consumption of 15418 Joules per run. 6. EPYC 9654 2P: Approximate power consumption of 30603 Joules per run. 7. EPYC 9754: Approximate power consumption of 12750 Joules per run. 8. EPYC 9754 2P: Approximate power consumption of 25927 Joules per run. 9. EPYC 8534P: Approximate power consumption of 8106 Joules per run. 10. EPYC 8534PN: Approximate power consumption of 7360 Joules per run. 11. Xeon 6766E 2P: Approximate power consumption of 19484 Joules per run. 12. Xeon 6766E: Approximate power consumption of 9299 Joules per run. 13. Xeon 6780E: Approximate power consumption of 10972 Joules per run. 14. Xeon 6780E 2P: Approximate power consumption of 22379 Joules per run.
OpenSSL OpenSSL is an open-source toolkit that implements SSL (Secure Sockets Layer) and TLS (Transport Layer Security) protocols. This test profile makes use of the built-in "openssl speed" benchmarking capabilities. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: SHA256 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 70000M 140000M 210000M 280000M 350000M SE +/- 29142783.86, N = 3 SE +/- 23323764.84, N = 3 SE +/- 159515825.53, N = 3 SE +/- 66583540.43, N = 3 SE +/- 27466135.54, N = 3 SE +/- 126029257.64, N = 3 SE +/- 33334799.97, N = 3 SE +/- 70647143.49, N = 3 SE +/- 919807437.76, N = 12 SE +/- 8534071.27, N = 3 SE +/- 160246527.97, N = 3 SE +/- 146384349.91, N = 3 SE +/- 38601729.93, N = 3 SE +/- 210407867.05, N = 3 SE +/- 34182873.86, N = 3 SE +/- 80639802.67, N = 3 SE +/- 10642001.84, N = 3 SE +/- 64797308.82, N = 3 SE +/- 97765007.32, N = 3 SE +/- 34216643.88, N = 3 SE +/- 242095363.59, N = 3 SE +/- 228931567.43, N = 3 131976050120 66573957920 61806994523 119106802107 44439185187 88635753413 51840436763 103382860113 54530700576 27858504490 276267766403 138409588983 126475137690 251645629887 161269162280 320258686237 74584721007 67806730387 256330349777 129975994733 144163027280 287035041140 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl byte/s Per Watt
OpenBenchmarking.org byte/s Per Watt, More Is Better OpenSSL 3.3 Algorithm: SHA256 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130M 260M 390M 520M 650M 193109819.08 195213927.96 189585676.93 179424218.79 157500377.52 149911179.45 167457577.18 160789835.78 103421352.66 105324899.05 344443539.20 345260515.93 386445411.79 378210579.19 481947170.76 471857277.56 469088919.27 511227929.81 578313018.50 611047359.48 516781889.88 507731880.45 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OpenSSL 3.3 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 71.86 / Avg: 683.42 / Max: 754.43 Min: 32.34 / Avg: 341.03 / Max: 377.49 Min: 57.24 / Avg: 326.01 / Max: 380.05 Min: 163.14 / Avg: 663.83 / Max: 754.31 Min: 75.75 / Avg: 282.15 / Max: 323.37 Min: 182.49 / Avg: 591.26 / Max: 697.86 Min: 82.11 / Avg: 309.57 / Max: 363.52 Min: 186.31 / Avg: 642.97 / Max: 734.25 Min: 100.31 / Avg: 527.27 / Max: 585.66 Min: 52.69 / Avg: 264.5 / Max: 291.33 Min: 69.9 / Avg: 802.07 / Max: 822.12 Min: 34.63 / Avg: 400.88 / Max: 411.05 Min: 29.19 / Avg: 327.28 / Max: 361.5 Min: 59.61 / Avg: 665.36 / Max: 734.49 Min: 22.61 / Avg: 334.62 / Max: 353.13 Min: 42.79 / Avg: 678.72 / Max: 712.84 Min: 18.27 / Avg: 159 / Max: 170.75 Min: 17.53 / Avg: 132.64 / Max: 140.44 Min: 105.85 / Avg: 443.24 / Max: 540.57 Min: 43.63 / Avg: 212.71 / Max: 270.71 Min: 43.49 / Avg: 278.96 / Max: 357.32 Min: 108.39 / Avg: 565.33 / Max: 713.33 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 125750 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 62750 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 60095 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 122144 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 51916 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 108791 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 56962 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 118306 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 96797 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 48668 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 145977 Joules per run. 12. EPYC 9684X: Approximate power consumption of 73362 Joules per run. 13. EPYC 9654: Approximate power consumption of 60001 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 121095 Joules per run. 15. EPYC 9754: Approximate power consumption of 61347 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 123527 Joules per run. 17. EPYC 8534P: Approximate power consumption of 29203 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 24361 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 81408 Joules per run. 20. Xeon 6766E: Approximate power consumption of 39068 Joules per run. 21. Xeon 6780E: Approximate power consumption of 51422 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 103832 Joules per run.
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 SE +/- 0.77, N = 3 SE +/- 0.69, N = 3 SE +/- 0.12, N = 3 SE +/- 0.01, N = 3 SE +/- 0.14, N = 3 SE +/- 0.58, N = 3 SE +/- 0.41, N = 3 SE +/- 0.54, N = 3 SE +/- 0.10, N = 3 SE +/- 0.36, N = 3 SE +/- 0.41, N = 3 SE +/- 0.12, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.18, N = 3 SE +/- 0.07, N = 3 SE +/- 0.15, N = 3 SE +/- 0.18, N = 3 545.21 284.64 167.83 423.18 202.59 373.50 217.11 401.45 96.08 47.99 205.03 101.51 93.99 188.74 115.78 231.83 53.89 48.73 99.72 51.85 58.06 113.68 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 2K 4K 6K 8K 10K SE +/- 24.76, N = 3 SE +/- 10.14, N = 3 SE +/- 1.87, N = 3 SE +/- 13.31, N = 3 SE +/- 15.13, N = 3 SE +/- 37.79, N = 3 SE +/- 7.60, N = 3 SE +/- 28.98, N = 3 SE +/- 6.96, N = 3 SE +/- 1.70, N = 3 SE +/- 59.51, N = 3 SE +/- 1.84, N = 3 SE +/- 67.22, N = 14 SE +/- 77.59, N = 3 SE +/- 139.41, N = 12 SE +/- 27.90, N = 3 SE +/- 0.64, N = 3 SE +/- 3.67, N = 3 SE +/- 11.12, N = 3 SE +/- 13.67, N = 3 SE +/- 16.46, N = 3 SE +/- 2.88, N = 3 9360.89 6757.26 4209.10 7356.63 4208.49 5565.23 4386.48 5933.65 2963.82 1525.57 8231.72 6963.31 5697.51 7810.65 5310.07 6513.36 3636.33 3405.94 843.92 1747.50 1906.99 978.46 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Result
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 60 120 180 240 300 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.16, N = 3 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 SE +/- 0.34, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.39, N = 3 SE +/- 0.01, N = 3 SE +/- 0.60, N = 11 SE +/- 0.77, N = 7 SE +/- 0.44, N = 3 SE +/- 1.05, N = 5 SE +/- 0.59, N = 3 SE +/- 0.13, N = 3 SE +/- 0.05, N = 3 SE +/- 2.84, N = 15 SE +/- 0.48, N = 3 SE +/- 0.06, N = 3 SE +/- 3.14, N = 3 28.17 26.85 62.46 37.58 28.73 29.98 38.50 41.57 70.95 127.89 43.17 83.11 91.16 48.43 102.84 56.73 100.67 109.00 294.69 259.66 240.38 271.14 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 86.44 / Avg: 651.59 / Max: 748.25 Min: 34.43 / Avg: 325.81 / Max: 362.26 Min: 59.14 / Avg: 321.95 / Max: 371.05 Min: 167.2 / Avg: 656.03 / Max: 736.45 Min: 70.61 / Avg: 331.05 / Max: 366.72 Min: 196.83 / Avg: 663.81 / Max: 748.85 Min: 74.79 / Avg: 330.98 / Max: 373.36 Min: 203.57 / Avg: 662.79 / Max: 751.8 Min: 102.32 / Avg: 507.36 / Max: 566.08 Min: 50.83 / Avg: 254.14 / Max: 284.65 Min: 69.87 / Avg: 750.94 / Max: 819.6 Min: 31.03 / Avg: 374.75 / Max: 410.94 Min: 29.13 / Avg: 323.9 / Max: 362.47 Min: 52.92 / Avg: 645.83 / Max: 711.68 Min: 20.94 / Avg: 299.63 / Max: 344.93 Min: 39.45 / Avg: 607.43 / Max: 679.21 Min: 18.55 / Avg: 159.63 / Max: 174.23 Min: 17.99 / Avg: 135.1 / Max: 150.13 Min: 106.93 / Avg: 441.51 / Max: 532 Min: 43.66 / Avg: 230.17 / Max: 253.31 Min: 43.55 / Avg: 296.98 / Max: 325.95 Min: 108.68 / Avg: 553.41 / Max: 653.25 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 43005 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 21286 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21571 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 43298 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 21518 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 43369 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 21624 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 43744 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 33148 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16604 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 49562 Joules per run. 12. EPYC 9684X: Approximate power consumption of 24495 Joules per run. 13. EPYC 9654: Approximate power consumption of 21192 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 42625 Joules per run. 15. EPYC 9754: Approximate power consumption of 19836 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 40495 Joules per run. 17. EPYC 8534P: Approximate power consumption of 10535 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 8917 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 30405 Joules per run. 20. Xeon 6766E: Approximate power consumption of 15268 Joules per run. 21. Xeon 6780E: Approximate power consumption of 19700 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 38001 Joules per run.
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 4K 8K 12K 16K 20K SE +/- 7.74, N = 3 SE +/- 5.57, N = 3 SE +/- 3.97, N = 3 SE +/- 4.14, N = 3 SE +/- 3.72, N = 3 SE +/- 3.67, N = 3 SE +/- 0.46, N = 3 SE +/- 7.22, N = 3 SE +/- 2.06, N = 3 SE +/- 1.47, N = 3 SE +/- 7.99, N = 3 SE +/- 4.58, N = 3 SE +/- 4.14, N = 3 SE +/- 7.03, N = 3 SE +/- 4.98, N = 3 SE +/- 10.13, N = 3 SE +/- 3.18, N = 3 SE +/- 1.89, N = 3 SE +/- 6.55, N = 3 SE +/- 20.57, N = 3 SE +/- 11.75, N = 3 SE +/- 4.90, N = 3 18375.63 9515.86 5943.66 15519.92 6717.65 13102.28 7207.74 14033.94 3263.03 1698.05 12665.62 6846.79 6554.12 12024.18 7862.65 14601.52 3692.67 3355.73 3787.94 2006.00 2179.99 4259.99 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 10K 20K 30K 40K 50K SE +/- 39.08, N = 3 SE +/- 47.41, N = 3 SE +/- 2.71, N = 3 SE +/- 53.98, N = 3 SE +/- 234.43, N = 4 SE +/- 80.58, N = 3 SE +/- 21.27, N = 3 SE +/- 233.95, N = 3 SE +/- 6.41, N = 3 SE +/- 5.62, N = 3 SE +/- 110.20, N = 3 SE +/- 11.71, N = 3 SE +/- 4.46, N = 3 SE +/- 147.69, N = 3 SE +/- 5.50, N = 3 SE +/- 11.27, N = 3 SE +/- 0.41, N = 3 SE +/- 1.69, N = 3 SE +/- 12.93, N = 3 SE +/- 7.59, N = 3 SE +/- 6.61, N = 3 SE +/- 19.55, N = 3 48122.16 26943.42 15943.17 47654.95 19183.83 37710.60 20910.53 40032.81 9657.08 4502.74 20550.93 9997.89 9356.71 18666.16 11508.19 22499.03 5366.79 4830.01 10020.91 5278.46 5866.63 11390.04 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
ASTC Encoder ASTC Encoder (astcenc) is for the Adaptive Scalable Texture Compression (ASTC) format commonly used with OpenGL, OpenGL ES, and Vulkan graphics APIs. This test profile does a coding test of both compression/decompression. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org MT/s, More Is Better ASTC Encoder 4.7 Preset: Exhaustive Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 4 8 12 16 20 SE +/- 0.0157, N = 3 SE +/- 0.0072, N = 3 SE +/- 0.0024, N = 3 SE +/- 0.0164, N = 3 SE +/- 0.0003, N = 3 SE +/- 0.0033, N = 3 SE +/- 0.0011, N = 3 SE +/- 0.0016, N = 3 SE +/- 0.0029, N = 3 SE +/- 0.0016, N = 3 SE +/- 0.0170, N = 3 SE +/- 0.0086, N = 3 SE +/- 0.0002, N = 3 SE +/- 0.0218, N = 3 SE +/- 0.0025, N = 3 SE +/- 0.1160, N = 3 SE +/- 0.0010, N = 3 SE +/- 0.0006, N = 3 SE +/- 0.0040, N = 3 SE +/- 0.0007, N = 3 SE +/- 0.0000, N = 3 SE +/- 0.0118, N = 3 8.9091 4.6303 4.2689 8.3701 3.1204 6.2126 3.6276 7.2075 2.6471 1.3319 11.9107 6.3027 5.6301 10.6018 7.5573 14.1038 3.5146 3.1993 7.1291 3.6505 4.0574 7.9060 1. (CXX) g++ options: -O3 -flto -pthread MT/s Per Watt
OpenBenchmarking.org MT/s Per Watt, More Is Better ASTC Encoder 4.7 Preset: Exhaustive Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0074 0.0148 0.0222 0.0296 0.037 0.017 0.016 0.014 0.015 0.010 0.011 0.012 0.012 0.005 0.005 0.021 0.020 0.021 0.023 0.029 0.033 0.023 0.025 0.021 0.019 0.016 0.019 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ASTC Encoder 4.7 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 80.68 / Avg: 525.87 / Max: 752.74 Min: 36.03 / Avg: 293.73 / Max: 378.6 Min: 57.84 / Avg: 300.87 / Max: 376.96 Min: 152.83 / Avg: 551.93 / Max: 753.4 Min: 74.57 / Avg: 315.36 / Max: 378.01 Min: 207.97 / Avg: 591.29 / Max: 755.19 Min: 82.06 / Avg: 312.54 / Max: 376.01 Min: 207.67 / Avg: 586.49 / Max: 753.26 Min: 103.02 / Avg: 483.56 / Max: 581.87 Min: 54.67 / Avg: 254.82 / Max: 291.9 Min: 65.5 / Avg: 555.22 / Max: 820.52 Min: 35.44 / Avg: 322.22 / Max: 410.64 Min: 29.24 / Avg: 271.69 / Max: 338.26 Min: 58.38 / Avg: 469.68 / Max: 682.7 Min: 22.1 / Avg: 264.41 / Max: 366.28 Min: 41.13 / Avg: 424.16 / Max: 725.4 Min: 18.31 / Avg: 151.62 / Max: 177.01 Min: 15.2 / Avg: 129.53 / Max: 151.58 Min: 105.14 / Avg: 347.52 / Max: 490.12 Min: 43.7 / Avg: 193.71 / Max: 235.48 Min: 43.55 / Avg: 250.35 / Max: 311.8 Min: 107.83 / Avg: 422.73 / Max: 622.38 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 13673 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 11553 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 12938 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 14902 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 17345 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 18921 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 15210 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 17008 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 30948 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 29984 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 11845 Joules per run. 12. EPYC 9684X: Approximate power consumption of 9881 Joules per run. 13. EPYC 9654: Approximate power consumption of 9147 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 10803 Joules per run. 15. EPYC 9754: Approximate power consumption of 7404 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 8907 Joules per run. 17. EPYC 8534P: Approximate power consumption of 7531 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 6995 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 10889 Joules per run. 20. Xeon 6766E: Approximate power consumption of 9621 Joules per run. 21. Xeon 6780E: Approximate power consumption of 11349 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 11977 Joules per run.
NAS Parallel Benchmarks NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: SP.C Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 80K 160K 240K 320K 400K SE +/- 1528.09, N = 5 SE +/- 31.76, N = 4 SE +/- 150.79, N = 3 SE +/- 560.20, N = 4 SE +/- 67.02, N = 3 SE +/- 679.14, N = 4 SE +/- 9.58, N = 3 SE +/- 420.81, N = 4 SE +/- 33.85, N = 3 SE +/- 11.99, N = 3 SE +/- 1666.53, N = 6 SE +/- 1178.78, N = 6 SE +/- 72.03, N = 4 SE +/- 1929.89, N = 5 SE +/- 126.50, N = 4 SE +/- 2064.71, N = 6 SE +/- 23.20, N = 3 SE +/- 14.31, N = 3 228184.68 109416.42 71245.26 147311.14 58815.36 135939.25 69776.41 141954.15 90420.25 37567.61 390520.93 225311.82 125191.11 256584.67 127519.37 214017.18 52745.64 52684.93 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6 Total Mop/s Per Watt
OpenBenchmarking.org Total Mop/s Per Watt, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: SP.C Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 200 400 600 800 1000 515.52 411.62 240.55 275.88 189.97 243.32 229.75 251.86 203.59 151.21 916.62 882.53 547.32 649.64 590.51 567.85 393.05 441.50 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better NAS Parallel Benchmarks 3.4 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 140 280 420 560 700 Min: 68.95 / Avg: 442.63 / Max: 754.48 Min: 26.78 / Avg: 265.82 / Max: 376.59 Min: 60.29 / Avg: 296.18 / Max: 370.22 Min: 158.17 / Avg: 533.96 / Max: 753.09 Min: 73.26 / Avg: 309.61 / Max: 365.04 Min: 187.62 / Avg: 558.68 / Max: 751.91 Min: 74.98 / Avg: 303.7 / Max: 376.9 Min: 183.64 / Avg: 563.63 / Max: 754.82 Min: 101.91 / Avg: 444.12 / Max: 565.31 Min: 52.53 / Avg: 248.45 / Max: 283.18 Min: 63.25 / Avg: 426.04 / Max: 818.12 Min: 32.04 / Avg: 255.3 / Max: 409.27 Min: 26 / Avg: 228.74 / Max: 319.02 Min: 56.6 / Avg: 394.96 / Max: 670.11 Min: 22.12 / Avg: 215.95 / Max: 323.68 Min: 41.44 / Avg: 376.89 / Max: 668.41 Min: 18.23 / Avg: 134.2 / Max: 159.66 Min: 17.36 / Avg: 119.33 / Max: 138.69 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 6905 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 5117 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 7701 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 9211 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 9185 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 9637 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 7896 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 9582 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 9623 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 10766 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 5113 Joules per run. 12. EPYC 9684X: Approximate power consumption of 2936 Joules per run. 13. EPYC 9654: Approximate power consumption of 3831 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 5529 Joules per run. 15. EPYC 9754: Approximate power consumption of 3779 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 7287 Joules per run. 17. EPYC 8534P: Approximate power consumption of 4339 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 3898 Joules per run.
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 200 400 600 800 1000 SE +/- 2.57, N = 3 SE +/- 10.06, N = 4 SE +/- 5.72, N = 3 SE +/- 4.81, N = 3 SE +/- 4.16, N = 3 SE +/- 1.77, N = 3 SE +/- 4.87, N = 3 SE +/- 1.98, N = 3 SE +/- 3.90, N = 3 SE +/- 1.09, N = 3 SE +/- 4.10, N = 3 SE +/- 5.53, N = 15 SE +/- 4.99, N = 15 SE +/- 2.35, N = 15 SE +/- 3.02, N = 15 SE +/- 2.41, N = 15 SE +/- 0.91, N = 3 SE +/- 5.34, N = 6 SE +/- 0.53, N = 3 SE +/- 1.50, N = 15 SE +/- 1.57, N = 3 SE +/- 0.77, N = 3 605.59 830.73 784.30 566.38 687.67 492.89 678.48 478.47 641.00 767.48 310.59 590.71 586.18 315.36 452.32 270.63 547.52 553.47 81.26 176.64 190.78 82.44 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 3 6 9 12 15 SE +/- 0.00701, N = 3 SE +/- 0.01491, N = 4 SE +/- 0.00936, N = 3 SE +/- 0.01492, N = 3 SE +/- 0.00884, N = 3 SE +/- 0.00720, N = 3 SE +/- 0.01053, N = 3 SE +/- 0.00871, N = 3 SE +/- 0.00943, N = 3 SE +/- 0.00184, N = 3 SE +/- 0.04200, N = 3 SE +/- 0.01586, N = 15 SE +/- 0.01428, N = 15 SE +/- 0.02296, N = 15 SE +/- 0.01454, N = 15 SE +/- 0.03210, N = 15 SE +/- 0.00301, N = 3 SE +/- 0.01684, N = 6 SE +/- 0.07940, N = 3 SE +/- 0.04869, N = 15 SE +/- 0.04327, N = 3 SE +/- 0.11179, N = 3 1.64919 1.20298 1.27368 1.76353 1.45280 2.02659 1.47249 2.08780 1.55821 1.30173 3.21781 1.69307 1.70579 3.17064 2.21020 3.69602 1.82443 1.80573 12.30210 5.66426 5.24051 12.12680 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.17 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 100 200 300 400 500 Min: 98.39 / Avg: 431.89 / Max: 460.51 Min: 53.65 / Avg: 232.18 / Max: 246.53 Min: 66.9 / Avg: 542.3 / Max: 581.73 Min: 35.49 / Avg: 275.71 / Max: 296 Min: 25.06 / Avg: 230.17 / Max: 246.35 Min: 57.19 / Avg: 475.21 / Max: 509.74 Min: 19.98 / Avg: 184.69 / Max: 197.9 Min: 39.85 / Avg: 399.31 / Max: 425.54 Min: 16.81 / Avg: 122.1 / Max: 130.96 Min: 17.47 / Avg: 111.54 / Max: 119.32 Min: 104.72 / Avg: 302.14 / Max: 319.15 Min: 43.72 / Avg: 141.66 / Max: 149.72 Min: 43.54 / Avg: 166.24 / Max: 176.01 Min: 108.06 / Avg: 346.02 / Max: 366.29 1. Xeon Platinum 8380 2P: Approximate power consumption of 27785 Joules per run. 2. Xeon Platinum 8380: Approximate power consumption of 14937 Joules per run. 3. EPYC 9684X 2P: Approximate power consumption of 34707 Joules per run. 4. EPYC 9684X: Approximate power consumption of 17664 Joules per run. 5. EPYC 9654: Approximate power consumption of 14747 Joules per run. 6. EPYC 9654 2P: Approximate power consumption of 30382 Joules per run. 7. EPYC 9754: Approximate power consumption of 11833 Joules per run. 8. EPYC 9754 2P: Approximate power consumption of 25556 Joules per run. 9. EPYC 8534P: Approximate power consumption of 7815 Joules per run. 10. EPYC 8534PN: Approximate power consumption of 7157 Joules per run. 11. Xeon 6766E 2P: Approximate power consumption of 19539 Joules per run. 12. Xeon 6766E: Approximate power consumption of 9113 Joules per run. 13. Xeon 6780E: Approximate power consumption of 10695 Joules per run. 14. Xeon 6780E 2P: Approximate power consumption of 22376 Joules per run.
ASTC Encoder ASTC Encoder (astcenc) is for the Adaptive Scalable Texture Compression (ASTC) format commonly used with OpenGL, OpenGL ES, and Vulkan graphics APIs. This test profile does a coding test of both compression/decompression. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org MT/s, More Is Better ASTC Encoder 4.7 Preset: Very Thorough Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 5 10 15 20 25 SE +/- 0.0007, N = 3 SE +/- 0.0294, N = 3 SE +/- 0.0054, N = 3 SE +/- 0.0379, N = 3 SE +/- 0.0016, N = 3 SE +/- 0.0055, N = 3 SE +/- 0.0016, N = 3 SE +/- 0.0022, N = 3 SE +/- 0.0026, N = 3 SE +/- 0.0075, N = 3 SE +/- 0.1284, N = 3 SE +/- 0.0254, N = 3 SE +/- 0.0006, N = 3 SE +/- 0.1965, N = 3 SE +/- 0.0006, N = 3 SE +/- 0.1961, N = 15 SE +/- 0.0007, N = 3 SE +/- 0.0012, N = 3 SE +/- 0.0386, N = 3 SE +/- 0.0005, N = 3 SE +/- 0.0005, N = 3 SE +/- 0.0314, N = 3 14.6334 7.6240 7.0885 13.7518 5.1342 10.2051 5.9702 11.8875 4.2935 2.1596 19.4052 10.3224 9.1844 17.0098 12.3187 22.0023 5.7420 5.2406 11.3573 5.8632 6.5166 12.6220 1. (CXX) g++ options: -O3 -flto -pthread MT/s Per Watt
OpenBenchmarking.org MT/s Per Watt, More Is Better ASTC Encoder 4.7 Preset: Very Thorough Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0117 0.0234 0.0351 0.0468 0.0585 0.028 0.026 0.023 0.025 0.016 0.017 0.019 0.020 0.009 0.008 0.036 0.032 0.034 0.036 0.047 0.052 0.038 0.041 0.033 0.030 0.026 0.030 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ASTC Encoder 4.7 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 71.14 / Avg: 526.63 / Max: 753.88 Min: 35.19 / Avg: 294.16 / Max: 378.5 Min: 61.31 / Avg: 301.81 / Max: 376.57 Min: 154.33 / Avg: 550 / Max: 755.26 Min: 74.02 / Avg: 315.87 / Max: 377.36 Min: 205.14 / Avg: 590.21 / Max: 754.13 Min: 87.45 / Avg: 313.77 / Max: 375.54 Min: 200.66 / Avg: 582.09 / Max: 758.49 Min: 97.89 / Avg: 488.29 / Max: 581.33 Min: 53.27 / Avg: 255.32 / Max: 291.21 Min: 64.98 / Avg: 538.44 / Max: 820.03 Min: 33 / Avg: 322.42 / Max: 410.63 Min: 25.96 / Avg: 270.94 / Max: 337.98 Min: 58.13 / Avg: 474.96 / Max: 673.2 Min: 21.13 / Avg: 262.17 / Max: 365.71 Min: 39.19 / Avg: 421.17 / Max: 704.37 Min: 18.13 / Avg: 151.45 / Max: 177.27 Min: 15.84 / Avg: 128.4 / Max: 151.19 Min: 104.49 / Avg: 346.65 / Max: 485.81 Min: 43.59 / Avg: 194.13 / Max: 235.38 Min: 43.52 / Avg: 249.37 / Max: 311.61 Min: 106.83 / Avg: 422.58 / Max: 617.03 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 14570 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 11864 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 12978 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 15217 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 17478 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 19477 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 15375 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 17463 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 31902 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 30894 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 12384 Joules per run. 12. EPYC 9684X: Approximate power consumption of 10210 Joules per run. 13. EPYC 9654: Approximate power consumption of 9212 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 11399 Joules per run. 15. EPYC 9754: Approximate power consumption of 7428 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 9490 Joules per run. 17. EPYC 8534P: Approximate power consumption of 7623 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 7019 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 11208 Joules per run. 20. Xeon 6766E: Approximate power consumption of 10030 Joules per run. 21. Xeon 6780E: Approximate power consumption of 11554 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 12536 Joules per run.
Speedb Speedb is a next-generation key value storage engine that is RocksDB compatible and aiming for stability, efficiency, and performance. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Op/s, More Is Better Speedb 2.7 Test: Random Read Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 300M 600M 900M 1200M 1500M SE +/- 5399265.88, N = 15 SE +/- 242146.75, N = 3 SE +/- 168680.90, N = 3 SE +/- 5393159.45, N = 3 SE +/- 3698537.65, N = 15 SE +/- 8491098.40, N = 15 SE +/- 2763560.64, N = 13 SE +/- 2955608.21, N = 3 SE +/- 706582.63, N = 3 SE +/- 232538.80, N = 3 SE +/- 5954964.38, N = 3 SE +/- 205170.43, N = 3 SE +/- 66268.38, N = 3 SE +/- 955915.20, N = 3 SE +/- 1606748.01, N = 3 SE +/- 2399164.12, N = 3 SE +/- 109015.29, N = 3 SE +/- 70537.88, N = 3 SE +/- 1272758.30, N = 3 SE +/- 998087.60, N = 3 SE +/- 1322733.50, N = 3 SE +/- 2674444.99, N = 3 586147871 315178381 276179617 551286958 211457048 419943570 244070674 497907490 259136466 130359145 1059546533 537633034 428557054 857687179 589951070 1169947385 274091778 242940110 1158496546 596955494 673159217 1324163340 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread Op/s Per Watt
OpenBenchmarking.org Op/s Per Watt, More Is Better Speedb 2.7 Test: Random Read Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 500K 1000K 1500K 2000K 2500K 894980.08 962315.70 834970.47 834394.35 680456.82 644065.87 744809.12 747196.35 506592.64 509439.26 1380809.63 1404496.49 1563545.14 1511464.50 1991742.68 1962564.72 1818446.43 2023204.53 2449964.81 2531402.05 2159153.28 2130388.24 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Speedb 2.7 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 68.16 / Avg: 654.93 / Max: 718.87 Min: 27.16 / Avg: 327.52 / Max: 377.21 Min: 54.25 / Avg: 330.77 / Max: 378.66 Min: 168.96 / Avg: 660.7 / Max: 755.23 Min: 71.79 / Avg: 310.76 / Max: 333.42 Min: 185.93 / Avg: 652.02 / Max: 753.16 Min: 70.78 / Avg: 327.7 / Max: 377.13 Min: 196.64 / Avg: 666.37 / Max: 752.39 Min: 103.26 / Avg: 511.53 / Max: 582.64 Min: 54.55 / Avg: 255.89 / Max: 290.77 Min: 69.56 / Avg: 767.34 / Max: 822.12 Min: 33.89 / Avg: 382.79 / Max: 411.07 Min: 29.2 / Avg: 274.09 / Max: 293.61 Min: 60.4 / Avg: 567.45 / Max: 609.28 Min: 22.11 / Avg: 296.2 / Max: 318.84 Min: 40.77 / Avg: 596.13 / Max: 648.34 Min: 18.42 / Avg: 150.73 / Max: 161.26 Min: 18.13 / Avg: 120.08 / Max: 129.07 Min: 105.77 / Avg: 472.86 / Max: 540.08 Min: 43.69 / Avg: 235.82 / Max: 270.43 Min: 43.47 / Avg: 311.77 / Max: 356.67 Min: 107.84 / Avg: 621.56 / Max: 712.89 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 42003 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 21180 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21169 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 42946 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 19909 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 41816 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 21451 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 42870 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 32908 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16462 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 48598 Joules per run. 12. EPYC 9684X: Approximate power consumption of 24626 Joules per run. 13. EPYC 9654: Approximate power consumption of 17542 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 36128 Joules per run. 15. EPYC 9754: Approximate power consumption of 18957 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 38152 Joules per run. 17. EPYC 8534P: Approximate power consumption of 9647 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 7725 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 30578 Joules per run. 20. Xeon 6766E: Approximate power consumption of 15171 Joules per run. 21. Xeon 6780E: Approximate power consumption of 20057 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 39987 Joules per run.
RocksDB This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Op/s, More Is Better RocksDB 9.0 Test: Random Read Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 300M 600M 900M 1200M 1500M SE +/- 82996.27, N = 3 SE +/- 1119855.47, N = 3 SE +/- 3338569.32, N = 3 SE +/- 1411218.60, N = 3 SE +/- 81327.78, N = 3 SE +/- 1120857.00, N = 3 SE +/- 86315.43, N = 3 SE +/- 785893.13, N = 3 SE +/- 704022.38, N = 3 SE +/- 744772.41, N = 3 SE +/- 2927744.32, N = 3 SE +/- 326038.01, N = 3 SE +/- 610621.13, N = 3 SE +/- 599126.55, N = 3 SE +/- 153963.59, N = 3 SE +/- 1154820.73, N = 3 SE +/- 206014.27, N = 3 SE +/- 211259.57, N = 3 SE +/- 4448269.22, N = 3 SE +/- 1336933.52, N = 3 SE +/- 2130676.22, N = 3 SE +/- 1897433.73, N = 3 578392800 297517946 265366170 525049998 205346154 405533173 234469939 473755946 251234103 125584953 1031209151 523310091 409272949 815145110 573235452 1135206564 266186537 234992636 1115720742 574749552 645309483 1272907561 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread Op/s Per Watt
OpenBenchmarking.org Op/s Per Watt, More Is Better RocksDB 9.0 Test: Random Read Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 500K 1000K 1500K 2000K 2500K 878232.54 904750.01 802721.25 791368.94 663946.02 608125.97 704496.50 709419.37 489869.48 490897.23 1341710.00 1362651.04 1523041.95 1477897.34 1957165.94 1907427.82 1780768.80 1972313.57 2359232.60 2436056.02 2069916.27 2038972.60 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better RocksDB 9.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 63.13 / Avg: 658.59 / Max: 754.12 Min: 25.38 / Avg: 328.84 / Max: 377.98 Min: 54.21 / Avg: 330.58 / Max: 378.42 Min: 145.71 / Avg: 663.47 / Max: 754.3 Min: 73.12 / Avg: 309.28 / Max: 327.48 Min: 186.94 / Avg: 666.86 / Max: 752.6 Min: 77.85 / Avg: 332.82 / Max: 365.47 Min: 195.53 / Avg: 667.81 / Max: 755.48 Min: 100.64 / Avg: 512.86 / Max: 581.28 Min: 53.91 / Avg: 255.83 / Max: 291.63 Min: 61.31 / Avg: 768.58 / Max: 822.92 Min: 33.04 / Avg: 384.04 / Max: 411.06 Min: 24.72 / Avg: 268.72 / Max: 291.05 Min: 53.06 / Avg: 551.56 / Max: 593.87 Min: 21.45 / Avg: 292.89 / Max: 315.65 Min: 40.42 / Avg: 595.15 / Max: 641.39 Min: 19.07 / Avg: 149.48 / Max: 159.86 Min: 18.15 / Avg: 119.15 / Max: 127.37 Min: 104.97 / Avg: 472.92 / Max: 541.33 Min: 43.66 / Avg: 235.93 / Max: 270.68 Min: 43.52 / Avg: 311.76 / Max: 357.69 Min: 107.45 / Avg: 624.29 / Max: 712.89 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 42369 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 21155 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21268 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 42904 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 19897 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 42679 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 21300 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 42740 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 32823 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16288 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 48933 Joules per run. 12. EPYC 9684X: Approximate power consumption of 24578 Joules per run. 13. EPYC 9654: Approximate power consumption of 17109 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 35116 Joules per run. 15. EPYC 9754: Approximate power consumption of 18745 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 37891 Joules per run. 17. EPYC 8534P: Approximate power consumption of 9567 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 7625 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 30582 Joules per run. 20. Xeon 6766E: Approximate power consumption of 15178 Joules per run. 21. Xeon 6780E: Approximate power consumption of 20056 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 40163 Joules per run.
TensorFlow This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 4 8 12 16 20 SE +/- 0.03, N = 15 SE +/- 0.05, N = 9 SE +/- 0.05, N = 4 SE +/- 0.06, N = 15 SE +/- 0.09, N = 4 SE +/- 0.07, N = 3 SE +/- 0.10, N = 4 SE +/- 0.04, N = 15 SE +/- 0.13, N = 15 SE +/- 0.08, N = 5 SE +/- 0.01, N = 3 SE +/- 0.09, N = 15 SE +/- 0.01, N = 4 SE +/- 0.06, N = 15 SE +/- 0.05, N = 15 SE +/- 0.03, N = 15 SE +/- 0.08, N = 15 SE +/- 0.08, N = 15 SE +/- 0.01, N = 15 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 3.85 6.43 10.53 4.39 11.29 5.11 9.99 4.37 9.13 17.82 3.92 8.96 9.01 3.66 6.19 2.47 10.79 10.70 1.76 4.67 5.02 1.99 images/sec Per Watt
OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0315 0.063 0.0945 0.126 0.1575 0.011 0.042 0.056 0.010 0.053 0.011 0.045 0.009 0.032 0.130 0.010 0.050 0.057 0.010 0.048 0.009 0.132 0.140 0.009 0.062 0.060 0.009 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.16.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 100 200 300 400 500 Min: 77.73 / Avg: 351.48 / Max: 431.04 Min: 26.03 / Avg: 152.5 / Max: 203.99 Min: 59.45 / Avg: 188.55 / Max: 248.97 Min: 139.48 / Avg: 455.97 / Max: 550.2 Min: 74.86 / Avg: 214.64 / Max: 277.01 Min: 196.38 / Avg: 479.87 / Max: 557.8 Min: 74.4 / Avg: 220.35 / Max: 283.28 Min: 193.89 / Avg: 495.88 / Max: 584.14 Min: 98.96 / Avg: 285.87 / Max: 395.19 Min: 49.72 / Avg: 137.42 / Max: 216.79 Min: 64.93 / Avg: 389.7 / Max: 463.09 Min: 32.53 / Avg: 179.99 / Max: 250.99 Min: 29.81 / Avg: 157.26 / Max: 218.19 Min: 55.24 / Avg: 357.87 / Max: 424.3 Min: 20.21 / Avg: 128.28 / Max: 166.19 Min: 39.45 / Avg: 288.27 / Max: 343.12 Min: 16.58 / Avg: 81.51 / Max: 118.9 Min: 15.23 / Avg: 76.32 / Max: 109.67 Min: 103.83 / Avg: 203.64 / Max: 238.14 Min: 43.57 / Avg: 74.94 / Max: 90.44 Min: 43.51 / Avg: 83.13 / Max: 101.84 Min: 104.65 / Avg: 212.41 / Max: 239.17 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 12770 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 3779 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 3535 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 15169 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 3864 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 14556 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 4297 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 16595 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 5984 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 2061 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 14159 Joules per run. 12. EPYC 9684X: Approximate power consumption of 3648 Joules per run. 13. EPYC 9654: Approximate power consumption of 3224 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 13670 Joules per run. 15. EPYC 9754: Approximate power consumption of 3438 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 15432 Joules per run. 17. EPYC 8534P: Approximate power consumption of 1560 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1476 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 15042 Joules per run. 20. Xeon 6766E: Approximate power consumption of 2573 Joules per run. 21. Xeon 6780E: Approximate power consumption of 2660 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 14161 Joules per run.
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 1400 2800 4200 5600 7000 SE +/- 3.43, N = 3 SE +/- 0.73, N = 3 SE +/- 1.46, N = 3 SE +/- 2.46, N = 3 SE +/- 3.41, N = 3 SE +/- 1.09, N = 3 SE +/- 4.55, N = 3 SE +/- 2.81, N = 3 SE +/- 9.58, N = 15 SE +/- 4.60, N = 3 SE +/- 13.59, N = 3 SE +/- 4.06, N = 3 SE +/- 4.84, N = 3 SE +/- 9.83, N = 3 SE +/- 7.27, N = 3 SE +/- 14.68, N = 3 SE +/- 3.51, N = 3 SE +/- 0.47, N = 3 SE +/- 1.20, N = 3 SE +/- 1.73, N = 3 SE +/- 0.61, N = 3 SE +/- 3.81, N = 3 5570.63 2924.66 1643.43 4744.05 2074.30 3998.02 2243.84 4351.59 1313.39 637.76 5766.62 2986.33 2739.01 5178.29 3280.25 6400.94 1542.61 1396.78 1593.88 832.29 934.97 1826.82 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
FFmpeg This is a benchmark of the FFmpeg multimedia framework. The FFmpeg test profile is making use of a modified version of vbench from Columbia University's Architecture and Design Lab (ARCADE) [http://arcade.cs.columbia.edu/vbench/] that is a benchmark for video-as-a-service workloads. The test profile offers the options of a range of vbench scenarios based on freely distributable video content and offers the options of using the x264 or x265 video encoders for transcoding. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Upload Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 7 14 21 28 35 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 SE +/- 0.00, N = 3 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 26.80 26.93 24.97 24.56 23.33 22.34 23.77 23.30 21.73 21.96 27.43 27.61 27.66 26.41 23.36 23.28 23.25 23.27 13.90 14.01 15.47 14.87 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma FPS Per Watt
OpenBenchmarking.org FPS Per Watt, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Upload Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0826 0.1652 0.2478 0.3304 0.413 0.095 0.179 0.142 0.069 0.108 0.052 0.110 0.054 0.097 0.167 0.098 0.210 0.237 0.104 0.258 0.113 0.354 0.367 0.121 0.270 0.283 0.121 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better FFmpeg 7.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 90 180 270 360 450 Min: 74.8 / Avg: 282.67 / Max: 421.23 Min: 33.49 / Avg: 150.78 / Max: 267.25 Min: 59.92 / Avg: 175.77 / Max: 260.15 Min: 169.76 / Avg: 355.39 / Max: 439.92 Min: 77.87 / Avg: 215.12 / Max: 282.66 Min: 200.59 / Avg: 429.86 / Max: 523.1 Min: 73.34 / Avg: 216.54 / Max: 288.18 Min: 200.89 / Avg: 428.04 / Max: 517.82 Min: 101.47 / Avg: 224.76 / Max: 314.49 Min: 54.29 / Avg: 131.33 / Max: 221.85 Min: 60.82 / Avg: 280.31 / Max: 349.69 Min: 32.37 / Avg: 131.52 / Max: 197.98 Min: 28.66 / Avg: 116.46 / Max: 162.4 Min: 57.5 / Avg: 253.71 / Max: 316.9 Min: 21.11 / Avg: 90.52 / Max: 130.74 Min: 40.21 / Avg: 205.67 / Max: 248.29 Min: 17.2 / Avg: 65.65 / Max: 103.63 Min: 16.42 / Avg: 63.46 / Max: 99.36 Min: 103.98 / Avg: 114.66 / Max: 149.44 Min: 21.91 / Avg: 51.98 / Max: 83.48 Min: 26.8 / Avg: 54.72 / Max: 93.15 Min: 105.83 / Avg: 122.91 / Max: 188.11 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 47960 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 25381 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 32458 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 66576 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 41303 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 84540 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 41071 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 82326 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 45701 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 26485 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 45690 Joules per run. 12. EPYC 9684X: Approximate power consumption of 21437 Joules per run. 13. EPYC 9654: Approximate power consumption of 18984 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 42285 Joules per run. 15. EPYC 9754: Approximate power consumption of 17440 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 39625 Joules per run. 17. EPYC 8534P: Approximate power consumption of 12671 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 12248 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 33022 Joules per run. 20. Xeon 6766E: Approximate power consumption of 14848 Joules per run. 21. Xeon 6780E: Approximate power consumption of 14154 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 32736 Joules per run.
ClickHouse ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 SE +/- 4.12, N = 5 SE +/- 4.18, N = 6 SE +/- 3.41, N = 3 SE +/- 4.37, N = 3 SE +/- 2.85, N = 3 SE +/- 1.35, N = 3 SE +/- 5.88, N = 3 SE +/- 3.85, N = 12 SE +/- 1.56, N = 3 SE +/- 1.56, N = 3 SE +/- 4.34, N = 3 SE +/- 7.88, N = 3 SE +/- 5.33, N = 3 SE +/- 6.05, N = 3 SE +/- 2.78, N = 3 SE +/- 4.49, N = 5 SE +/- 1.57, N = 3 SE +/- 1.88, N = 3 SE +/- 1.51, N = 3 SE +/- 2.21, N = 3 SE +/- 1.12, N = 3 SE +/- 3.71, N = 3 423.30 437.20 465.50 485.63 446.40 491.89 461.62 460.66 285.17 326.65 513.92 566.31 536.82 504.84 433.79 411.26 323.59 322.69 311.63 365.62 388.29 333.06
Timed FFmpeg Compilation This test times how long it takes to build the FFmpeg multimedia library. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Timed FFmpeg Compilation 7.0 Time To Compile Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 8 16 24 32 40 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.11, N = 3 SE +/- 0.30, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 17.39 21.36 24.06 19.51 26.46 20.79 24.84 20.01 25.94 34.29 17.84 19.99 20.49 18.09 23.22 21.22 27.54 28.42 25.71 27.85 25.24 23.32 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Timed FFmpeg Compilation 7.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 85.35 / Avg: 348.01 / Max: 755.27 Min: 34.1 / Avg: 198.27 / Max: 377.58 Min: 57.21 / Avg: 220.08 / Max: 376.48 Min: 157.82 / Avg: 400.67 / Max: 753.15 Min: 74.35 / Avg: 250.86 / Max: 374.99 Min: 208.48 / Avg: 470.97 / Max: 753.46 Min: 81.57 / Avg: 251.37 / Max: 376.37 Min: 198.1 / Avg: 467.2 / Max: 752.99 Min: 98.24 / Avg: 301.65 / Max: 581.66 Min: 52.91 / Avg: 184.1 / Max: 291.84 Min: 65.37 / Avg: 314.5 / Max: 819.41 Min: 32.76 / Avg: 171.98 / Max: 410.22 Min: 28.44 / Avg: 151.49 / Max: 345.46 Min: 55.22 / Avg: 281.94 / Max: 701.16 Min: 21.46 / Avg: 124.42 / Max: 336.98 Min: 39.64 / Avg: 238.4 / Max: 679.1 Min: 17.56 / Avg: 90.17 / Max: 171.06 Min: 17.2 / Avg: 81.55 / Max: 145.14 Min: 103.98 / Avg: 158.14 / Max: 527.88 Min: 43.59 / Avg: 88.1 / Max: 260.1 Min: 43.39 / Avg: 101.96 / Max: 321.98 Min: 55.1 / Avg: 172.28 / Max: 647.64 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 8700 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 5618 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 6896 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 10952 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 8278 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 13030 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 7876 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 12459 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 9955 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 7548 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 7863 Joules per run. 12. EPYC 9684X: Approximate power consumption of 4701 Joules per run. 13. EPYC 9654: Approximate power consumption of 4191 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 7330 Joules per run. 15. EPYC 9754: Approximate power consumption of 3898 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 6993 Joules per run. 17. EPYC 8534P: Approximate power consumption of 3186 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 2963 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 5377 Joules per run. 20. Xeon 6766E: Approximate power consumption of 3172 Joules per run. 21. Xeon 6780E: Approximate power consumption of 3331 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 5398 Joules per run.
TensorFlow This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 30 60 90 120 150 SE +/- 0.70, N = 3 SE +/- 0.50, N = 3 SE +/- 0.04, N = 3 SE +/- 1.12, N = 3 SE +/- 0.13, N = 3 SE +/- 0.39, N = 3 SE +/- 0.93, N = 3 SE +/- 1.28, N = 3 SE +/- 1.42, N = 3 SE +/- 0.36, N = 3 SE +/- 1.04, N = 4 SE +/- 0.08, N = 3 SE +/- 0.64, N = 3 SE +/- 0.91, N = 5 SE +/- 0.60, N = 3 SE +/- 0.88, N = 3 SE +/- 0.05, N = 3 SE +/- 0.11, N = 3 SE +/- 0.56, N = 3 SE +/- 0.04, N = 3 SE +/- 0.14, N = 3 SE +/- 0.76, N = 3 94.66 91.51 120.93 115.47 104.23 111.71 103.56 107.30 108.32 90.72 86.08 104.52 114.63 82.94 106.14 67.08 87.31 80.86 61.48 71.41 76.37 68.52 images/sec Per Watt
OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.1472 0.2944 0.4416 0.5888 0.736 0.202 0.382 0.398 0.202 0.330 0.186 0.326 0.178 0.236 0.362 0.159 0.354 0.448 0.170 0.477 0.179 0.610 0.654 0.186 0.423 0.378 0.188 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.16.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 Min: 81.35 / Avg: 469.58 / Max: 533.37 Min: 35.02 / Avg: 239.37 / Max: 274.93 Min: 57.29 / Avg: 303.56 / Max: 335.19 Min: 158.09 / Avg: 571.99 / Max: 633.85 Min: 73.44 / Avg: 315.74 / Max: 344.17 Min: 206.91 / Avg: 601.85 / Max: 661.69 Min: 75.88 / Avg: 317.98 / Max: 346.3 Min: 193.17 / Avg: 603.74 / Max: 661.05 Min: 104.27 / Avg: 458.39 / Max: 515.43 Min: 51.52 / Avg: 250.55 / Max: 277.16 Min: 66.65 / Avg: 542.07 / Max: 602.63 Min: 33.94 / Avg: 295.36 / Max: 331.29 Min: 28.64 / Avg: 256.02 / Max: 290.14 Min: 53.67 / Avg: 487.46 / Max: 539.03 Min: 19.21 / Avg: 222.65 / Max: 256.54 Min: 40.87 / Avg: 375.57 / Max: 410.97 Min: 17.24 / Avg: 143.22 / Max: 160.51 Min: 15.94 / Avg: 123.62 / Max: 139.7 Min: 104.2 / Avg: 330.36 / Max: 365.9 Min: 43.68 / Avg: 168.94 / Max: 189.35 Min: 43.53 / Avg: 201.8 / Max: 232.09 Min: 53.44 / Avg: 364.61 / Max: 411.61 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 39445 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 20585 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 20440 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 40992 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 24627 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 44136 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 24696 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 46689 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 34685 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 21631 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 49464 Joules per run. 12. EPYC 9684X: Approximate power consumption of 22448 Joules per run. 13. EPYC 9654: Approximate power consumption of 18007 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 46016 Joules per run. 15. EPYC 9754: Approximate power consumption of 16996 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 43566 Joules per run. 17. EPYC 8534P: Approximate power consumption of 12938 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 11950 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 42947 Joules per run. 20. Xeon 6766E: Approximate power consumption of 18752 Joules per run. 21. Xeon 6780E: Approximate power consumption of 20987 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 42781 Joules per run.
Timed Godot Game Engine Compilation This test times how long it takes to compile the Godot Game Engine. Godot is a popular, open-source, cross-platform 2D/3D game engine and is built using the SCons build system and targeting the X11 platform. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Timed Godot Game Engine Compilation 4.0 Time To Compile Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 40 80 120 160 200 SE +/- 0.29, N = 3 SE +/- 0.91, N = 3 SE +/- 0.76, N = 3 SE +/- 0.56, N = 3 SE +/- 0.18, N = 3 SE +/- 0.56, N = 3 SE +/- 0.32, N = 3 SE +/- 1.69, N = 3 SE +/- 0.69, N = 3 SE +/- 0.22, N = 3 SE +/- 0.62, N = 3 SE +/- 0.12, N = 3 SE +/- 0.16, N = 3 SE +/- 0.06, N = 3 SE +/- 0.20, N = 3 SE +/- 0.55, N = 3 SE +/- 0.32, N = 3 SE +/- 0.16, N = 3 SE +/- 0.64, N = 3 SE +/- 0.16, N = 3 SE +/- 0.73, N = 3 SE +/- 1.40, N = 3 103.38 122.72 140.23 118.57 149.38 123.88 143.81 122.70 151.54 187.88 96.16 103.35 111.69 102.58 128.28 126.11 154.01 159.62 160.46 165.41 152.23 148.99 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Timed Godot Game Engine Compilation 4.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 82.98 / Avg: 430.41 / Max: 750.75 Min: 33.4 / Avg: 236.2 / Max: 374.96 Min: 55.69 / Avg: 255.97 / Max: 375.31 Min: 154.59 / Avg: 461.39 / Max: 752.04 Min: 76.87 / Avg: 285.63 / Max: 375.65 Min: 199.22 / Avg: 527.95 / Max: 724.51 Min: 82.82 / Avg: 282.51 / Max: 375.66 Min: 197.93 / Avg: 519.6 / Max: 744.47 Min: 97.52 / Avg: 352.55 / Max: 559.9 Min: 50.66 / Avg: 217.11 / Max: 290.99 Min: 65.36 / Avg: 383.39 / Max: 820.55 Min: 33.53 / Avg: 222.04 / Max: 410.61 Min: 24.79 / Avg: 188.63 / Max: 336.96 Min: 58.53 / Avg: 338.4 / Max: 689.21 Min: 18.92 / Avg: 152.32 / Max: 333.75 Min: 39.69 / Avg: 276.98 / Max: 673.64 Min: 18.58 / Avg: 110.14 / Max: 169.2 Min: 16.76 / Avg: 97.75 / Max: 142.01 Min: 103.92 / Avg: 184.93 / Max: 507.62 Min: 43.52 / Avg: 109.04 / Max: 243.23 Min: 43.34 / Avg: 124.67 / Max: 295.77 Min: 106.86 / Avg: 202.24 / Max: 626.79 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 47202 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 31808 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 37371 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 57674 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 44367 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 68458 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 42188 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 66683 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 55350 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 42119 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 39105 Joules per run. 12. EPYC 9684X: Approximate power consumption of 24203 Joules per run. 13. EPYC 9654: Approximate power consumption of 22133 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 36434 Joules per run. 15. EPYC 9754: Approximate power consumption of 20411 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 36469 Joules per run. 17. EPYC 8534P: Approximate power consumption of 17622 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 16193 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 30822 Joules per run. 20. Xeon 6766E: Approximate power consumption of 18719 Joules per run. 21. Xeon 6780E: Approximate power consumption of 19739 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 31483 Joules per run.
GNU Octave Benchmark This test profile measures how long it takes to complete several reference GNU Octave files via octave-benchmark. GNU Octave is used for numerical computations and is an open-source alternative to MATLAB. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better GNU Octave Benchmark 8.4.0 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 3 6 9 12 15 SE +/- 0.019, N = 6 SE +/- 0.020, N = 6 SE +/- 0.015, N = 6 SE +/- 0.019, N = 6 SE +/- 0.015, N = 6 SE +/- 0.096, N = 5 SE +/- 0.024, N = 6 SE +/- 0.082, N = 5 SE +/- 0.052, N = 5 SE +/- 0.017, N = 5 SE +/- 0.007, N = 6 SE +/- 0.018, N = 6 SE +/- 0.009, N = 6 SE +/- 0.004, N = 6 SE +/- 0.014, N = 5 SE +/- 0.025, N = 5 SE +/- 0.011, N = 5 SE +/- 0.007, N = 5 SE +/- 0.023, N = 5 SE +/- 0.035, N = 5 SE +/- 0.051, N = 5 SE +/- 0.108, N = 7 6.856 6.458 7.532 8.036 7.622 12.617 7.748 12.578 9.694 9.104 6.955 6.857 7.528 7.645 8.801 8.848 8.929 8.948 12.245 10.996 10.243 11.619 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better GNU Octave Benchmark 8.4.0 CPU Power Consumption Monitor Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 80 160 240 320 400 Min: 32.85 / Avg: 108.34 / Max: 202.86 Min: 56.04 / Avg: 133.36 / Max: 217.89 Min: 167.67 / Avg: 296.93 / Max: 375.38 Min: 74.85 / Avg: 164.13 / Max: 237.93 Min: 202.03 / Avg: 373.8 / Max: 446.62 Min: 79.51 / Avg: 166.55 / Max: 232.48 Min: 197.53 / Avg: 371.49 / Max: 456.41 Min: 99.24 / Avg: 180.92 / Max: 246.72 Min: 53.19 / Avg: 97.85 / Max: 151.32 Min: 61.74 / Avg: 205.11 / Max: 301.54 Min: 34.49 / Avg: 95.8 / Max: 154.31 Min: 27.81 / Avg: 84.26 / Max: 135.67 Min: 56.62 / Avg: 189.57 / Max: 270.57 Min: 20.26 / Avg: 67.77 / Max: 105.08 Min: 40.57 / Avg: 161.36 / Max: 222.38 Min: 17.25 / Avg: 49.95 / Max: 77.01 Min: 15.49 / Avg: 47.63 / Max: 72.89 Min: 103.69 / Avg: 114.72 / Max: 127.74 Min: 43.6 / Avg: 52.88 / Max: 68.56 Min: 43.45 / Avg: 55 / Max: 74.81 Min: 104.36 / Avg: 116.68 / Max: 139.31 1. Xeon Platinum 8592+: Approximate power consumption of 1156 Joules per run. 2. Xeon Platinum 8490H: Approximate power consumption of 1556 Joules per run. 3. Xeon Platinum 8490H 2P: Approximate power consumption of 3613 Joules per run. 4. Xeon Max 9468: Approximate power consumption of 1915 Joules per run. 5. Xeon Max 9468 2P: Approximate power consumption of 6280 Joules per run. 6. Xeon Max 9480: Approximate power consumption of 1971 Joules per run. 7. Xeon Max 9480 2P: Approximate power consumption of 6167 Joules per run. 8. Xeon Platinum 8380 2P: Approximate power consumption of 2461 Joules per run. 9. Xeon Platinum 8380: Approximate power consumption of 1292 Joules per run. 10. EPYC 9684X 2P: Approximate power consumption of 2256 Joules per run. 11. EPYC 9684X: Approximate power consumption of 1054 Joules per run. 12. EPYC 9654: Approximate power consumption of 983 Joules per run. 13. EPYC 9654 2P: Approximate power consumption of 2212 Joules per run. 14. EPYC 9754: Approximate power consumption of 867 Joules per run. 15. EPYC 9754 2P: Approximate power consumption of 2065 Joules per run. 16. EPYC 8534P: Approximate power consumption of 649 Joules per run. 17. EPYC 8534PN: Approximate power consumption of 629 Joules per run. 18. Xeon 6766E 2P: Approximate power consumption of 1858 Joules per run. 19. Xeon 6766E: Approximate power consumption of 793 Joules per run. 20. Xeon 6780E: Approximate power consumption of 781 Joules per run. 21. Xeon 6780E 2P: Approximate power consumption of 1817 Joules per run.
Appleseed Appleseed is an open-source production renderer focused on physically-based global illumination rendering engine primarily designed for animation and visual effects. Learn more via the OpenBenchmarking.org test page.
Scene: Disney Material
EPYC 9684X 2P: The test run did not produce a result.
EPYC 9654 2P: The test run did not produce a result.
EPYC 9754 2P: The test run did not produce a result.
Xeon 6766E 2P: The test run did not produce a result.
Xeon 6780E 2P: The test run did not produce a result.
Liquid-DSP LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 57 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 600M 1200M 1800M 2400M 3000M SE +/- 32405829.38, N = 3 SE +/- 11426868.92, N = 3 SE +/- 7076957.92, N = 3 SE +/- 28500058.48, N = 3 SE +/- 2629533.12, N = 3 SE +/- 28812627.44, N = 4 SE +/- 5493127.02, N = 3 SE +/- 27382304.50, N = 5 SE +/- 25737283.81, N = 3 SE +/- 4885465.97, N = 3 SE +/- 8732315.46, N = 3 SE +/- 8476044.68, N = 3 SE +/- 3786085.64, N = 3 SE +/- 10590929.03, N = 3 SE +/- 8567444.84, N = 3 SE +/- 17457503.96, N = 3 SE +/- 4914717.13, N = 3 SE +/- 7776531.65, N = 3 SE +/- 4223873.95, N = 3 SE +/- 1953913.45, N = 3 SE +/- 1361779.88, N = 3 SE +/- 7523814.04, N = 3 2620066667 2475500000 2539200000 2655500000 2138766667 2494050000 2308966667 2491340000 1999266667 1469166667 2772800000 2862000000 2859833333 2730233333 2444933333 2374766667 2186833333 2026333333 1852366667 1906266667 2099033333 2036733333 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid samples/s Per Watt
OpenBenchmarking.org samples/s Per Watt, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 57 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 4M 8M 12M 16M 20M 5119414.53 8044246.29 8050132.03 4994066.82 6748464.67 3917514.64 7252530.07 3870621.21 4681614.53 5987302.63 6245758.05 9250164.53 10813033.93 6982683.34 12777153.28 8048978.36 16817799.69 18884627.20 9063033.04 14237235.02 12897729.09 8820935.85 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Liquid-DSP 1.6 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 67.62 / Avg: 511.79 / Max: 675.09 Min: 27.41 / Avg: 307.74 / Max: 373.74 Min: 60.17 / Avg: 315.42 / Max: 375.58 Min: 154.62 / Avg: 531.73 / Max: 660.07 Min: 74.72 / Avg: 316.93 / Max: 377.16 Min: 203.4 / Avg: 636.64 / Max: 709.85 Min: 76.69 / Avg: 318.37 / Max: 376.42 Min: 206.33 / Avg: 643.65 / Max: 732.46 Min: 101.13 / Avg: 427.05 / Max: 542.12 Min: 52.59 / Avg: 245.38 / Max: 291.79 Min: 64 / Avg: 443.95 / Max: 498.34 Min: 32.57 / Avg: 309.4 / Max: 348.95 Min: 27.79 / Avg: 264.48 / Max: 300.86 Min: 54.92 / Avg: 391 / Max: 447.88 Min: 18.99 / Avg: 191.35 / Max: 215.83 Min: 37.21 / Avg: 295.04 / Max: 331.11 Min: 17.61 / Avg: 130.03 / Max: 147.65 Min: 16.16 / Avg: 107.3 / Max: 126.15 Min: 104.16 / Avg: 204.39 / Max: 225.35 Min: 43.66 / Avg: 133.68 / Max: 150 Min: 43.55 / Avg: 162.74 / Max: 182.74 Min: 107.02 / Avg: 230.9 / Max: 255.6 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 17401 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 10668 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 10830 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 18256 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 10881 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 21487 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 10824 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 21755 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 14662 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 8343 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 15094 Joules per run. 12. EPYC 9684X: Approximate power consumption of 10520 Joules per run. 13. EPYC 9654: Approximate power consumption of 8992 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 13164 Joules per run. 15. EPYC 9754: Approximate power consumption of 6506 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 10130 Joules per run. 17. EPYC 8534P: Approximate power consumption of 4421 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 3684 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 6949 Joules per run. 20. Xeon 6766E: Approximate power consumption of 4590 Joules per run. 21. Xeon 6780E: Approximate power consumption of 5533 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 7851 Joules per run.
Zstd Compression This test measures the time needed to compress/decompress a sample file (silesia.tar) using Zstd (Zstandard) compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19 - Decompression Speed Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 300 600 900 1200 1500 SE +/- 1.88, N = 3 SE +/- 3.01, N = 4 SE +/- 4.45, N = 3 SE +/- 4.96, N = 3 SE +/- 2.12, N = 3 SE +/- 0.66, N = 15 SE +/- 1.08, N = 15 SE +/- 0.65, N = 15 SE +/- 1.74, N = 4 SE +/- 1.75, N = 3 SE +/- 1.73, N = 3 SE +/- 7.31, N = 3 SE +/- 0.46, N = 3 SE +/- 2.20, N = 3 SE +/- 0.83, N = 3 SE +/- 1.83, N = 3 SE +/- 21.23, N = 3 SE +/- 1.58, N = 3 SE +/- 5.06, N = 3 SE +/- 2.22, N = 3 SE +/- 5.13, N = 3 SE +/- 2.25, N = 3 1165.8 1221.8 1032.0 963.6 1126.4 1040.2 1127.5 1039.2 900.5 1032.4 1392.5 1385.3 1388.9 1382.1 1139.9 1139.0 1118.8 1144.8 721.4 743.5 816.7 774.4 1. (CC) gcc options: -O3 -pthread -lz -llzma MB/s Per Watt
OpenBenchmarking.org MB/s Per Watt, More Is Better Zstd Compression 1.5.4 Compression Level: 19 - Decompression Speed Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 5 10 15 20 25 4.008 8.705 6.465 2.828 5.616 2.506 5.548 2.520 4.454 9.439 5.292 11.711 13.308 5.818 14.065 5.875 19.698 20.546 5.845 12.746 13.679 6.162 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Zstd Compression 1.5.4 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 80 160 240 320 400 Min: 76.44 / Avg: 290.84 / Max: 334.48 Min: 33.62 / Avg: 140.35 / Max: 172.45 Min: 61.06 / Avg: 159.64 / Max: 183.39 Min: 170.25 / Avg: 340.73 / Max: 371.6 Min: 73.69 / Avg: 200.55 / Max: 225.84 Min: 203.74 / Avg: 415.14 / Max: 451.39 Min: 75.37 / Avg: 203.22 / Max: 228.29 Min: 197.43 / Avg: 412.33 / Max: 448.69 Min: 98.06 / Avg: 202.2 / Max: 229.76 Min: 50.67 / Avg: 109.38 / Max: 135.43 Min: 60.19 / Avg: 263.13 / Max: 287.32 Min: 33.68 / Avg: 118.29 / Max: 136.36 Min: 27.93 / Avg: 104.36 / Max: 120.51 Min: 59.25 / Avg: 237.56 / Max: 259.24 Min: 21.5 / Avg: 81.05 / Max: 92.77 Min: 38.29 / Avg: 193.87 / Max: 209.99 Min: 16.44 / Avg: 56.8 / Max: 67.51 Min: 16.36 / Avg: 55.72 / Max: 65.47 Min: 103.62 / Avg: 123.42 / Max: 157.28 Min: 43.62 / Avg: 58.33 / Max: 74.24 Min: 43.45 / Avg: 59.7 / Max: 75.66 Min: 104.87 / Avg: 125.62 / Max: 159.28 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 21231 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 10140 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 12718 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 27600 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 15175 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 28202 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 14239 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 28781 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 15873 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 7328 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 20436 Joules per run. 12. EPYC 9684X: Approximate power consumption of 8596 Joules per run. 13. EPYC 9654: Approximate power consumption of 7584 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 17976 Joules per run. 15. EPYC 9754: Approximate power consumption of 5403 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 12989 Joules per run. 17. EPYC 8534P: Approximate power consumption of 3787 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 3715 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 9668 Joules per run. 20. Xeon 6766E: Approximate power consumption of 4453 Joules per run. 21. Xeon 6780E: Approximate power consumption of 4358 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 9338 Joules per run.
TensorFlow This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 40 80 120 160 200 SE +/- 0.61, N = 3 SE +/- 0.48, N = 3 SE +/- 0.01, N = 3 SE +/- 1.39, N = 3 SE +/- 1.17, N = 3 SE +/- 0.79, N = 3 SE +/- 0.61, N = 3 SE +/- 1.80, N = 3 SE +/- 0.21, N = 3 SE +/- 0.08, N = 3 SE +/- 0.31, N = 3 SE +/- 1.42, N = 4 SE +/- 0.34, N = 3 SE +/- 1.83, N = 3 SE +/- 1.62, N = 4 SE +/- 0.81, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.93, N = 9 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 1.22, N = 3 169.75 140.53 148.45 174.95 117.53 145.29 125.14 138.39 127.97 91.75 137.50 121.96 140.01 161.90 135.17 174.93 101.17 95.63 113.42 91.96 97.67 124.60 images/sec Per Watt
OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.16 0.32 0.48 0.64 0.8 0.290 0.469 0.433 0.258 0.343 0.212 0.364 0.202 0.254 0.349 0.227 0.385 0.487 0.296 0.553 0.366 0.659 0.711 0.257 0.441 0.383 0.246 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.16.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 83.43 / Avg: 585.9 / Max: 658.36 Min: 33.86 / Avg: 299.63 / Max: 330.67 Min: 61.57 / Avg: 342.65 / Max: 363.24 Min: 161.89 / Avg: 678.16 / Max: 719.66 Min: 74.91 / Avg: 342.39 / Max: 362.9 Min: 207.09 / Avg: 684.53 / Max: 724.92 Min: 85.58 / Avg: 343.75 / Max: 366.49 Min: 208.64 / Avg: 684.02 / Max: 721.63 Min: 102.54 / Avg: 504.58 / Max: 542.99 Min: 53.71 / Avg: 263.16 / Max: 276.44 Min: 66.7 / Avg: 606.04 / Max: 658.36 Min: 35.54 / Avg: 316.96 / Max: 353.37 Min: 30.39 / Avg: 287.56 / Max: 321.33 Min: 59.62 / Avg: 547.08 / Max: 589.2 Min: 20.9 / Avg: 244.22 / Max: 295.24 Min: 40.89 / Avg: 478.51 / Max: 540.78 Min: 18.7 / Avg: 153.51 / Max: 165.78 Min: 16.14 / Avg: 134.5 / Max: 142.97 Min: 106.33 / Avg: 441.95 / Max: 500.12 Min: 43.69 / Avg: 208.71 / Max: 235.06 Min: 43.51 / Avg: 255.22 / Max: 299.17 Min: 108.05 / Avg: 506.95 / Max: 588.39 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 205455 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 124546 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 134663 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 232837 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 170850 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 279287 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 161103 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 296866 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 232275 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 164827 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 254737 Joules per run. 12. EPYC 9684X: Approximate power consumption of 148177 Joules per run. 13. EPYC 9654: Approximate power consumption of 117803 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 196584 Joules per run. 15. EPYC 9754: Approximate power consumption of 102574 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 161257 Joules per run. 17. EPYC 8534P: Approximate power consumption of 87397 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 81147 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 234921 Joules per run. 20. Xeon 6766E: Approximate power consumption of 132047 Joules per run. 21. Xeon 6780E: Approximate power consumption of 152029 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 245873 Joules per run.
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 8 16 24 32 40 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.10, N = 3 SE +/- 0.34, N = 3 SE +/- 0.07, N = 3 SE +/- 0.19, N = 3 SE +/- 0.05, N = 3 SE +/- 0.24, N = 3 SE +/- 0.08, N = 3 SE +/- 0.19, N = 3 SE +/- 0.36, N = 3 SE +/- 0.05, N = 3 SE +/- 0.33, N = 4 SE +/- 0.24, N = 7 SE +/- 0.14, N = 3 SE +/- 0.25, N = 3 SE +/- 0.22, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 31.71 33.38 32.34 30.04 28.52 24.73 28.48 24.68 25.96 28.09 24.05 28.73 29.84 25.63 27.45 26.33 27.94 27.87 17.62 23.31 26.03 18.43 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 13 26 39 52 65 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.13, N = 3 SE +/- 0.55, N = 3 SE +/- 0.08, N = 3 SE +/- 0.32, N = 3 SE +/- 0.07, N = 3 SE +/- 0.30, N = 3 SE +/- 0.15, N = 3 SE +/- 0.22, N = 3 SE +/- 0.41, N = 3 SE +/- 0.07, N = 3 SE +/- 0.43, N = 4 SE +/- 0.35, N = 7 SE +/- 0.18, N = 3 SE +/- 0.33, N = 3 SE +/- 0.71, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 31.53 29.96 30.92 33.29 35.07 40.45 35.11 40.52 38.52 35.60 41.57 34.81 33.52 39.02 36.45 38.00 35.79 35.88 56.77 42.90 38.42 54.25 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.17 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 80 160 240 320 400 Min: 101.44 / Avg: 386.17 / Max: 431.52 Min: 53.88 / Avg: 210.59 / Max: 230.53 Min: 65.93 / Avg: 426.21 / Max: 468.57 Min: 33.52 / Avg: 227.41 / Max: 249.95 Min: 29.71 / Avg: 198.61 / Max: 217.44 Min: 58.29 / Avg: 391.03 / Max: 427.27 Min: 21.43 / Avg: 160.48 / Max: 176.89 Min: 41.16 / Avg: 302.54 / Max: 329.11 Min: 17.92 / Avg: 105.97 / Max: 115.61 Min: 16.17 / Avg: 95.68 / Max: 104.17 Min: 104.02 / Avg: 236.43 / Max: 258.12 Min: 43.71 / Avg: 132.85 / Max: 145.13 Min: 43.46 / Avg: 155.26 / Max: 169.97 Min: 106.52 / Avg: 256.16 / Max: 280.65 1. Xeon Platinum 8380 2P: Approximate power consumption of 25745 Joules per run. 2. Xeon Platinum 8380: Approximate power consumption of 13969 Joules per run. 3. EPYC 9684X 2P: Approximate power consumption of 27988 Joules per run. 4. EPYC 9684X: Approximate power consumption of 14933 Joules per run. 5. EPYC 9654: Approximate power consumption of 13042 Joules per run. 6. EPYC 9654 2P: Approximate power consumption of 25808 Joules per run. 7. EPYC 9754: Approximate power consumption of 10632 Joules per run. 8. EPYC 9754 2P: Approximate power consumption of 20097 Joules per run. 9. EPYC 8534P: Approximate power consumption of 6994 Joules per run. 10. EPYC 8534PN: Approximate power consumption of 6347 Joules per run. 11. Xeon 6766E 2P: Approximate power consumption of 16077 Joules per run. 12. Xeon 6766E: Approximate power consumption of 8945 Joules per run. 13. Xeon 6780E: Approximate power consumption of 10402 Joules per run. 14. Xeon 6780E 2P: Approximate power consumption of 17248 Joules per run.
Zstd Compression This test measures the time needed to compress/decompress a sample file (silesia.tar) using Zstd (Zstandard) compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19, Long Mode - Decompression Speed Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 300 600 900 1200 1500 SE +/- 1.60, N = 3 SE +/- 0.84, N = 3 SE +/- 0.43, N = 3 SE +/- 3.69, N = 3 SE +/- 0.56, N = 3 SE +/- 1.00, N = 3 SE +/- 1.45, N = 3 SE +/- 1.78, N = 15 SE +/- 0.30, N = 3 SE +/- 4.15, N = 3 SE +/- 2.93, N = 3 SE +/- 1.99, N = 3 SE +/- 1.17, N = 3 SE +/- 1.87, N = 3 SE +/- 1.95, N = 3 SE +/- 0.19, N = 3 SE +/- 2.09, N = 3 SE +/- 0.92, N = 3 SE +/- 4.61, N = 3 SE +/- 3.99, N = 3 SE +/- 1.05, N = 3 SE +/- 1.54, N = 3 1189.7 1242.6 1069.1 992.1 1131.1 1041.8 1133.3 1046.0 912.9 1018.3 1321.4 1324.9 1328.5 1324.6 1102.2 1104.2 1101.4 1096.5 701.2 739.1 797.7 753.2 1. (CC) gcc options: -O3 -pthread -lz -llzma MB/s Per Watt
OpenBenchmarking.org MB/s Per Watt, More Is Better Zstd Compression 1.5.4 Compression Level: 19, Long Mode - Decompression Speed Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 5 10 15 20 25 4.173 9.241 6.931 2.956 5.787 2.512 5.674 2.539 4.675 9.833 5.089 11.661 13.268 5.643 14.042 5.816 20.514 20.797 6.001 14.311 15.034 6.333 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Zstd Compression 1.5.4 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 80 160 240 320 400 Min: 75.89 / Avg: 285.1 / Max: 313.97 Min: 33.99 / Avg: 134.46 / Max: 153.43 Min: 61.25 / Avg: 154.25 / Max: 170.09 Min: 172.05 / Avg: 335.67 / Max: 356.47 Min: 73.9 / Avg: 195.37 / Max: 210.14 Min: 208.83 / Avg: 414.8 / Max: 438.11 Min: 82.48 / Avg: 199.75 / Max: 214.36 Min: 201.8 / Avg: 412.05 / Max: 436.43 Min: 96.44 / Avg: 195.29 / Max: 212.05 Min: 49.33 / Avg: 103.56 / Max: 117.6 Min: 64.16 / Avg: 259.66 / Max: 276.36 Min: 33.27 / Avg: 113.62 / Max: 124.55 Min: 28.35 / Avg: 100.13 / Max: 109.97 Min: 57.79 / Avg: 234.74 / Max: 249.39 Min: 18.92 / Avg: 78.5 / Max: 87.36 Min: 39.89 / Avg: 189.86 / Max: 203.51 Min: 17.05 / Avg: 53.69 / Max: 60.18 Min: 15.43 / Avg: 52.72 / Max: 59.1 Min: 103.71 / Avg: 116.84 / Max: 150.87 Min: 43.63 / Avg: 51.65 / Max: 69.7 Min: 43.37 / Avg: 53.06 / Max: 71.35 Min: 105.69 / Avg: 118.94 / Max: 149.49 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 22998 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 10667 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 13831 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 29875 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 18365 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 40927 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 18444 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 38595 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 17707 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 9596 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 22677 Joules per run. 12. EPYC 9684X: Approximate power consumption of 9734 Joules per run. 13. EPYC 9654: Approximate power consumption of 8711 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 20423 Joules per run. 15. EPYC 9754: Approximate power consumption of 5285 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 12784 Joules per run. 17. EPYC 8534P: Approximate power consumption of 3615 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 3550 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 8646 Joules per run. 20. Xeon 6766E: Approximate power consumption of 3805 Joules per run. 21. Xeon 6780E: Approximate power consumption of 3714 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 8484 Joules per run.
Apache IoTDB Apache IotDB is a time series database and this benchmark is facilitated using the IoT Benchmaark [https://github.com/thulab/iot-benchmark/]. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org point/sec, More Is Better Apache IoTDB 1.2 Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 30M 60M 90M 120M 150M SE +/- 761276.42, N = 12 SE +/- 746822.47, N = 3 SE +/- 308756.34, N = 3 SE +/- 692701.79, N = 8 SE +/- 662950.65, N = 3 SE +/- 565297.90, N = 12 SE +/- 1037167.36, N = 3 SE +/- 574699.97, N = 12 SE +/- 661234.22, N = 3 SE +/- 88241.50, N = 3 SE +/- 353097.82, N = 3 SE +/- 371659.60, N = 3 SE +/- 255887.16, N = 3 SE +/- 1152766.29, N = 3 SE +/- 68559.13, N = 3 SE +/- 666882.79, N = 15 SE +/- 13050.78, N = 3 SE +/- 412757.79, N = 3 SE +/- 531367.14, N = 12 SE +/- 111181.55, N = 3 SE +/- 441557.52, N = 3 SE +/- 796440.21, N = 3 89231850 92709751 87797206 80169620 82455664 77501248 83475645 78057728 74653007 78823112 106778379 126161028 125562060 108821580 116685326 103630483 105432862 105138551 67599793 81900477 87190397 68320800
VVenC VVenC is the Fraunhofer Versatile Video Encoder as a fast/efficient H.266/VVC encoder. The vvenc encoder makes use of SIMD Everywhere (SIMDe). The vvenc software is published under the Clear BSD License. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.11 Video Input: Bosphorus 4K - Video Preset: Fast Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X EPYC 9654 EPYC 9754 EPYC 8534P EPYC 8534PN Xeon 6766E Xeon 6780E 2 4 6 8 10 SE +/- 0.038, N = 3 SE +/- 0.023, N = 3 SE +/- 0.022, N = 3 SE +/- 0.047, N = 3 SE +/- 0.010, N = 3 SE +/- 0.081, N = 3 SE +/- 0.033, N = 3 SE +/- 0.043, N = 15 SE +/- 0.028, N = 3 SE +/- 0.010, N = 3 SE +/- 0.057, N = 3 SE +/- 0.048, N = 3 SE +/- 0.045, N = 3 SE +/- 0.038, N = 3 SE +/- 0.041, N = 3 SE +/- 0.008, N = 3 SE +/- 0.007, N = 3 6.960 7.392 6.719 6.480 6.324 6.023 6.501 6.077 5.877 5.583 7.547 7.431 6.465 6.118 6.000 4.052 4.440 1. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects Frames Per Second Per Watt
OpenBenchmarking.org Frames Per Second Per Watt, More Is Better VVenC 1.11 Video Input: Bosphorus 4K - Video Preset: Fast Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X EPYC 9654 EPYC 9754 EPYC 8534P EPYC 8534PN Xeon 6766E Xeon 6780E 0.0151 0.0302 0.0453 0.0604 0.0755 0.017 0.032 0.028 0.015 0.023 0.012 0.023 0.012 0.018 0.028 0.037 0.042 0.048 0.062 0.067 0.052 0.050 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better VVenC 1.11 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X EPYC 9654 EPYC 9754 EPYC 8534P EPYC 8534PN Xeon 6766E Xeon 6780E 110 220 330 440 550 Min: 77.27 / Avg: 413.94 / Max: 550.57 Min: 26.5 / Avg: 232.82 / Max: 325.56 Min: 59.59 / Avg: 242.83 / Max: 330.87 Min: 154.77 / Avg: 444.48 / Max: 576.57 Min: 71.41 / Avg: 273.3 / Max: 339.11 Min: 218.19 / Avg: 515.79 / Max: 625.23 Min: 84.83 / Avg: 277.48 / Max: 349.11 Min: 193.59 / Avg: 516.46 / Max: 637.28 Min: 100.2 / Avg: 328.02 / Max: 463.25 Min: 52.86 / Avg: 196.6 / Max: 265.58 Min: 31.5 / Avg: 204.88 / Max: 302.64 Min: 27.21 / Avg: 177.95 / Max: 263.84 Min: 20.88 / Avg: 134.72 / Max: 195.13 Min: 16.24 / Avg: 99.45 / Max: 145.04 Min: 15.3 / Avg: 89.82 / Max: 125.64 Min: 43.59 / Avg: 78.47 / Max: 122.17 Min: 43.46 / Avg: 89.13 / Max: 146.7 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 39324 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 20256 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 23150 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 45189 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 27513 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 55877 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 27193 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 55743 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 35973 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 22215 Joules per run. 11. EPYC 9684X: Approximate power consumption of 17825 Joules per run. 12. EPYC 9654: Approximate power consumption of 15719 Joules per run. 13. EPYC 9754: Approximate power consumption of 13832 Joules per run. 14. EPYC 8534P: Approximate power consumption of 10476 Joules per run. 15. EPYC 8534PN: Approximate power consumption of 9641 Joules per run. 16. Xeon 6766E: Approximate power consumption of 12216 Joules per run. 17. Xeon 6780E: Approximate power consumption of 12687 Joules per run. Video Input: Bosphorus 4K - Video Preset: Fast
EPYC 9684X 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
EPYC 9654 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
EPYC 9754 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
Xeon 6766E 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
Xeon 6780E 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
TensorFlow This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 40 80 120 160 200 SE +/- 0.21, N = 3 SE +/- 0.58, N = 3 SE +/- 0.03, N = 3 SE +/- 1.57, N = 3 SE +/- 0.14, N = 3 SE +/- 1.40, N = 3 SE +/- 0.63, N = 3 SE +/- 1.04, N = 12 SE +/- 0.46, N = 3 SE +/- 0.02, N = 3 SE +/- 0.50, N = 3 SE +/- 1.39, N = 4 SE +/- 0.66, N = 3 SE +/- 0.57, N = 3 SE +/- 2.00, N = 12 SE +/- 0.18, N = 3 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 SE +/- 0.48, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.54, N = 3 150.33 129.02 143.67 161.06 119.73 141.95 123.69 135.28 125.91 91.65 120.11 123.37 138.11 133.87 125.76 131.38 98.70 92.82 103.22 87.17 92.42 115.12 images/sec Per Watt
OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.1555 0.311 0.4665 0.622 0.7775 0.278 0.463 0.425 0.243 0.354 0.210 0.363 0.200 0.254 0.352 0.203 0.385 0.485 0.252 0.525 0.291 0.646 0.691 0.247 0.438 0.382 0.242 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.16.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 84.37 / Avg: 540.26 / Max: 604.56 Min: 33.15 / Avg: 278.36 / Max: 312.29 Min: 59.06 / Avg: 338.33 / Max: 360.73 Min: 163.23 / Avg: 663.98 / Max: 713.39 Min: 73.46 / Avg: 338.38 / Max: 359.94 Min: 203.91 / Avg: 674.94 / Max: 716.61 Min: 77.09 / Avg: 340.59 / Max: 361.18 Min: 196.92 / Avg: 674.95 / Max: 729.37 Min: 100.88 / Avg: 496.59 / Max: 533.47 Min: 54.97 / Avg: 260.49 / Max: 276.51 Min: 58.73 / Avg: 590.53 / Max: 641.68 Min: 33.82 / Avg: 320.09 / Max: 348.64 Min: 29.3 / Avg: 284.71 / Max: 314.17 Min: 53.87 / Avg: 531.98 / Max: 578.15 Min: 20.95 / Avg: 239.33 / Max: 288.65 Min: 43.33 / Avg: 451.33 / Max: 504.94 Min: 18.72 / Avg: 152.81 / Max: 164.9 Min: 16.01 / Avg: 134.32 / Max: 142.38 Min: 104.82 / Avg: 417.33 / Max: 477.08 Min: 43.62 / Avg: 198.95 / Max: 223.14 Min: 43.44 / Avg: 241.64 / Max: 277.25 Min: 107.7 / Avg: 475.01 / Max: 547.45 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 109132 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 64116 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 70035 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 126378 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 84933 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 143762 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 82649 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 152651 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 118851 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 82748 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 144483 Joules per run. 12. EPYC 9684X: Approximate power consumption of 76021 Joules per run. 13. EPYC 9654: Approximate power consumption of 60832 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 117567 Joules per run. 15. EPYC 9754: Approximate power consumption of 55424 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 102754 Joules per run. 17. EPYC 8534P: Approximate power consumption of 45284 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 42266 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 123112 Joules per run. 20. Xeon 6766E: Approximate power consumption of 67311 Joules per run. 21. Xeon 6780E: Approximate power consumption of 77084 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 127620 Joules per run.
Timed ImageMagick Compilation This test times how long it takes to build ImageMagick. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Timed ImageMagick Compilation 6.9.0 Time To Compile Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 5 10 15 20 25 SE +/- 0.03, N = 4 SE +/- 0.10, N = 4 SE +/- 0.10, N = 4 SE +/- 0.13, N = 4 SE +/- 0.15, N = 4 SE +/- 0.11, N = 4 SE +/- 0.06, N = 4 SE +/- 0.07, N = 4 SE +/- 0.13, N = 4 SE +/- 0.03, N = 3 SE +/- 0.04, N = 4 SE +/- 0.06, N = 4 SE +/- 0.09, N = 4 SE +/- 0.04, N = 4 SE +/- 0.08, N = 4 SE +/- 0.02, N = 4 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 SE +/- 0.08, N = 3 SE +/- 0.05, N = 3 SE +/- 0.11, N = 3 11.49 12.60 14.72 13.26 16.08 14.40 15.38 14.09 16.33 18.84 11.72 12.20 13.47 12.75 16.39 15.81 17.92 18.18 20.59 20.91 19.20 18.85 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Timed ImageMagick Compilation 6.9.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 81.81 / Avg: 295.33 / Max: 748.04 Min: 26.01 / Avg: 162.46 / Max: 377 Min: 60.5 / Avg: 186.22 / Max: 378.44 Min: 164.76 / Avg: 362.03 / Max: 752.14 Min: 73.52 / Avg: 220.79 / Max: 376.49 Min: 203.42 / Avg: 435.59 / Max: 750.99 Min: 75.62 / Avg: 220.24 / Max: 379.25 Min: 198.51 / Avg: 429.23 / Max: 750.07 Min: 97.82 / Avg: 252.21 / Max: 581.41 Min: 51.29 / Avg: 152.46 / Max: 291.86 Min: 62.42 / Avg: 273.56 / Max: 669.18 Min: 32.48 / Avg: 139.23 / Max: 409.7 Min: 28.39 / Avg: 120.39 / Max: 332.54 Min: 57.57 / Avg: 245.77 / Max: 578.82 Min: 21.44 / Avg: 97.43 / Max: 329.22 Min: 40.62 / Avg: 204.88 / Max: 561.52 Min: 17.83 / Avg: 69.48 / Max: 164.08 Min: 16.43 / Avg: 65.12 / Max: 142.84 Min: 103.94 / Avg: 137.3 / Max: 386.07 Min: 43.53 / Avg: 69.56 / Max: 253.22 Min: 43.41 / Avg: 74.98 / Max: 300.96 Min: 107.23 / Avg: 143.22 / Max: 459.28 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 6054 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 3371 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 4423 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 8236 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 5409 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 10019 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 5286 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 9765 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 6305 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 4421 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 6018 Joules per run. 12. EPYC 9684X: Approximate power consumption of 3028 Joules per run. 13. EPYC 9654: Approximate power consumption of 2769 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 5591 Joules per run. 15. EPYC 9754: Approximate power consumption of 2655 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 5532 Joules per run. 17. EPYC 8534P: Approximate power consumption of 2084 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1997 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 4714 Joules per run. 20. Xeon 6766E: Approximate power consumption of 2342 Joules per run. 21. Xeon 6780E: Approximate power consumption of 2349 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 4535 Joules per run.
libavif avifenc This is a test of the AOMedia libavif library testing the encoding of a JPEG image to AV1 Image Format (AVIF). Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 10, Lossless Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 2 4 6 8 10 SE +/- 0.015, N = 8 SE +/- 0.008, N = 8 SE +/- 0.006, N = 7 SE +/- 0.014, N = 7 SE +/- 0.005, N = 7 SE +/- 0.019, N = 7 SE +/- 0.015, N = 7 SE +/- 0.028, N = 7 SE +/- 0.011, N = 7 SE +/- 0.008, N = 7 SE +/- 0.003, N = 7 SE +/- 0.002, N = 8 SE +/- 0.006, N = 8 SE +/- 0.006, N = 8 SE +/- 0.004, N = 7 SE +/- 0.006, N = 7 SE +/- 0.006, N = 7 SE +/- 0.010, N = 7 SE +/- 0.021, N = 6 SE +/- 0.009, N = 6 SE +/- 0.003, N = 6 SE +/- 0.016, N = 6 4.579 4.456 4.923 5.074 4.916 5.317 4.867 5.311 5.919 5.906 4.943 4.770 4.792 4.829 5.662 5.740 5.735 5.734 8.094 7.507 6.849 7.603 1. (CXX) g++ options: -O3 -fPIC -lm CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better libavif avifenc 1.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 100 200 300 400 500 Min: 76.28 / Avg: 204.47 / Max: 438.17 Min: 26.86 / Avg: 95.6 / Max: 261.18 Min: 58.72 / Avg: 130.94 / Max: 271.24 Min: 134.59 / Avg: 276.23 / Max: 451.3 Min: 73.28 / Avg: 159.39 / Max: 303.29 Min: 198.99 / Avg: 348.01 / Max: 540.22 Min: 72.94 / Avg: 159.29 / Max: 307.76 Min: 197.84 / Avg: 346.41 / Max: 545.23 Min: 97.81 / Avg: 180.38 / Max: 349.14 Min: 49.47 / Avg: 100.66 / Max: 234.57 Min: 59.66 / Avg: 192.17 / Max: 352.61 Min: 31.1 / Avg: 89.96 / Max: 203.77 Min: 27.35 / Avg: 79.69 / Max: 177.97 Min: 54.59 / Avg: 171.46 / Max: 320.72 Min: 20.59 / Avg: 64.93 / Max: 140.09 Min: 39.49 / Avg: 147.26 / Max: 254.64 Min: 15.89 / Avg: 45.79 / Max: 103.55 Min: 15.19 / Avg: 43.89 / Max: 93.61 Min: 103.88 / Avg: 113.94 / Max: 151.55 Min: 43.59 / Avg: 50.67 / Max: 89.41 Min: 43.45 / Avg: 52.35 / Max: 100.96 Min: 106.05 / Avg: 116.77 / Max: 170.77 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 1789 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 813 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 1178 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 2526 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 1434 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 3281 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 1434 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 3266 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 1804 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 1007 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 1730 Joules per run. 12. EPYC 9684X: Approximate power consumption of 798 Joules per run. 13. EPYC 9654: Approximate power consumption of 707 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 1522 Joules per run. 15. EPYC 9754: Approximate power consumption of 631 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 1431 Joules per run. 17. EPYC 8534P: Approximate power consumption of 445 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 426 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 1386 Joules per run. 20. Xeon 6766E: Approximate power consumption of 583 Joules per run. 21. Xeon 6780E: Approximate power consumption of 567 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 1362 Joules per run.
Apache IoTDB Apache IotDB is a time series database and this benchmark is facilitated using the IoT Benchmaark [https://github.com/thulab/iot-benchmark/]. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Average Latency, Fewer Is Better Apache IoTDB 1.2 Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 80 160 240 320 400 SE +/- 3.40, N = 12 SE +/- 3.41, N = 3 SE +/- 2.20, N = 3 SE +/- 3.79, N = 8 SE +/- 5.15, N = 3 SE +/- 2.59, N = 12 SE +/- 5.07, N = 3 SE +/- 3.74, N = 12 SE +/- 3.47, N = 3 SE +/- 4.06, N = 3 SE +/- 1.87, N = 3 SE +/- 1.71, N = 3 SE +/- 1.96, N = 3 SE +/- 3.49, N = 3 SE +/- 1.41, N = 3 SE +/- 2.16, N = 15 SE +/- 0.38, N = 3 SE +/- 0.82, N = 3 SE +/- 3.93, N = 12 SE +/- 1.12, N = 3 SE +/- 4.45, N = 3 SE +/- 5.20, N = 3 286.78 280.26 294.33 317.36 314.44 328.41 309.03 325.97 349.42 326.53 246.08 209.68 211.85 240.43 227.40 253.13 251.47 251.05 380.33 312.32 296.36 377.58 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Apache IoTDB 1.2 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 Min: 76.05 / Avg: 329.73 / Max: 605.38 Min: 33.32 / Avg: 159.48 / Max: 348.24 Min: 58.74 / Avg: 204.83 / Max: 345.97 Min: 174.02 / Avg: 422.43 / Max: 631.3 Min: 75.58 / Avg: 242.09 / Max: 358.23 Min: 207 / Avg: 485.64 / Max: 662.26 Min: 74.42 / Avg: 245.7 / Max: 359.89 Min: 204.98 / Avg: 492.49 / Max: 690.42 Min: 105.33 / Avg: 293.48 / Max: 476.12 Min: 51.86 / Avg: 163.52 / Max: 286.64 Min: 68.46 / Avg: 291.76 / Max: 496.27 Min: 35.8 / Avg: 141.12 / Max: 306.16 Min: 30.38 / Avg: 122.12 / Max: 263.01 Min: 52.66 / Avg: 254.51 / Max: 448.61 Min: 21.99 / Avg: 100.77 / Max: 212.81 Min: 43.37 / Avg: 215.97 / Max: 369.95 Min: 15.92 / Avg: 72.92 / Max: 146.34 Min: 17.44 / Avg: 68.28 / Max: 132.65 Min: 61.74 / Avg: 182.78 / Max: 332.16 Min: 43.59 / Avg: 76.38 / Max: 156.34 Min: 43.44 / Avg: 82.74 / Max: 200.76 Min: 95.98 / Avg: 192.34 / Max: 351.09 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 45448 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 26155 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 35573 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 66269 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 43414 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 74505 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 43735 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 74324 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 56838 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 30414 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 43570 Joules per run. 12. EPYC 9684X: Approximate power consumption of 19051 Joules per run. 13. EPYC 9654: Approximate power consumption of 16731 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 39025 Joules per run. 15. EPYC 9754: Approximate power consumption of 14578 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 26650 Joules per run. 17. EPYC 8534P: Approximate power consumption of 11327 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 10424 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 31590 Joules per run. 20. Xeon 6766E: Approximate power consumption of 14105 Joules per run. 21. Xeon 6780E: Approximate power consumption of 14369 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 41674 Joules per run.
QMCPACK QMCPACK is a modern high-performance open-source Quantum Monte Carlo (QMC) simulation code making use of MPI for this benchmark of the H20 example code. QMCPACK is an open-source production level many-body ab initio Quantum Monte Carlo code for computing the electronic structure of atoms, molecules, and solids. QMCPACK is supported by the U.S. Department of Energy. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Total Execution Time - Seconds, Fewer Is Better QMCPACK 3.17.1 Input: Li2_STO_ae Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 40 80 120 160 200 SE +/- 0.93, N = 3 SE +/- 1.03, N = 3 SE +/- 0.89, N = 3 SE +/- 1.11, N = 3 SE +/- 1.20, N = 3 SE +/- 0.88, N = 3 SE +/- 1.04, N = 3 SE +/- 1.11, N = 5 SE +/- 0.50, N = 3 SE +/- 1.47, N = 7 SE +/- 0.06, N = 3 SE +/- 1.06, N = 3 SE +/- 0.54, N = 3 SE +/- 0.23, N = 3 SE +/- 0.63, N = 3 SE +/- 0.42, N = 3 SE +/- 1.13, N = 3 SE +/- 0.40, N = 3 97.91 105.98 109.30 101.63 121.19 102.12 117.81 106.27 131.37 163.75 91.97 97.00 108.02 102.98 110.80 111.15 137.23 151.27 1. (CXX) g++ options: -fopenmp -foffload=disable -finline-limit=1000 -fstrict-aliasing -funroll-all-loops -ffast-math -march=native -O3 -lm -ldl CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better QMCPACK 3.17.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 140 280 420 560 700 Min: 63.82 / Avg: 660.86 / Max: 753.6 Min: 23.78 / Avg: 335.13 / Max: 377.2 Min: 59.34 / Avg: 337.54 / Max: 376.68 Min: 169.74 / Avg: 670.52 / Max: 753.5 Min: 75.52 / Avg: 323.64 / Max: 364.79 Min: 208.9 / Avg: 673.9 / Max: 748.46 Min: 80.16 / Avg: 338.77 / Max: 371.37 Min: 206.85 / Avg: 676.4 / Max: 753.87 Min: 104.4 / Avg: 524.73 / Max: 581.03 Min: 53.73 / Avg: 263.86 / Max: 290.45 Min: 66.83 / Avg: 767.28 / Max: 818.97 Min: 33.88 / Avg: 391.36 / Max: 409.49 Min: 28.38 / Avg: 316.1 / Max: 334.43 Min: 54.02 / Avg: 635.44 / Max: 688.42 Min: 21.99 / Avg: 319.33 / Max: 338.99 Min: 44.37 / Avg: 628.81 / Max: 690.2 Min: 17.96 / Avg: 154.43 / Max: 159.92 Min: 17.04 / Avg: 132.24 / Max: 137.56 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 70712 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 37423 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 38705 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 73534 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 40886 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 73455 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 41781 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 76704 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 71713 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 44403 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 76728 Joules per run. 12. EPYC 9684X: Approximate power consumption of 39788 Joules per run. 13. EPYC 9654: Approximate power consumption of 35614 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 70533 Joules per run. 15. EPYC 9754: Approximate power consumption of 37149 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 77343 Joules per run. 17. EPYC 8534P: Approximate power consumption of 21929 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 20629 Joules per run.
libavif avifenc This is a test of the AOMedia libavif library testing the encoding of a JPEG image to AV1 Image Format (AVIF). Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 6, Lossless Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 3 6 9 12 15 SE +/- 0.031, N = 7 SE +/- 0.025, N = 7 SE +/- 0.013, N = 7 SE +/- 0.022, N = 7 SE +/- 0.045, N = 6 SE +/- 0.027, N = 6 SE +/- 0.033, N = 6 SE +/- 0.035, N = 6 SE +/- 0.027, N = 6 SE +/- 0.016, N = 6 SE +/- 0.015, N = 7 SE +/- 0.014, N = 7 SE +/- 0.010, N = 7 SE +/- 0.020, N = 7 SE +/- 0.007, N = 6 SE +/- 0.025, N = 6 SE +/- 0.009, N = 6 SE +/- 0.011, N = 6 SE +/- 0.054, N = 5 SE +/- 0.012, N = 5 SE +/- 0.010, N = 6 SE +/- 0.038, N = 5 5.613 5.784 6.278 6.172 6.836 7.121 6.605 7.038 7.388 8.201 5.950 5.757 5.799 5.846 6.853 6.986 7.182 7.301 9.960 9.188 8.359 9.351 1. (CXX) g++ options: -O3 -fPIC -lm CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better libavif avifenc 1.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 Min: 74.34 / Avg: 248.3 / Max: 649.52 Min: 26.64 / Avg: 128.43 / Max: 374.81 Min: 61.6 / Avg: 158.79 / Max: 375.47 Min: 143.68 / Avg: 313.6 / Max: 692.26 Min: 74.59 / Avg: 193.8 / Max: 362.37 Min: 197.54 / Avg: 390.59 / Max: 684.36 Min: 69.76 / Avg: 191.83 / Max: 376.91 Min: 196.47 / Avg: 378.09 / Max: 677.18 Min: 95.62 / Avg: 213.07 / Max: 530.05 Min: 48.9 / Avg: 132.08 / Max: 290.31 Min: 61.29 / Avg: 220.4 / Max: 507.64 Min: 29.45 / Avg: 115.08 / Max: 342.75 Min: 27.48 / Avg: 100.34 / Max: 306.84 Min: 51.5 / Avg: 198.44 / Max: 459.76 Min: 20.4 / Avg: 80.51 / Max: 234.12 Min: 39.73 / Avg: 165.83 / Max: 352.71 Min: 15.99 / Avg: 55.18 / Max: 149.59 Min: 15.05 / Avg: 53.07 / Max: 124.5 Min: 53.34 / Avg: 123.17 / Max: 220.64 Min: 43.56 / Avg: 59.76 / Max: 149.48 Min: 43.39 / Avg: 64.09 / Max: 183.29 Min: 106.3 / Avg: 128.53 / Max: 249.32 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 2448 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 1266 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 1633 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 3226 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 2099 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 4362 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 2046 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 4537 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 2415 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 1629 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 2173 Joules per run. 12. EPYC 9684X: Approximate power consumption of 1118 Joules per run. 13. EPYC 9654: Approximate power consumption of 989 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 1956 Joules per run. 15. EPYC 9754: Approximate power consumption of 886 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 1852 Joules per run. 17. EPYC 8534P: Approximate power consumption of 662 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 610 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 1724 Joules per run. 20. Xeon 6766E: Approximate power consumption of 789 Joules per run. 21. Xeon 6780E: Approximate power consumption of 790 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 1722 Joules per run.
Result
OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 6 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 1.0865 2.173 3.2595 4.346 5.4325 SE +/- 0.009, N = 10 SE +/- 0.016, N = 9 SE +/- 0.022, N = 9 SE +/- 0.008, N = 9 SE +/- 0.017, N = 9 SE +/- 0.029, N = 8 SE +/- 0.011, N = 9 SE +/- 0.022, N = 9 SE +/- 0.023, N = 15 SE +/- 0.010, N = 8 SE +/- 0.005, N = 9 SE +/- 0.005, N = 10 SE +/- 0.011, N = 10 SE +/- 0.008, N = 10 SE +/- 0.002, N = 9 SE +/- 0.026, N = 9 SE +/- 0.016, N = 9 SE +/- 0.011, N = 9 SE +/- 0.023, N = 8 SE +/- 0.003, N = 8 SE +/- 0.004, N = 8 SE +/- 0.034, N = 8 2.805 2.971 3.169 3.044 3.730 3.776 3.550 3.738 3.528 4.093 2.890 2.723 2.756 2.810 3.251 3.341 3.484 3.623 4.829 4.243 3.872 4.486 1. (CXX) g++ options: -O3 -fPIC -lm CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better libavif avifenc 1.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 Min: 66.73 / Avg: 224.06 / Max: 669.89 Min: 27.77 / Avg: 125.51 / Max: 374.47 Min: 59.37 / Avg: 149.47 / Max: 376.13 Min: 141.74 / Avg: 294.92 / Max: 681.8 Min: 73.48 / Avg: 180.42 / Max: 357.76 Min: 194.63 / Avg: 375.42 / Max: 682.97 Min: 71.59 / Avg: 183.17 / Max: 376.96 Min: 196.21 / Avg: 370.24 / Max: 687.54 Min: 96.12 / Avg: 215.89 / Max: 534.91 Min: 49.52 / Avg: 131.52 / Max: 290.38 Min: 59.74 / Avg: 193.24 / Max: 500.52 Min: 29.87 / Avg: 106.31 / Max: 349.7 Min: 26.55 / Avg: 92.59 / Max: 299.06 Min: 54.93 / Avg: 178.85 / Max: 447.63 Min: 18.49 / Avg: 76.34 / Max: 238.8 Min: 35.83 / Avg: 144.55 / Max: 349.42 Min: 15.86 / Avg: 54.43 / Max: 150.92 Min: 15.57 / Avg: 49.3 / Max: 126.89 Min: 103.77 / Avg: 129.25 / Max: 219.98 Min: 43.55 / Avg: 64.88 / Max: 147.13 Min: 43.39 / Avg: 69.56 / Max: 179.96 Min: 106.17 / Avg: 135.03 / Max: 247.79 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 1546 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 879 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 1096 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 2130 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 1403 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 2910 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 1364 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 2880 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 1626 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 1069 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 1353 Joules per run. 12. EPYC 9684X: Approximate power consumption of 723 Joules per run. 13. EPYC 9654: Approximate power consumption of 630 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 1216 Joules per run. 15. EPYC 9754: Approximate power consumption of 551 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 1060 Joules per run. 17. EPYC 8534P: Approximate power consumption of 411 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 378 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 1147 Joules per run. 20. Xeon 6766E: Approximate power consumption of 535 Joules per run. 21. Xeon 6780E: Approximate power consumption of 556 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 1148 Joules per run.
Timed Gem5 Compilation This test times how long it takes to compile Gem5. Gem5 is a simulator for computer system architecture research. Gem5 is widely used for computer architecture research within the industry, academia, and more. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Timed Gem5 Compilation 23.0.1 Time To Compile Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 60 120 180 240 300 SE +/- 0.89, N = 3 SE +/- 2.17, N = 3 SE +/- 0.92, N = 3 SE +/- 0.58, N = 3 SE +/- 2.59, N = 4 SE +/- 1.72, N = 3 SE +/- 2.11, N = 6 SE +/- 1.01, N = 3 SE +/- 1.04, N = 3 SE +/- 3.88, N = 3 SE +/- 1.16, N = 3 SE +/- 2.15, N = 3 SE +/- 2.24, N = 4 SE +/- 0.72, N = 3 SE +/- 1.88, N = 3 SE +/- 1.73, N = 3 SE +/- 1.99, N = 9 SE +/- 0.97, N = 3 SE +/- 0.78, N = 3 SE +/- 3.60, N = 3 SE +/- 1.47, N = 3 SE +/- 2.61, N = 3 157.36 187.51 210.93 178.28 220.57 184.30 215.50 181.63 219.67 275.71 161.94 176.88 185.30 164.90 212.55 192.98 242.93 251.61 252.97 267.95 238.43 233.21 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Timed Gem5 Compilation 23.0.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 43.96 / Avg: 377.81 / Max: 753.32 Min: 33.1 / Avg: 215.42 / Max: 377.33 Min: 55.65 / Avg: 228.11 / Max: 376.67 Min: 160.34 / Avg: 415.56 / Max: 738.65 Min: 40.79 / Avg: 257.31 / Max: 376.35 Min: 177.84 / Avg: 479.92 / Max: 746.22 Min: 67.72 / Avg: 254.21 / Max: 375.35 Min: 191.44 / Avg: 472.13 / Max: 747.43 Min: 97.98 / Avg: 327.07 / Max: 580.5 Min: 50.89 / Avg: 194.29 / Max: 291.11 Min: 65.57 / Avg: 360.36 / Max: 822.7 Min: 29.1 / Avg: 201.66 / Max: 413.09 Min: 29.61 / Avg: 170.81 / Max: 332.22 Min: 55.44 / Avg: 320.45 / Max: 676.84 Min: 21.18 / Avg: 144.58 / Max: 331.44 Min: 40.43 / Avg: 270.24 / Max: 677.31 Min: 17.32 / Avg: 96.65 / Max: 166.6 Min: 16.66 / Avg: 87.52 / Max: 141.58 Min: 104.15 / Avg: 164.39 / Max: 501.65 Min: 43.55 / Avg: 90.66 / Max: 234.37 Min: 43.31 / Avg: 103.5 / Max: 281.26 Min: 55.47 / Avg: 178.9 / Max: 585.97 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 61457 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 41503 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 49424 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 76602 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 58024 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 91024 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 56012 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 88446 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 73591 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 54854 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 60180 Joules per run. 12. EPYC 9684X: Approximate power consumption of 36701 Joules per run. 13. EPYC 9654: Approximate power consumption of 32540 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 54477 Joules per run. 15. EPYC 9754: Approximate power consumption of 31566 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 53598 Joules per run. 17. EPYC 8534P: Approximate power consumption of 24022 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 22523 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 42633 Joules per run. 20. Xeon 6766E: Approximate power consumption of 24811 Joules per run. 21. Xeon 6780E: Approximate power consumption of 25219 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 42875 Joules per run.
Zstd Compression This test measures the time needed to compress/decompress a sample file (silesia.tar) using Zstd (Zstandard) compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19, Long Mode - Compression Speed Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 3 6 9 12 15 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 15 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 9.67 9.80 7.94 8.16 7.76 7.62 7.72 7.46 7.83 7.52 8.42 8.45 8.38 8.30 6.68 6.64 6.76 6.74 5.60 5.65 6.19 6.10 1. (CC) gcc options: -O3 -pthread -lz -llzma
WebP Image Encode This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100, Lossless, Highest Compression Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.135 0.27 0.405 0.54 0.675 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.59 0.60 0.52 0.51 0.55 0.54 0.55 0.54 0.49 0.50 0.56 0.57 0.57 0.57 0.48 0.48 0.48 0.48 0.35 0.35 0.39 0.38 1. (CC) gcc options: -fvisibility=hidden -O2 -lm MP/s Per Watt
OpenBenchmarking.org MP/s Per Watt, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100, Lossless, Highest Compression Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.002 0.004 0.006 0.008 0.01 0.002 0.005 0.004 0.002 0.003 0.001 0.003 0.001 0.003 0.005 0.002 0.005 0.006 0.003 0.006 0.003 0.009 0.009 0.003 0.007 0.008 0.003 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better WebP Image Encode 1.2.4 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 80 160 240 320 400 Min: 79.69 / Avg: 274 / Max: 299.87 Min: 34.5 / Avg: 128.71 / Max: 144.36 Min: 60.77 / Avg: 148.44 / Max: 161.11 Min: 150.62 / Avg: 324.76 / Max: 344.8 Min: 80.95 / Avg: 184.91 / Max: 202.94 Min: 205.48 / Avg: 407.7 / Max: 432.16 Min: 83.4 / Avg: 190.72 / Max: 207.25 Min: 205.98 / Avg: 397.44 / Max: 422.1 Min: 97.01 / Avg: 192.53 / Max: 212.04 Min: 50.06 / Avg: 101.4 / Max: 108.28 Min: 61.65 / Avg: 249.88 / Max: 268.66 Min: 30.35 / Avg: 109.81 / Max: 119.47 Min: 27.22 / Avg: 96.75 / Max: 105.57 Min: 57.93 / Avg: 225.88 / Max: 245.29 Min: 20.24 / Avg: 77.06 / Max: 83.97 Min: 39.58 / Avg: 186.91 / Max: 199.67 Min: 15.79 / Avg: 53.42 / Max: 58.48 Min: 15.76 / Avg: 52.31 / Max: 56.63 Min: 104.05 / Avg: 111.28 / Max: 129.11 Min: 43.65 / Avg: 50.5 / Max: 67.21 Min: 43.35 / Avg: 51.07 / Max: 67.23 Min: 105.36 / Avg: 121.62 / Max: 143.58 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 12330 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 5749 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 7521 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 16671 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 8937 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 19841 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 9091 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 19342 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 10332 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 5307 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 11661 Joules per run. 12. EPYC 9684X: Approximate power consumption of 5124 Joules per run. 13. EPYC 9654: Approximate power consumption of 4483 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 10541 Joules per run. 15. EPYC 9754: Approximate power consumption of 4213 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 10218 Joules per run. 17. EPYC 8534P: Approximate power consumption of 2885 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 2842 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 8086 Joules per run. 20. Xeon 6766E: Approximate power consumption of 3653 Joules per run. 21. Xeon 6780E: Approximate power consumption of 3387 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 8189 Joules per run.
Zstd Compression This test measures the time needed to compress/decompress a sample file (silesia.tar) using Zstd (Zstandard) compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19 - Compression Speed Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 4 8 12 16 20 SE +/- 0.03, N = 3 SE +/- 0.21, N = 4 SE +/- 0.06, N = 3 SE +/- 0.12, N = 3 SE +/- 0.15, N = 3 SE +/- 0.09, N = 15 SE +/- 0.11, N = 15 SE +/- 0.13, N = 15 SE +/- 0.17, N = 4 SE +/- 0.03, N = 3 SE +/- 0.22, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.09, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 17.8 18.0 14.6 15.2 14.4 13.8 14.5 13.3 14.3 13.7 16.8 17.2 17.2 17.0 13.8 13.7 13.9 13.8 10.6 10.6 11.5 11.6 1. (CC) gcc options: -O3 -pthread -lz -llzma
SVT-AV1 This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 12 - Input: Bosphorus 4K Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 40 80 120 160 200 SE +/- 0.42, N = 7 SE +/- 0.20, N = 7 SE +/- 0.41, N = 7 SE +/- 0.25, N = 7 SE +/- 0.61, N = 7 SE +/- 0.83, N = 5 SE +/- 0.40, N = 7 SE +/- 0.97, N = 6 SE +/- 1.28, N = 6 SE +/- 0.48, N = 6 SE +/- 0.88, N = 6 SE +/- 0.43, N = 7 SE +/- 0.80, N = 7 SE +/- 1.88, N = 15 SE +/- 1.32, N = 6 SE +/- 1.41, N = 6 SE +/- 0.71, N = 6 SE +/- 0.78, N = 6 SE +/- 0.88, N = 5 SE +/- 0.08, N = 6 SE +/- 0.15, N = 6 SE +/- 1.07, N = 6 165.50 177.86 164.25 156.52 146.10 122.09 151.72 127.55 140.76 134.07 163.80 165.75 178.52 171.22 169.23 168.78 165.09 157.36 108.50 115.35 126.59 117.68 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq Frames Per Second Per Watt
OpenBenchmarking.org Frames Per Second Per Watt, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 12 - Input: Bosphorus 4K Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.6399 1.2798 1.9197 2.5596 3.1995 0.675 1.363 1.097 0.500 0.784 0.306 0.812 0.318 0.638 1.054 0.709 1.399 1.714 0.829 2.019 1.001 2.784 2.844 0.833 1.703 1.741 0.843 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better SVT-AV1 2.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 100 200 300 400 500 Min: 72.44 / Avg: 245.05 / Max: 463.8 Min: 27.81 / Avg: 130.54 / Max: 271.31 Min: 58.81 / Avg: 149.76 / Max: 276.69 Min: 162.99 / Avg: 313.03 / Max: 463.03 Min: 78.53 / Avg: 186.44 / Max: 299.02 Min: 206.55 / Avg: 399.09 / Max: 553.52 Min: 70.86 / Avg: 186.8 / Max: 304.11 Min: 192.02 / Avg: 400.5 / Max: 567.38 Min: 98.84 / Avg: 220.59 / Max: 378.11 Min: 49.17 / Avg: 127.22 / Max: 220.81 Min: 64.22 / Avg: 231.05 / Max: 380.24 Min: 28.14 / Avg: 118.49 / Max: 228.43 Min: 25.96 / Avg: 104.16 / Max: 214.25 Min: 57.32 / Avg: 206.47 / Max: 350.04 Min: 21.46 / Avg: 83.8 / Max: 173.31 Min: 39.75 / Avg: 168.64 / Max: 285.91 Min: 16.3 / Avg: 59.31 / Max: 124.91 Min: 14.97 / Avg: 55.32 / Max: 108.24 Min: 104.27 / Avg: 130.28 / Max: 174.4 Min: 43.6 / Avg: 67.73 / Max: 107.71 Min: 43.49 / Avg: 72.69 / Max: 125.26 Min: 105.73 / Avg: 139.65 / Max: 205.54 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 2381 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 1194 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 1540 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 3220 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 1944 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 5029 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 1815 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 4873 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 2353 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 1336 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 2426 Joules per run. 12. EPYC 9684X: Approximate power consumption of 1202 Joules per run. 13. EPYC 9654: Approximate power consumption of 1012 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 2078 Joules per run. 15. EPYC 9754: Approximate power consumption of 880 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 1799 Joules per run. 17. EPYC 8534P: Approximate power consumption of 633 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 599 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 1668 Joules per run. 20. Xeon 6766E: Approximate power consumption of 813 Joules per run. 21. Xeon 6780E: Approximate power consumption of 824 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 1699 Joules per run.
GraphicsMagick This is a test of GraphicsMagick with its OpenMP implementation that performs various imaging tests on a sample high resolution (currently 15400 x 6940) JPEG image. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Noise-Gaussian Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 40 80 120 160 200 SE +/- 0.88, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 SE +/- 1.15, N = 3 SE +/- 0.33, N = 3 SE +/- 0.58, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 0.67, N = 3 SE +/- 0.67, N = 3 SE +/- 0.00, N = 3 SE +/- 0.58, N = 3 SE +/- 0.67, N = 3 SE +/- 0.58, N = 3 SE +/- 0.58, N = 3 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.58, N = 3 SE +/- 1.44, N = 4 194 171 158 182 150 150 158 164 153 121 179 165 160 178 151 164 123 120 118 145 155 126 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp Iterations Per Minute Per Watt
OpenBenchmarking.org Iterations Per Minute Per Watt, More Is Better GraphicsMagick 1.3.43 Operation: Noise-Gaussian Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.3443 0.6886 1.0329 1.3772 1.7215 0.544 0.778 0.716 0.467 0.552 0.308 0.614 0.345 0.482 0.620 0.540 0.932 1.041 0.597 1.226 0.674 1.420 1.507 0.740 1.530 1.417 0.729 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better GraphicsMagick 1.3.43 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 90 180 270 360 450 Min: 82.86 / Avg: 356.85 / Max: 403.74 Min: 34.53 / Avg: 219.79 / Max: 241.79 Min: 59.26 / Avg: 220.76 / Max: 250.24 Min: 160.72 / Avg: 389.84 / Max: 423.25 Min: 74.91 / Avg: 271.55 / Max: 302.98 Min: 203.35 / Avg: 486.24 / Max: 527.71 Min: 75.67 / Avg: 257.27 / Max: 283.18 Min: 196.74 / Avg: 476 / Max: 507.38 Min: 99.29 / Avg: 317.68 / Max: 360.97 Min: 53.3 / Avg: 195.01 / Max: 207.9 Min: 66.05 / Avg: 331.54 / Max: 359.49 Min: 33.85 / Avg: 176.95 / Max: 194.06 Min: 29.47 / Avg: 153.63 / Max: 171.14 Min: 59.18 / Avg: 297.92 / Max: 323.55 Min: 21.53 / Avg: 123.19 / Max: 140.7 Min: 39.77 / Avg: 243.28 / Max: 272.18 Min: 17.9 / Avg: 86.65 / Max: 95.02 Min: 16.29 / Avg: 79.6 / Max: 84.69 Min: 104.1 / Avg: 159.54 / Max: 190.88 Min: 43.66 / Avg: 94.78 / Max: 111.52 Min: 43.47 / Avg: 109.4 / Max: 130.3 Min: 98.17 / Avg: 172.89 / Max: 203.08 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 23076 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 14213 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 14202 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 25210 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 17470 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 31119 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 16465 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 30305 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 20332 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 12481 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 20997 Joules per run. 12. EPYC 9684X: Approximate power consumption of 11384 Joules per run. 13. EPYC 9654: Approximate power consumption of 9884 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 19067 Joules per run. 15. EPYC 9754: Approximate power consumption of 7884 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 15570 Joules per run. 17. EPYC 8534P: Approximate power consumption of 5574 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 5121 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 10210 Joules per run. 20. Xeon 6766E: Approximate power consumption of 6066 Joules per run. 21. Xeon 6780E: Approximate power consumption of 7038 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 11108 Joules per run.
VVenC VVenC is the Fraunhofer Versatile Video Encoder as a fast/efficient H.266/VVC encoder. The vvenc encoder makes use of SIMD Everywhere (SIMDe). The vvenc software is published under the Clear BSD License. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.11 Video Input: Bosphorus 4K - Video Preset: Faster Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X EPYC 9654 EPYC 9754 EPYC 8534P EPYC 8534PN Xeon 6766E Xeon 6780E 4 8 12 16 20 SE +/- 0.12, N = 3 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 0.16, N = 3 SE +/- 0.05, N = 3 SE +/- 0.11, N = 3 SE +/- 0.13, N = 3 SE +/- 0.13, N = 3 SE +/- 0.13, N = 6 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 13.26 15.97 15.06 12.54 14.10 11.90 14.36 11.97 13.02 13.10 17.02 16.73 14.79 13.97 13.61 10.39 11.18 1. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects Frames Per Second Per Watt
OpenBenchmarking.org Frames Per Second Per Watt, More Is Better VVenC 1.11 Video Input: Bosphorus 4K - Video Preset: Faster Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X EPYC 9654 EPYC 9754 EPYC 8534P EPYC 8534PN Xeon 6766E Xeon 6780E 0.0322 0.0644 0.0966 0.1288 0.161 0.031 0.068 0.060 0.028 0.051 0.023 0.051 0.023 0.038 0.062 0.080 0.090 0.106 0.130 0.143 0.114 0.108 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better VVenC 1.11 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X EPYC 9654 EPYC 9754 EPYC 8534P EPYC 8534PN Xeon 6766E Xeon 6780E 110 220 330 440 550 Min: 77.34 / Avg: 425.45 / Max: 535.49 Min: 34.91 / Avg: 235.39 / Max: 320.85 Min: 60.17 / Avg: 250.97 / Max: 326.74 Min: 149.66 / Avg: 449.44 / Max: 572.09 Min: 74.46 / Avg: 275.77 / Max: 340.06 Min: 209.37 / Avg: 521.79 / Max: 619.75 Min: 73.18 / Avg: 282.13 / Max: 350.27 Min: 204.58 / Avg: 521.13 / Max: 631.04 Min: 100.84 / Avg: 347.13 / Max: 466.54 Min: 54.24 / Avg: 210.37 / Max: 275.5 Min: 34.49 / Avg: 211.98 / Max: 303.77 Min: 29.27 / Avg: 185.29 / Max: 257.81 Min: 20.86 / Avg: 139.36 / Max: 195.74 Min: 18.52 / Avg: 107.71 / Max: 147.66 Min: 17.01 / Avg: 95.43 / Max: 126.76 Min: 43.53 / Avg: 90.8 / Max: 124.66 Min: 43.51 / Avg: 103.62 / Max: 147.39 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 23116 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 10436 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 11628 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 26067 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 13421 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 30960 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 13448 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 31268 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 18572 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 10799 Joules per run. 11. EPYC 9684X: Approximate power consumption of 9115 Joules per run. 12. EPYC 9654: Approximate power consumption of 8153 Joules per run. 13. EPYC 9754: Approximate power consumption of 7061 Joules per run. 14. EPYC 8534P: Approximate power consumption of 5422 Joules per run. 15. EPYC 8534PN: Approximate power consumption of 4931 Joules per run. 16. Xeon 6766E: Approximate power consumption of 5932 Joules per run. 17. Xeon 6780E: Approximate power consumption of 6321 Joules per run. Video Input: Bosphorus 4K - Video Preset: Faster
EPYC 9684X 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
EPYC 9654 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
EPYC 9754 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
Xeon 6766E 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
Xeon 6780E 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
WebP Image Encode This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100, Highest Compression Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.8145 1.629 2.4435 3.258 4.0725 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 5 SE +/- 0.00, N = 5 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 5 SE +/- 0.00, N = 5 SE +/- 0.00, N = 5 SE +/- 0.00, N = 5 3.46 3.47 3.08 3.07 3.10 3.09 3.10 3.09 2.81 2.82 3.62 3.61 3.62 3.62 3.04 3.03 3.03 3.03 2.23 2.23 2.49 2.47 1. (CC) gcc options: -fvisibility=hidden -O2 -lm MP/s Per Watt
OpenBenchmarking.org MP/s Per Watt, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100, Highest Compression Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0162 0.0324 0.0486 0.0648 0.081 0.019 0.051 0.035 0.014 0.028 0.011 0.026 0.011 0.017 0.033 0.019 0.044 0.048 0.021 0.049 0.020 0.069 0.072 0.021 0.051 0.056 0.023 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better WebP Image Encode 1.2.4 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 70 140 210 280 350 Min: 74.68 / Avg: 186.13 / Max: 288.17 Min: 34.25 / Avg: 68.3 / Max: 101.37 Min: 59.48 / Avg: 88.57 / Max: 151.52 Min: 148.59 / Avg: 222.03 / Max: 316.69 Min: 70.24 / Avg: 111.05 / Max: 144.04 Min: 200.76 / Avg: 274.15 / Max: 348.74 Min: 81.36 / Avg: 119.53 / Max: 163.62 Min: 205.94 / Avg: 277 / Max: 371.07 Min: 100.4 / Avg: 169.36 / Max: 210.51 Min: 50.09 / Avg: 86.28 / Max: 102.41 Min: 63.07 / Avg: 192.89 / Max: 262.1 Min: 32.65 / Avg: 82.63 / Max: 115.67 Min: 28.98 / Avg: 75.95 / Max: 101.21 Min: 56.66 / Avg: 176 / Max: 238.56 Min: 20.53 / Avg: 61.84 / Max: 81.06 Min: 39.42 / Avg: 149.38 / Max: 197.42 Min: 16.45 / Avg: 44.16 / Max: 57.18 Min: 16.53 / Avg: 42.26 / Max: 55.05 Min: 103.85 / Avg: 107.03 / Max: 109.06 Min: 43.59 / Avg: 43.93 / Max: 46.02 Min: 43.35 / Avg: 44.16 / Max: 45.33 Min: 105.24 / Avg: 107.9 / Max: 111.31 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 2109 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 774 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 1078 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 2701 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 1314 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 3336 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 1434 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 3370 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 2202 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 1104 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 2122 Joules per run. 12. EPYC 9684X: Approximate power consumption of 978 Joules per run. 13. EPYC 9654: Approximate power consumption of 810 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 1907 Joules per run. 15. EPYC 9754: Approximate power consumption of 752 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 1842 Joules per run. 17. EPYC 8534P: Approximate power consumption of 537 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 514 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 1627 Joules per run. 20. Xeon 6766E: Approximate power consumption of 659 Joules per run. 21. Xeon 6780E: Approximate power consumption of 618 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 1532 Joules per run.
OpenFOAM OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Mesh Time Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 40 80 120 160 200 139.62 148.40 160.73 162.03 153.12 134.78 150.67 159.31 162.32 182.24 135.52 118.54 136.40 140.48 167.41 192.42 163.70 188.37 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
PyBench This test profile reports the total time of the different average timed test results from PyBench. PyBench reports average test times for different functions such as BuiltinFunctionCalls and NestedForLoops, with this total result providing a rough estimate as to Python's average performance on a given system. This test profile runs PyBench each time for 20 rounds. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Milliseconds, Fewer Is Better PyBench 2018-02-16 Total For Average Test Times Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 200 400 600 800 1000 SE +/- 0.48, N = 4 SE +/- 0.41, N = 4 SE +/- 0.33, N = 3 SE +/- 1.15, N = 3 SE +/- 0.33, N = 3 SE +/- 0.67, N = 3 SE +/- 0.58, N = 3 SE +/- 0.67, N = 3 SE +/- 0.33, N = 3 SE +/- 2.85, N = 3 SE +/- 1.20, N = 3 SE +/- 2.08, N = 3 SE +/- 2.19, N = 3 SE +/- 1.86, N = 3 SE +/- 0.58, N = 3 SE +/- 1.33, N = 3 SE +/- 1.45, N = 3 SE +/- 2.40, N = 3 SE +/- 0.33, N = 3 SE +/- 1.15, N = 3 SE +/- 0.88, N = 3 SE +/- 0.58, N = 3 692 691 765 767 763 763 762 763 971 973 818 818 818 822 974 972 976 974 1119 1117 1007 1005 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better PyBench 2018-02-16 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 60 120 180 240 300 Min: 79.78 / Avg: 194.14 / Max: 289.01 Min: 33.53 / Avg: 85.96 / Max: 134.17 Min: 58.93 / Avg: 88.45 / Max: 123.25 Min: 163.51 / Avg: 228.16 / Max: 305.07 Min: 74.61 / Avg: 114.52 / Max: 125.95 Min: 206.86 / Avg: 276.72 / Max: 343.62 Min: 83.03 / Avg: 121.48 / Max: 133.99 Min: 205.54 / Avg: 276.95 / Max: 327.1 Min: 98.37 / Avg: 177.98 / Max: 196.22 Min: 49.36 / Avg: 92.52 / Max: 101.33 Min: 65.07 / Avg: 232.2 / Max: 264.86 Min: 33.11 / Avg: 99.97 / Max: 113.9 Min: 28.15 / Avg: 88.41 / Max: 100.93 Min: 57.47 / Avg: 207.73 / Max: 239.74 Min: 19.44 / Avg: 72.53 / Max: 81.29 Min: 38.38 / Avg: 175.13 / Max: 196.99 Min: 15.93 / Avg: 48.41 / Max: 54.07 Min: 14.86 / Avg: 47.57 / Max: 53.35 Min: 103.97 / Avg: 107.3 / Max: 109.09 Min: 43.58 / Avg: 43.95 / Max: 46.08 Min: 43.46 / Avg: 45.25 / Max: 46 Min: 106.05 / Avg: 107.95 / Max: 109.82 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 3980 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 1762 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 1975 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 5248 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 2519 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 6088 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 2713 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 6093 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 4805 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 2498 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 5418 Joules per run. 12. EPYC 9684X: Approximate power consumption of 2399 Joules per run. 13. EPYC 9654: Approximate power consumption of 2092 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 5055 Joules per run. 15. EPYC 9754: Approximate power consumption of 2007 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 4904 Joules per run. 17. EPYC 8534P: Approximate power consumption of 1339 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1332 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 3970 Joules per run. 20. Xeon 6766E: Approximate power consumption of 1392 Joules per run. 21. Xeon 6780E: Approximate power consumption of 1282 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 3059 Joules per run.
Google SynthMark SynthMark is a cross platform tool for benchmarking CPU performance under a variety of real-time audio workloads. It uses a polyphonic synthesizer model to provide standardized tests for latency, jitter and computational throughput. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Voices, More Is Better Google SynthMark 20201109 Test: VoiceMark_100 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 200 400 600 800 1000 SE +/- 0.38, N = 3 SE +/- 0.13, N = 3 SE +/- 0.22, N = 3 SE +/- 1.51, N = 3 SE +/- 0.26, N = 3 SE +/- 0.30, N = 3 SE +/- 0.24, N = 3 SE +/- 0.48, N = 3 SE +/- 0.53, N = 3 SE +/- 7.09, N = 3 SE +/- 0.72, N = 3 SE +/- 0.69, N = 3 SE +/- 0.55, N = 3 SE +/- 0.56, N = 3 SE +/- 0.45, N = 3 SE +/- 0.88, N = 3 SE +/- 0.14, N = 3 SE +/- 0.60, N = 3 SE +/- 0.33, N = 3 SE +/- 0.58, N = 3 SE +/- 0.18, N = 3 SE +/- 0.06, N = 3 799.49 799.72 711.38 712.70 711.10 710.92 712.01 712.09 548.36 555.60 783.20 783.42 783.78 782.32 655.80 655.05 655.24 656.25 494.38 494.05 540.24 538.91 1. (CXX) g++ options: -lm -lpthread -std=c++11 -Ofast Voices Per Watt
OpenBenchmarking.org Voices Per Watt, More Is Better Google SynthMark 20201109 Test: VoiceMark_100 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 3 6 9 12 15 3.121 7.777 7.626 3.044 6.250 2.322 5.891 2.567 2.986 5.954 3.246 7.582 8.699 3.607 9.006 3.610 12.984 13.295 4.640 11.291 12.340 4.969 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Google SynthMark 20201109 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 70 140 210 280 350 Min: 77.31 / Avg: 256.19 / Max: 292.81 Min: 33.54 / Avg: 102.83 / Max: 128.91 Min: 63.55 / Avg: 93.65 / Max: 130.75 Min: 172.36 / Avg: 234.1 / Max: 329.35 Min: 75.06 / Avg: 113.78 / Max: 122.61 Min: 203.32 / Avg: 306.14 / Max: 413.85 Min: 84.65 / Avg: 120.87 / Max: 129.59 Min: 201.92 / Avg: 277.45 / Max: 348.85 Min: 99.91 / Avg: 183.65 / Max: 205.87 Min: 52.55 / Avg: 93.31 / Max: 100.6 Min: 61.62 / Avg: 241.28 / Max: 266.15 Min: 33.97 / Avg: 103.33 / Max: 113.89 Min: 28.69 / Avg: 90.1 / Max: 99.51 Min: 57.99 / Avg: 216.87 / Max: 238.45 Min: 21.02 / Avg: 72.82 / Max: 80.06 Min: 40.35 / Avg: 181.43 / Max: 200.97 Min: 17.96 / Avg: 50.47 / Max: 55.88 Min: 16.18 / Avg: 49.36 / Max: 54.66 Min: 104.37 / Avg: 106.55 / Max: 109.25 Min: 43.51 / Avg: 43.76 / Max: 45.51 Min: 43.34 / Avg: 43.78 / Max: 45.89 Min: 106.8 / Avg: 108.46 / Max: 112.7 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 8796 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 3496 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 3215 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 8115 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 3906 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 10511 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 4110 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 9433 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 6244 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 3173 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 8284 Joules per run. 12. EPYC 9684X: Approximate power consumption of 3513 Joules per run. 13. EPYC 9654: Approximate power consumption of 3063 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 7374 Joules per run. 15. EPYC 9754: Approximate power consumption of 2500 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 6229 Joules per run. 17. EPYC 8534P: Approximate power consumption of 1733 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1678 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 3658 Joules per run. 20. Xeon 6766E: Approximate power consumption of 1517 Joules per run. 21. Xeon 6780E: Approximate power consumption of 1489 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 3688 Joules per run.
Timed Mesa Compilation This test profile times how long it takes to compile Mesa with Meson/Ninja. For minimizing build dependencies and avoid versioning conflicts, test this is just the core Mesa build without LLVM or the extra Gallium3D/Mesa drivers enabled. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Seconds, Fewer Is Better Timed Mesa Compilation 24.0 Time To Compile Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 6 12 18 24 30 SE +/- 0.05, N = 4 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.08, N = 3 SE +/- 0.17, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.08, N = 4 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 4 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 16.18 17.26 19.23 18.29 20.18 18.47 19.65 18.14 21.44 23.66 16.40 16.67 16.96 16.41 19.91 19.56 21.04 21.53 25.88 25.89 23.41 23.46 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Timed Mesa Compilation 24.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 82.26 / Avg: 324.23 / Max: 753.39 Min: 32.86 / Avg: 176.64 / Max: 377.39 Min: 57 / Avg: 172.35 / Max: 378.42 Min: 171.78 / Avg: 374.89 / Max: 753.6 Min: 74.89 / Avg: 232.74 / Max: 375.37 Min: 199.11 / Avg: 446.38 / Max: 751.99 Min: 73.22 / Avg: 228.31 / Max: 375.9 Min: 195.35 / Avg: 442.47 / Max: 753.73 Min: 99.18 / Avg: 266.43 / Max: 584.3 Min: 52.69 / Avg: 166.64 / Max: 291.22 Min: 65.81 / Avg: 287.81 / Max: 802.37 Min: 33.71 / Avg: 153.28 / Max: 411.05 Min: 27.72 / Avg: 132.61 / Max: 328.77 Min: 53.33 / Avg: 251.26 / Max: 671.83 Min: 20.4 / Avg: 109.13 / Max: 324.24 Min: 41.25 / Avg: 215.57 / Max: 638.97 Min: 18.48 / Avg: 79 / Max: 166.34 Min: 16.52 / Avg: 73.01 / Max: 143.27 Min: 104.21 / Avg: 137.28 / Max: 498.1 Min: 43.62 / Avg: 71.87 / Max: 255.49 Min: 43.31 / Avg: 79.63 / Max: 313.34 Min: 106.87 / Avg: 146.41 / Max: 572.5 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 7052 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 4063 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 5343 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 9247 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 5974 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 10862 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 5860 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 10619 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 7282 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 4944 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 6260 Joules per run. 12. EPYC 9684X: Approximate power consumption of 3474 Joules per run. 13. EPYC 9654: Approximate power consumption of 3050 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 5402 Joules per run. 15. EPYC 9754: Approximate power consumption of 2874 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 5605 Joules per run. 17. EPYC 8534P: Approximate power consumption of 2159 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 2044 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 4484 Joules per run. 20. Xeon 6766E: Approximate power consumption of 2324 Joules per run. 21. Xeon 6780E: Approximate power consumption of 2389 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 4392 Joules per run.
SecureMark SecureMark is an objective, standardized benchmarking framework for measuring the efficiency of cryptographic processing solutions developed by EEMBC. SecureMark-TLS is benchmarking Transport Layer Security performance with a focus on IoT/edge computing. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org marks, More Is Better SecureMark 1.0.4 Benchmark: SecureMark-TLS Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 70K 140K 210K 280K 350K SE +/- 411.11, N = 3 SE +/- 209.97, N = 3 SE +/- 625.56, N = 3 SE +/- 330.95, N = 3 SE +/- 256.85, N = 3 SE +/- 384.08, N = 3 SE +/- 670.43, N = 3 SE +/- 196.24, N = 3 SE +/- 285.52, N = 3 SE +/- 372.88, N = 3 SE +/- 809.90, N = 3 SE +/- 415.71, N = 3 SE +/- 361.20, N = 3 SE +/- 389.81, N = 3 SE +/- 457.42, N = 3 SE +/- 553.62, N = 3 SE +/- 372.96, N = 3 SE +/- 542.88, N = 3 SE +/- 722.69, N = 3 SE +/- 553.57, N = 3 SE +/- 406.59, N = 3 SE +/- 1219.44, N = 3 308434 309896 277205 275472 277647 277589 277260 277298 231076 231357 301740 300833 298341 299610 250695 251075 250024 250162 197298 196740 220051 217536 1. (CC) gcc options: -pedantic -O3 marks Per Watt
OpenBenchmarking.org marks Per Watt, More Is Better SecureMark 1.0.4 Benchmark: SecureMark-TLS Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 1100 2200 3300 4400 5500 1242.56 3643.38 3029.20 1185.32 2308.76 986.37 2198.71 973.55 1197.70 2364.52 1152.38 2686.16 3034.03 1272.88 3204.23 1278.59 4697.25 4781.86 1847.99 4501.16 4990.15 2010.97 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better SecureMark 1.0.4 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 60 120 180 240 300 Min: 78.38 / Avg: 248.23 / Max: 290.1 Min: 33.51 / Avg: 85.06 / Max: 96.45 Min: 53.54 / Avg: 91.51 / Max: 104.77 Min: 171.99 / Avg: 232.4 / Max: 318.93 Min: 74.22 / Avg: 120.26 / Max: 126.65 Min: 137.33 / Avg: 281.43 / Max: 342.59 Min: 85.74 / Avg: 126.1 / Max: 134.53 Min: 124.02 / Avg: 284.83 / Max: 338.05 Min: 97.89 / Avg: 192.93 / Max: 216.11 Min: 49.93 / Avg: 97.85 / Max: 101.93 Min: 60.77 / Avg: 261.84 / Max: 267.2 Min: 31.06 / Avg: 111.99 / Max: 116.51 Min: 28.33 / Avg: 98.33 / Max: 101.2 Min: 56.74 / Avg: 235.38 / Max: 240.55 Min: 18.81 / Avg: 78.24 / Max: 81.48 Min: 41.92 / Avg: 196.37 / Max: 200.73 Min: 16.16 / Avg: 53.23 / Max: 56.82 Min: 14.73 / Avg: 52.31 / Max: 55.82 Min: 103.87 / Avg: 106.76 / Max: 110.05 Min: 43.5 / Avg: 43.71 / Max: 45.5 Min: 43.33 / Avg: 44.1 / Max: 46.18 Min: 106.5 / Avg: 108.17 / Max: 111.72 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 70661 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 24241 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 26081 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 66467 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 34394 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 80019 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 35939 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 81083 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 54922 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 27919 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 74101 Joules per run. 12. EPYC 9684X: Approximate power consumption of 31844 Joules per run. 13. EPYC 9654: Approximate power consumption of 27959 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 66691 Joules per run. 15. EPYC 9754: Approximate power consumption of 22298 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 55769 Joules per run. 17. EPYC 8534P: Approximate power consumption of 15134 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 14892 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 30392 Joules per run. 20. Xeon 6766E: Approximate power consumption of 12442 Joules per run. 21. Xeon 6780E: Approximate power consumption of 12612 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 30794 Joules per run.
OpenFOAM OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Mesh Time Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 9 18 27 36 45 29.33 31.70 31.38 35.60 31.78 32.48 32.00 28.84 36.86 39.12 26.82 25.93 28.03 27.74 30.38 29.47 33.67 36.82 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
Liquid-DSP LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 32 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 500M 1000M 1500M 2000M 2500M SE +/- 17236814.61, N = 3 SE +/- 27191440.65, N = 3 SE +/- 3167192.94, N = 3 SE +/- 3300505.01, N = 3 SE +/- 688799.28, N = 3 SE +/- 2206304.10, N = 3 SE +/- 692820.32, N = 3 SE +/- 3017909.50, N = 3 SE +/- 9052685.30, N = 3 SE +/- 3209534.41, N = 3 SE +/- 2510644.01, N = 3 SE +/- 3000185.18, N = 3 SE +/- 2810891.52, N = 3 SE +/- 1567730.14, N = 3 SE +/- 1550627.11, N = 3 SE +/- 1462114.15, N = 3 SE +/- 3090487.20, N = 3 SE +/- 3256958.36, N = 3 SE +/- 1003881.36, N = 3 SE +/- 1379613.47, N = 3 SE +/- 808290.38, N = 3 SE +/- 4028647.42, N = 3 2154633333 1927766667 1890566667 2025000000 1640266667 1963233333 1679700000 2090466667 1731166667 1561766667 2279300000 2287466667 2282766667 2282066667 1898766667 1894966667 1871333333 1776866667 1780533333 1841400000 2057300000 1989300000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid samples/s Per Watt
OpenBenchmarking.org samples/s Per Watt, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 32 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 4M 8M 12M 16M 20M 4527054.56 6720931.25 6722664.60 3966847.18 6685402.04 3308597.89 6609424.93 3387722.73 4217240.97 6395094.29 5779445.49 8884551.10 9937920.60 6304024.25 11984070.91 7114576.18 14706486.76 17627091.46 9390076.73 15528502.68 14358014.80 9419289.56 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Liquid-DSP 1.6 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 Min: 75.17 / Avg: 475.95 / Max: 586.43 Min: 27.76 / Avg: 286.83 / Max: 364.52 Min: 60.85 / Avg: 281.22 / Max: 356.43 Min: 152.44 / Avg: 510.48 / Max: 610.23 Min: 76.61 / Avg: 245.35 / Max: 268.44 Min: 200.67 / Avg: 593.37 / Max: 651.17 Min: 74.71 / Avg: 254.14 / Max: 326.8 Min: 197.41 / Avg: 617.07 / Max: 678.02 Min: 100.23 / Avg: 410.5 / Max: 516.01 Min: 49.48 / Avg: 244.21 / Max: 290.74 Min: 64.31 / Avg: 394.38 / Max: 445.2 Min: 33.54 / Avg: 257.47 / Max: 292.35 Min: 25.11 / Avg: 229.7 / Max: 257.97 Min: 57.58 / Avg: 362 / Max: 403.93 Min: 20.46 / Avg: 158.44 / Max: 178.44 Min: 38.6 / Avg: 266.35 / Max: 296.68 Min: 15.76 / Avg: 127.25 / Max: 146.72 Min: 15.81 / Avg: 100.8 / Max: 114.74 Min: 104.03 / Avg: 189.62 / Max: 209.49 Min: 43.61 / Avg: 118.58 / Max: 131.69 Min: 43.43 / Avg: 143.29 / Max: 159.65 Min: 105.02 / Avg: 211.19 / Max: 235.86 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 16499 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 9848 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 9655 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 17527 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 8342 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 20372 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 8725 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 21186 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 13957 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 8303 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 13277 Joules per run. 12. EPYC 9684X: Approximate power consumption of 8668 Joules per run. 13. EPYC 9654: Approximate power consumption of 7810 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 12308 Joules per run. 15. EPYC 9754: Approximate power consumption of 5440 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 9056 Joules per run. 17. EPYC 8534P: Approximate power consumption of 4369 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 3394 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 6384 Joules per run. 20. Xeon 6766E: Approximate power consumption of 4071 Joules per run. 21. Xeon 6780E: Approximate power consumption of 4919 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 7251 Joules per run.
Result
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 32 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 9M 18M 27M 36M 45M SE +/- 419600.12, N = 5 SE +/- 417042.80, N = 5 SE +/- 1527.53, N = 3 SE +/- 1154.70, N = 3 SE +/- 1666.67, N = 3 SE +/- 1201.85, N = 3 SE +/- 3000.00, N = 3 SE +/- 1452.97, N = 3 SE +/- 577.35, N = 3 SE +/- 1000.00, N = 3 SE +/- 19139.84, N = 3 SE +/- 7023.77, N = 3 SE +/- 7753.14, N = 3 SE +/- 13503.09, N = 3 SE +/- 6984.11, N = 3 SE +/- 2185.81, N = 3 SE +/- 2333.33, N = 3 SE +/- 881.92, N = 3 SE +/- 881.92, N = 3 SE +/- 0.00, N = 3 SE +/- 1527.53, N = 3 SE +/- 881.92, N = 3 38950600 40244000 36506000 36461000 36537667 36497667 36539000 36521333 31992000 31995000 36040000 36066000 36068333 36033000 29907333 29893333 29899667 29899333 31705667 31726000 35259000 35190667 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid samples/s Per Watt
OpenBenchmarking.org samples/s Per Watt, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 32 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 200K 400K 600K 800K 1000K 215045.22 509090.21 411972.01 158420.27 318611.94 133630.14 300054.21 130400.41 175115.57 340868.75 148995.98 344631.62 393460.52 165061.92 410323.62 166453.31 588721.27 596676.31 300148.32 725751.19 803665.72 326342.24 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Liquid-DSP 1.6 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 60 120 180 240 300 Min: 81.91 / Avg: 181.13 / Max: 198.07 Min: 33.18 / Avg: 79.05 / Max: 85.63 Min: 61.4 / Avg: 88.61 / Max: 120.23 Min: 163.87 / Avg: 230.15 / Max: 297.76 Min: 72.3 / Avg: 114.68 / Max: 123.65 Min: 199.94 / Avg: 273.12 / Max: 314.88 Min: 84.78 / Avg: 121.77 / Max: 132.95 Min: 204.92 / Avg: 280.07 / Max: 323.05 Min: 96.06 / Avg: 182.69 / Max: 203.89 Min: 51.12 / Avg: 93.86 / Max: 101.44 Min: 62.85 / Avg: 241.89 / Max: 266.07 Min: 33.02 / Avg: 104.65 / Max: 115.43 Min: 29.58 / Avg: 91.67 / Max: 100.42 Min: 55.79 / Avg: 218.3 / Max: 239.44 Min: 20.11 / Avg: 72.89 / Max: 80.63 Min: 37.62 / Avg: 179.59 / Max: 198.37 Min: 17.38 / Avg: 50.79 / Max: 56.16 Min: 16.61 / Avg: 50.11 / Max: 55.4 Min: 103.77 / Avg: 105.63 / Max: 107.48 Min: 43.55 / Avg: 43.71 / Max: 45.4 Min: 43.37 / Avg: 43.87 / Max: 45.94 Min: 104.44 / Avg: 107.83 / Max: 110.44 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 6195 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 2688 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 3042 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 7825 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 3899 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 9286 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 4181 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 9522 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 6211 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 3223 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 8305 Joules per run. 12. EPYC 9684X: Approximate power consumption of 3593 Joules per run. 13. EPYC 9654: Approximate power consumption of 3117 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 7495 Joules per run. 15. EPYC 9754: Approximate power consumption of 2502 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 6106 Joules per run. 17. EPYC 8534P: Approximate power consumption of 1744 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1704 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 3592 Joules per run. 20. Xeon 6766E: Approximate power consumption of 1486 Joules per run. 21. Xeon 6780E: Approximate power consumption of 1506 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 3666 Joules per run.
ONNX Runtime OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.17 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 90 180 270 360 450 Min: 103.45 / Avg: 419.57 / Max: 461.32 Min: 53.43 / Avg: 226.19 / Max: 247.32 Min: 60.67 / Avg: 475.62 / Max: 514.58 Min: 31.9 / Avg: 250.92 / Max: 275.39 Min: 26.28 / Avg: 211.37 / Max: 231.46 Min: 54.43 / Avg: 417.34 / Max: 450.65 Min: 19.69 / Avg: 171.56 / Max: 188.27 Min: 40.25 / Avg: 308.06 / Max: 331.38 Min: 18.14 / Avg: 109.41 / Max: 118.96 Min: 16.01 / Avg: 98.3 / Max: 106.86 Min: 104.4 / Avg: 226.53 / Max: 245.57 Min: 43.64 / Avg: 132.23 / Max: 144.22 Min: 43.52 / Avg: 154.49 / Max: 168.64 Min: 106.43 / Avg: 248.46 / Max: 271.28
OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.17 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 90 180 270 360 450 Min: 95.98 / Avg: 424.24 / Max: 455.9 Min: 51.89 / Avg: 246.13 / Max: 266.29 Min: 63.67 / Avg: 460.32 / Max: 497.92 Min: 33.42 / Avg: 261.74 / Max: 283.2 Min: 29.64 / Avg: 222.91 / Max: 240.57 Min: 56.36 / Avg: 405.91 / Max: 434.32 Min: 20.33 / Avg: 188.2 / Max: 202.92 Min: 38.39 / Avg: 302.95 / Max: 323.86 Min: 16.8 / Avg: 119.38 / Max: 129.78 Min: 16.97 / Avg: 101.89 / Max: 112.56 Min: 104.06 / Avg: 210.79 / Max: 227.9 Min: 43.62 / Avg: 139.52 / Max: 148.88 Min: 43.51 / Avg: 163.29 / Max: 175 Min: 106.24 / Avg: 233.19 / Max: 250.31
OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.17 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 Min: 100.08 / Avg: 498.61 / Max: 537.57 Min: 53.6 / Avg: 252.85 / Max: 280.59 Min: 64.5 / Avg: 611.91 / Max: 674.71 Min: 33.76 / Avg: 321.88 / Max: 360.42 Min: 27.94 / Avg: 273.66 / Max: 300.92 Min: 60.03 / Avg: 522.44 / Max: 571.64 Min: 21.08 / Avg: 240.98 / Max: 267.52 Min: 41.83 / Avg: 453.96 / Max: 496.3 Min: 19.31 / Avg: 140.51 / Max: 154.48 Min: 17.45 / Avg: 121.04 / Max: 134.63 Min: 105.71 / Avg: 414.92 / Max: 451.7 Min: 43.7 / Avg: 200.72 / Max: 216.16 Min: 43.58 / Avg: 243.68 / Max: 263.63 Min: 108.32 / Avg: 473.62 / Max: 514.95
CPU Power Consumption Monitor OpenBenchmarking.org Watts CPU Power Consumption Monitor Phoronix Test Suite System Monitoring Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 170 340 510 680 850 Min: 39.72 / Avg: 455.07 / Max: 946.96 Min: 17.77 / Avg: 260.08 / Max: 405.42 Min: 30.38 / Avg: 278.1 / Max: 383.24 Min: 87.48 / Avg: 517.33 / Max: 758.17 Min: 38.11 / Avg: 291.53 / Max: 379.76 Min: 102.49 / Avg: 566.6 / Max: 756.48 Min: 38.16 / Avg: 295.53 / Max: 384.53 Min: 95.52 / Avg: 569.8 / Max: 760.61 Min: 51.38 / Avg: 437.37 / Max: 583.47 Min: 26.31 / Avg: 237.91 / Max: 292.14 Min: 33.66 / Avg: 525.49 / Max: 837.69 Min: 17.06 / Avg: 290.08 / Max: 413.51 Min: 14.69 / Avg: 244.69 / Max: 373.1 Min: 35.7 / Avg: 464.49 / Max: 751.79 Min: 10.09 / Avg: 225.05 / Max: 397.44 Min: 20.22 / Avg: 375.51 / Max: 735.74 Min: 8.43 / Avg: 128.7 / Max: 184.62 Min: 9.26 / Avg: 114.13 / Max: 155.71 Min: 52.85 / Avg: 291.05 / Max: 542.48 Min: 21.86 / Avg: 142.1 / Max: 271.22 Min: 21.7 / Avg: 169.1 / Max: 357.69 Min: 53.44 / Avg: 321.01 / Max: 713.33
Stockfish OpenBenchmarking.org Watts, Fewer Is Better Stockfish 16.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 78.55 / Avg: 672.28 / Max: 755.5 Min: 22.35 / Avg: 337.72 / Max: 370.84 Min: 56.83 / Avg: 339.56 / Max: 379.91 Min: 166.29 / Avg: 678.39 / Max: 758.17 Min: 71.31 / Avg: 341.39 / Max: 379.06 Min: 203.83 / Avg: 679.75 / Max: 756.48 Min: 74.29 / Avg: 341.12 / Max: 366.15 Min: 195.85 / Avg: 680.45 / Max: 758.53 Min: 100.78 / Avg: 519.4 / Max: 581.59 Min: 53.05 / Avg: 263.42 / Max: 290.77 Min: 70.77 / Avg: 766.5 / Max: 822.06 Min: 35.5 / Avg: 386.38 / Max: 410.66 Min: 30.05 / Avg: 347.3 / Max: 373.1 Min: 57.4 / Avg: 686.5 / Max: 751.79 Min: 21.51 / Avg: 332.06 / Max: 363.69 Min: 37.25 / Avg: 640.56 / Max: 735.74 Min: 17.26 / Avg: 174.36 / Max: 184.62 Min: 16.19 / Avg: 145.98 / Max: 155.71 Min: 105.79 / Avg: 474.56 / Max: 541.15 Min: 43.78 / Avg: 240.94 / Max: 270.17 Min: 43.61 / Avg: 310.08 / Max: 337.09 Min: 109.43 / Avg: 618.97 / Max: 701.47
OpenBenchmarking.org Nodes Per Second Per Watt, More Is Better Stockfish 16.1 Chess Benchmark Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130K 260K 390K 520K 650K 331127.60 325017.74 285328.34 276776.39 199243.06 202981.45 215737.78 219573.26 201379.09 193986.52 520707.98 555213.84 569277.48 540060.41 571475.98 470216.10 568916.36 621037.11 496138.40 509643.71 403742.35 431231.39
Result
OpenBenchmarking.org Nodes Per Second, More Is Better Stockfish 16.1 Chess Benchmark Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 90M 180M 270M 360M 450M SE +/- 2482737.87, N = 3 SE +/- 2966712.90, N = 9 SE +/- 1304590.97, N = 3 SE +/- 2148606.38, N = 4 SE +/- 1751369.24, N = 12 SE +/- 4344961.90, N = 10 SE +/- 629927.17, N = 3 SE +/- 2925715.37, N = 11 SE +/- 1325249.25, N = 3 SE +/- 1466028.98, N = 9 SE +/- 919073.22, N = 3 SE +/- 2268830.04, N = 3 SE +/- 3170744.86, N = 15 SE +/- 2356843.91, N = 3 SE +/- 4652276.19, N = 12 SE +/- 7961094.38, N = 12 SE +/- 2397455.91, N = 12 SE +/- 2147688.02, N = 12 SE +/- 2692064.58, N = 4 SE +/- 3565305.92, N = 15 SE +/- 1441726.26, N = 3 SE +/- 3095674.84, N = 3 222610378 109766345 96887479 187761769 68019088 137977203 73592230 149409082 104597200 51099545 399124223 214524659 197708350 370751530 189763799 301202232 99198144 90658156 235445499 122794246 125194066 266919825 1. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver Nodes Per Second Per Watt
OpenBenchmarking.org Nodes Per Second Per Watt, More Is Better Stockfish 16.1 Chess Benchmark Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130K 260K 390K 520K 650K 331127.60 325017.74 285328.34 276776.39 199243.06 202981.45 215737.78 219573.26 201379.09 193986.52 520707.98 555213.84 569277.48 540060.41 571475.98 470216.10 568916.36 621037.11 496138.40 509643.71 403742.35 431231.39 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Stockfish 16.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 78.55 / Avg: 672.28 / Max: 755.5 Min: 22.35 / Avg: 337.72 / Max: 370.84 Min: 56.83 / Avg: 339.56 / Max: 379.91 Min: 166.29 / Avg: 678.39 / Max: 758.17 Min: 71.31 / Avg: 341.39 / Max: 379.06 Min: 203.83 / Avg: 679.75 / Max: 756.48 Min: 74.29 / Avg: 341.12 / Max: 366.15 Min: 195.85 / Avg: 680.45 / Max: 758.53 Min: 100.78 / Avg: 519.4 / Max: 581.59 Min: 53.05 / Avg: 263.42 / Max: 290.77 Min: 70.77 / Avg: 766.5 / Max: 822.06 Min: 35.5 / Avg: 386.38 / Max: 410.66 Min: 30.05 / Avg: 347.3 / Max: 373.1 Min: 57.4 / Avg: 686.5 / Max: 751.79 Min: 21.51 / Avg: 332.06 / Max: 363.69 Min: 37.25 / Avg: 640.56 / Max: 735.74 Min: 17.26 / Avg: 174.36 / Max: 184.62 Min: 16.19 / Avg: 145.98 / Max: 155.71 Min: 105.79 / Avg: 474.56 / Max: 541.15 Min: 43.78 / Avg: 240.94 / Max: 270.17 Min: 43.61 / Avg: 310.08 / Max: 337.09 Min: 109.43 / Avg: 618.97 / Max: 701.47 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 80225 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 41915 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 44483 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 85138 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 48989 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 84357 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 47870 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 89882 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 64926 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 40040 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 63364 Joules per run. 12. EPYC 9684X: Approximate power consumption of 32714 Joules per run. 13. EPYC 9654: Approximate power consumption of 31720 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 62700 Joules per run. 15. EPYC 9754: Approximate power consumption of 41673 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 77348 Joules per run. 17. EPYC 8534P: Approximate power consumption of 20371 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 19208 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 56116 Joules per run. 20. Xeon 6766E: Approximate power consumption of 27740 Joules per run. 21. Xeon 6780E: Approximate power consumption of 28528 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 67055 Joules per run.
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 11 22 33 44 55 SE +/- 0.09, N = 3 SE +/- 0.09, N = 3 SE +/- 0.04, N = 3 SE +/- 0.12, N = 3 SE +/- 0.11, N = 3 SE +/- 0.40, N = 3 SE +/- 0.31, N = 3 SE +/- 0.33, N = 3 SE +/- 0.35, N = 3 SE +/- 0.01, N = 3 SE +/- 0.40, N = 15 SE +/- 0.61, N = 15 SE +/- 0.50, N = 15 SE +/- 0.61, N = 15 SE +/- 0.45, N = 15 SE +/- 0.23, N = 15 SE +/- 0.63, N = 15 SE +/- 0.61, N = 15 SE +/- 0.36, N = 11 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.35, N = 3 28.85 29.02 29.41 29.75 33.33 36.23 33.99 36.00 29.76 28.02 22.79 21.58 23.92 25.32 26.45 27.90 27.93 26.83 47.20 41.08 36.78 43.81 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.17 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 90 180 270 360 450 Min: 103.45 / Avg: 419.57 / Max: 461.32 Min: 53.43 / Avg: 226.19 / Max: 247.32 Min: 60.67 / Avg: 475.62 / Max: 514.58 Min: 31.9 / Avg: 250.92 / Max: 275.39 Min: 26.28 / Avg: 211.37 / Max: 231.46 Min: 54.43 / Avg: 417.34 / Max: 450.65 Min: 19.69 / Avg: 171.56 / Max: 188.27 Min: 40.25 / Avg: 308.06 / Max: 331.38 Min: 18.14 / Avg: 109.41 / Max: 118.96 Min: 16.01 / Avg: 98.3 / Max: 106.86 Min: 104.4 / Avg: 226.53 / Max: 245.57 Min: 43.64 / Avg: 132.23 / Max: 144.22 Min: 43.52 / Avg: 154.49 / Max: 168.64 Min: 106.43 / Avg: 248.46 / Max: 271.28 1. Xeon Platinum 8380 2P: Approximate power consumption of 27831 Joules per run. 2. Xeon Platinum 8380: Approximate power consumption of 15080 Joules per run. 3. EPYC 9684X 2P: Approximate power consumption of 31169 Joules per run. 4. EPYC 9684X: Approximate power consumption of 16477 Joules per run. 5. EPYC 9654: Approximate power consumption of 13894 Joules per run. 6. EPYC 9654 2P: Approximate power consumption of 27349 Joules per run. 7. EPYC 9754: Approximate power consumption of 11346 Joules per run. 8. EPYC 9754 2P: Approximate power consumption of 20373 Joules per run. 9. EPYC 8534P: Approximate power consumption of 7243 Joules per run. 10. EPYC 8534PN: Approximate power consumption of 6514 Joules per run. 11. Xeon 6766E 2P: Approximate power consumption of 15301 Joules per run. 12. Xeon 6766E: Approximate power consumption of 8903 Joules per run. 13. Xeon 6780E: Approximate power consumption of 10351 Joules per run. 14. Xeon 6780E 2P: Approximate power consumption of 16978 Joules per run.
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 11 22 33 44 55 SE +/- 0.11, N = 3 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 SE +/- 0.13, N = 3 SE +/- 0.09, N = 3 SE +/- 0.31, N = 3 SE +/- 0.27, N = 3 SE +/- 0.26, N = 3 SE +/- 0.40, N = 3 SE +/- 0.01, N = 3 SE +/- 0.76, N = 15 SE +/- 1.36, N = 15 SE +/- 0.91, N = 15 SE +/- 0.92, N = 15 SE +/- 0.63, N = 15 SE +/- 0.27, N = 15 SE +/- 0.87, N = 15 SE +/- 0.82, N = 15 SE +/- 0.16, N = 11 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.18, N = 3 34.66 34.46 34.00 33.61 30.00 27.61 29.43 27.78 33.60 35.69 44.06 46.88 42.07 39.80 37.96 35.87 36.08 37.53 21.20 24.34 27.18 22.83 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 11 22 33 44 55 SE +/- 0.09, N = 3 SE +/- 0.09, N = 3 SE +/- 0.04, N = 3 SE +/- 0.12, N = 3 SE +/- 0.11, N = 3 SE +/- 0.40, N = 3 SE +/- 0.31, N = 3 SE +/- 0.33, N = 3 SE +/- 0.35, N = 3 SE +/- 0.01, N = 3 SE +/- 0.40, N = 15 SE +/- 0.61, N = 15 SE +/- 0.50, N = 15 SE +/- 0.61, N = 15 SE +/- 0.45, N = 15 SE +/- 0.23, N = 15 SE +/- 0.63, N = 15 SE +/- 0.61, N = 15 SE +/- 0.36, N = 11 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.35, N = 3 28.85 29.02 29.41 29.75 33.33 36.23 33.99 36.00 29.76 28.02 22.79 21.58 23.92 25.32 26.45 27.90 27.93 26.83 47.20 41.08 36.78 43.81 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: bertsquad-12 - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 30 60 90 120 150 SE +/- 0.44, N = 3 SE +/- 0.04, N = 3 SE +/- 0.17, N = 3 SE +/- 0.62, N = 3 SE +/- 0.44, N = 3 SE +/- 0.68, N = 3 SE +/- 0.23, N = 3 SE +/- 1.12, N = 15 SE +/- 0.29, N = 3 SE +/- 1.84, N = 12 SE +/- 2.80, N = 15 SE +/- 0.18, N = 3 SE +/- 0.17, N = 3 SE +/- 0.90, N = 6 SE +/- 0.70, N = 15 SE +/- 2.33, N = 12 SE +/- 0.51, N = 3 SE +/- 1.26, N = 3 SE +/- 6.85, N = 15 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 SE +/- 6.88, N = 15 44.60 39.75 49.64 60.36 47.24 60.11 49.97 55.90 54.28 48.47 90.06 71.56 72.12 93.83 87.66 93.64 80.72 86.65 155.90 124.06 111.87 141.57 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.17 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 90 180 270 360 450 Min: 95.98 / Avg: 424.24 / Max: 455.9 Min: 51.89 / Avg: 246.13 / Max: 266.29 Min: 63.67 / Avg: 460.32 / Max: 497.92 Min: 33.42 / Avg: 261.74 / Max: 283.2 Min: 29.64 / Avg: 222.91 / Max: 240.57 Min: 56.36 / Avg: 405.91 / Max: 434.32 Min: 20.33 / Avg: 188.2 / Max: 202.92 Min: 38.39 / Avg: 302.95 / Max: 323.86 Min: 16.8 / Avg: 119.38 / Max: 129.78 Min: 16.97 / Avg: 101.89 / Max: 112.56 Min: 104.06 / Avg: 210.79 / Max: 227.9 Min: 43.62 / Avg: 139.52 / Max: 148.88 Min: 43.51 / Avg: 163.29 / Max: 175 Min: 106.24 / Avg: 233.19 / Max: 250.31 1. Xeon Platinum 8380 2P: Approximate power consumption of 27717 Joules per run. 2. Xeon Platinum 8380: Approximate power consumption of 15999 Joules per run. 3. EPYC 9684X 2P: Approximate power consumption of 29798 Joules per run. 4. EPYC 9684X: Approximate power consumption of 16926 Joules per run. 5. EPYC 9654: Approximate power consumption of 14564 Joules per run. 6. EPYC 9654 2P: Approximate power consumption of 26384 Joules per run. 7. EPYC 9754: Approximate power consumption of 12233 Joules per run. 8. EPYC 9754 2P: Approximate power consumption of 19692 Joules per run. 9. EPYC 8534P: Approximate power consumption of 7799 Joules per run. 10. EPYC 8534PN: Approximate power consumption of 6691 Joules per run. 11. Xeon 6766E 2P: Approximate power consumption of 13884 Joules per run. 12. Xeon 6766E: Approximate power consumption of 9162 Joules per run. 13. Xeon 6780E: Approximate power consumption of 10723 Joules per run. 14. Xeon 6780E 2P: Approximate power consumption of 15344 Joules per run.
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: bertsquad-12 - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 6 12 18 24 30 SE +/- 0.21982, N = 3 SE +/- 0.02370, N = 3 SE +/- 0.07031, N = 3 SE +/- 0.16743, N = 3 SE +/- 0.19764, N = 3 SE +/- 0.18711, N = 3 SE +/- 0.09194, N = 3 SE +/- 0.35497, N = 15 SE +/- 0.09869, N = 3 SE +/- 0.58074, N = 12 SE +/- 0.38561, N = 15 SE +/- 0.03564, N = 3 SE +/- 0.03352, N = 3 SE +/- 0.10002, N = 6 SE +/- 0.09294, N = 15 SE +/- 0.26635, N = 12 SE +/- 0.07825, N = 3 SE +/- 0.16639, N = 3 SE +/- 0.31004, N = 15 SE +/- 0.00331, N = 3 SE +/- 0.00509, N = 3 SE +/- 0.36771, N = 15 22.42510 25.15910 20.14530 16.57050 21.17020 16.63940 20.01030 17.98730 18.42220 20.87230 11.27070 13.97450 13.86470 10.66150 11.41820 10.75188 12.38840 11.54470 6.60471 8.06013 8.93833 7.31285 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: bertsquad-12 - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 30 60 90 120 150 SE +/- 0.44, N = 3 SE +/- 0.04, N = 3 SE +/- 0.17, N = 3 SE +/- 0.62, N = 3 SE +/- 0.44, N = 3 SE +/- 0.68, N = 3 SE +/- 0.23, N = 3 SE +/- 1.12, N = 15 SE +/- 0.29, N = 3 SE +/- 1.84, N = 12 SE +/- 2.80, N = 15 SE +/- 0.18, N = 3 SE +/- 0.17, N = 3 SE +/- 0.90, N = 6 SE +/- 0.70, N = 15 SE +/- 2.33, N = 12 SE +/- 0.51, N = 3 SE +/- 1.26, N = 3 SE +/- 6.85, N = 15 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 SE +/- 6.88, N = 15 44.60 39.75 49.64 60.36 47.24 60.11 49.97 55.90 54.28 48.47 90.06 71.56 72.12 93.83 87.66 93.64 80.72 86.65 155.90 124.06 111.87 141.57 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Result
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 50 100 150 200 250 SE +/- 0.44, N = 3 SE +/- 0.71, N = 3 SE +/- 0.09, N = 3 SE +/- 0.69, N = 15 SE +/- 3.36, N = 15 SE +/- 5.82, N = 12 SE +/- 6.41, N = 15 SE +/- 2.59, N = 15 SE +/- 1.55, N = 15 SE +/- 2.32, N = 15 SE +/- 2.18, N = 15 SE +/- 4.76, N = 12 SE +/- 4.84, N = 15 SE +/- 0.35, N = 3 SE +/- 2.29, N = 15 SE +/- 2.91, N = 3 SE +/- 6.87, N = 12 SE +/- 7.19, N = 15 SE +/- 0.06, N = 3 SE +/- 0.09, N = 3 SE +/- 0.21, N = 3 SE +/- 0.13, N = 3 100.74 109.67 116.32 92.35 139.10 121.67 155.79 121.78 110.97 160.53 182.27 178.03 182.02 220.35 166.79 203.57 216.70 226.63 194.11 188.30 174.14 182.36 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.17 CPU Power Consumption Monitor Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 120 240 360 480 600 Min: 100.08 / Avg: 498.61 / Max: 537.57 Min: 53.6 / Avg: 252.85 / Max: 280.59 Min: 64.5 / Avg: 611.91 / Max: 674.71 Min: 33.76 / Avg: 321.88 / Max: 360.42 Min: 27.94 / Avg: 273.66 / Max: 300.92 Min: 60.03 / Avg: 522.44 / Max: 571.64 Min: 21.08 / Avg: 240.98 / Max: 267.52 Min: 41.83 / Avg: 453.96 / Max: 496.3 Min: 19.31 / Avg: 140.51 / Max: 154.48 Min: 17.45 / Avg: 121.04 / Max: 134.63 Min: 105.71 / Avg: 414.92 / Max: 451.7 Min: 43.7 / Avg: 200.72 / Max: 216.16 Min: 43.58 / Avg: 243.68 / Max: 263.63 Min: 108.32 / Avg: 473.62 / Max: 514.95 1. Xeon Platinum 8380 2P: Approximate power consumption of 32310 Joules per run. 2. Xeon Platinum 8380: Approximate power consumption of 16418 Joules per run. 3. EPYC 9684X 2P: Approximate power consumption of 39448 Joules per run. 4. EPYC 9684X: Approximate power consumption of 20815 Joules per run. 5. EPYC 9654: Approximate power consumption of 17715 Joules per run. 6. EPYC 9654 2P: Approximate power consumption of 33784 Joules per run. 7. EPYC 9754: Approximate power consumption of 15632 Joules per run. 8. EPYC 9754 2P: Approximate power consumption of 29507 Joules per run. 9. EPYC 8534P: Approximate power consumption of 9157 Joules per run. 10. EPYC 8534PN: Approximate power consumption of 7875 Joules per run. 11. Xeon 6766E 2P: Approximate power consumption of 27108 Joules per run. 12. Xeon 6766E: Approximate power consumption of 13114 Joules per run. 13. Xeon 6780E: Approximate power consumption of 15758 Joules per run. 14. Xeon 6780E 2P: Approximate power consumption of 31101 Joules per run.
Result
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 3 6 9 12 15 SE +/- 0.04271, N = 3 SE +/- 0.05824, N = 3 SE +/- 0.00664, N = 3 SE +/- 0.07619, N = 15 SE +/- 0.15651, N = 15 SE +/- 0.34632, N = 12 SE +/- 0.22869, N = 15 SE +/- 0.16487, N = 15 SE +/- 0.11577, N = 15 SE +/- 0.08940, N = 15 SE +/- 0.06453, N = 15 SE +/- 0.16422, N = 12 SE +/- 0.15150, N = 15 SE +/- 0.00718, N = 3 SE +/- 0.08489, N = 15 SE +/- 0.07023, N = 3 SE +/- 0.14467, N = 12 SE +/- 0.11914, N = 15 SE +/- 0.00154, N = 3 SE +/- 0.00241, N = 3 SE +/- 0.00692, N = 3 SE +/- 0.00381, N = 3 9.92684 9.11885 8.59719 10.83623 7.24187 8.39962 6.54965 8.26016 9.03367 6.24740 5.49711 5.66508 5.55018 4.53817 6.01164 4.91420 4.66491 4.46533 5.15166 5.31050 5.74234 5.48343 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt Inference Time Cost (ms)
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 50 100 150 200 250 SE +/- 0.44, N = 3 SE +/- 0.71, N = 3 SE +/- 0.09, N = 3 SE +/- 0.69, N = 15 SE +/- 3.36, N = 15 SE +/- 5.82, N = 12 SE +/- 6.41, N = 15 SE +/- 2.59, N = 15 SE +/- 1.55, N = 15 SE +/- 2.32, N = 15 SE +/- 2.18, N = 15 SE +/- 4.76, N = 12 SE +/- 4.84, N = 15 SE +/- 0.35, N = 3 SE +/- 2.29, N = 15 SE +/- 2.91, N = 3 SE +/- 6.87, N = 12 SE +/- 7.19, N = 15 SE +/- 0.06, N = 3 SE +/- 0.09, N = 3 SE +/- 0.21, N = 3 SE +/- 0.13, N = 3 100.74 109.67 116.32 92.35 139.10 121.67 155.79 121.78 110.97 160.53 182.27 178.03 182.02 220.35 166.79 203.57 216.70 226.63 194.11 188.30 174.14 182.36 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
srsRAN Project OpenBenchmarking.org Watts, Fewer Is Better srsRAN Project 23.10.1-20240325 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 68.27 / Avg: 537.03 / Max: 710 Min: 25.9 / Avg: 266.9 / Max: 379.06 Min: 60.24 / Avg: 283.1 / Max: 369.61 Min: 148.45 / Avg: 589.02 / Max: 721.35 Min: 74.5 / Avg: 281.29 / Max: 379.76 Min: 195.95 / Avg: 604.92 / Max: 745.23 Min: 74.87 / Avg: 289.12 / Max: 373.87 Min: 189.97 / Avg: 617.8 / Max: 721.97 Min: 100.98 / Avg: 470 / Max: 560.27 Min: 51.25 / Avg: 229.96 / Max: 288.72 Min: 65.52 / Avg: 632.5 / Max: 723.62 Min: 32.26 / Avg: 321.41 / Max: 408.75 Min: 28.12 / Avg: 276.24 / Max: 341.73 Min: 55.25 / Avg: 559.64 / Max: 633.66 Min: 21.57 / Avg: 261.04 / Max: 306.84 Min: 41.23 / Avg: 514.74 / Max: 612.62 Min: 17.85 / Avg: 136.58 / Max: 166.81 Min: 16.71 / Avg: 117.93 / Max: 142.26 Min: 103.72 / Avg: 426.81 / Max: 506.19 Min: 43.55 / Avg: 205.11 / Max: 263.97 Min: 43.52 / Avg: 245.99 / Max: 312.37 Min: 104.56 / Avg: 509.97 / Max: 630.46
OpenBenchmarking.org Mbps Per Watt, More Is Better srsRAN Project 23.10.1-20240325 Test: PDSCH Processor Benchmark, Throughput Total Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 40 80 120 160 200 56.88 98.83 87.21 51.12 75.68 49.98 52.16 19.21 40.31 58.87 41.07 91.42 100.26 40.98 96.52 58.04 141.87 165.23 74.22 133.01 121.16 64.73
Result
OpenBenchmarking.org Mbps, More Is Better srsRAN Project 23.10.1-20240325 Test: PDSCH Processor Benchmark, Throughput Total Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 7K 14K 21K 28K 35K SE +/- 356.81, N = 15 SE +/- 298.34, N = 15 SE +/- 236.27, N = 4 SE +/- 312.17, N = 3 SE +/- 938.95, N = 15 SE +/- 175.78, N = 4 SE +/- 281.72, N = 15 SE +/- 490.54, N = 15 SE +/- 308.01, N = 15 SE +/- 44.42, N = 3 SE +/- 343.97, N = 3 SE +/- 348.28, N = 4 SE +/- 357.13, N = 12 SE +/- 526.01, N = 15 SE +/- 237.63, N = 3 SE +/- 2115.57, N = 15 SE +/- 207.19, N = 5 SE +/- 58.21, N = 3 SE +/- 319.61, N = 3 SE +/- 150.02, N = 4 SE +/- 134.28, N = 4 SE +/- 242.64, N = 3 30547.6 26378.1 24688.5 30108.7 21286.6 30236.0 15081.0 11866.7 18943.6 13537.7 25977.4 29384.9 27695.2 22931.8 25194.6 29877.1 19375.9 19485.8 31677.2 27281.9 29804.4 33010.5 1. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -fno-trapping-math -fno-math-errno -ldl Mbps Per Watt
OpenBenchmarking.org Mbps Per Watt, More Is Better srsRAN Project 23.10.1-20240325 Test: PDSCH Processor Benchmark, Throughput Total Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 40 80 120 160 200 56.88 98.83 87.21 51.12 75.68 49.98 52.16 19.21 40.31 58.87 41.07 91.42 100.26 40.98 96.52 58.04 141.87 165.23 74.22 133.01 121.16 64.73 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better srsRAN Project 23.10.1-20240325 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 68.27 / Avg: 537.03 / Max: 710 Min: 25.9 / Avg: 266.9 / Max: 379.06 Min: 60.24 / Avg: 283.1 / Max: 369.61 Min: 148.45 / Avg: 589.02 / Max: 721.35 Min: 74.5 / Avg: 281.29 / Max: 379.76 Min: 195.95 / Avg: 604.92 / Max: 745.23 Min: 74.87 / Avg: 289.12 / Max: 373.87 Min: 189.97 / Avg: 617.8 / Max: 721.97 Min: 100.98 / Avg: 470 / Max: 560.27 Min: 51.25 / Avg: 229.96 / Max: 288.72 Min: 65.52 / Avg: 632.5 / Max: 723.62 Min: 32.26 / Avg: 321.41 / Max: 408.75 Min: 28.12 / Avg: 276.24 / Max: 341.73 Min: 55.25 / Avg: 559.64 / Max: 633.66 Min: 21.57 / Avg: 261.04 / Max: 306.84 Min: 41.23 / Avg: 514.74 / Max: 612.62 Min: 17.85 / Avg: 136.58 / Max: 166.81 Min: 16.71 / Avg: 117.93 / Max: 142.26 Min: 103.72 / Avg: 426.81 / Max: 506.19 Min: 43.55 / Avg: 205.11 / Max: 263.97 Min: 43.52 / Avg: 245.99 / Max: 312.37 Min: 104.56 / Avg: 509.97 / Max: 630.46 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 10311 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 4075 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 4883 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 12762 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 4351 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 11947 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 5069 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 15363 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 11719 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 4906 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 24878 Joules per run. 12. EPYC 9684X: Approximate power consumption of 5946 Joules per run. 13. EPYC 9654: Approximate power consumption of 5939 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 23020 Joules per run. 15. EPYC 9754: Approximate power consumption of 8005 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 18977 Joules per run. 17. EPYC 8534P: Approximate power consumption of 3169 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 2752 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 11524 Joules per run. 20. Xeon 6766E: Approximate power consumption of 3948 Joules per run. 21. Xeon 6780E: Approximate power consumption of 4489 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 12919 Joules per run.
SVT-AV1 OpenBenchmarking.org Watts, Fewer Is Better SVT-AV1 2.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 100 200 300 400 500 Min: 70.69 / Avg: 247.31 / Max: 459.08 Min: 26.49 / Avg: 131.08 / Max: 275.44 Min: 59.06 / Avg: 155.98 / Max: 273.08 Min: 160.44 / Avg: 317.58 / Max: 460.42 Min: 73.18 / Avg: 187.24 / Max: 299.74 Min: 196.97 / Avg: 398.41 / Max: 555.31 Min: 69.14 / Avg: 187.17 / Max: 307.31 Min: 193.69 / Avg: 401.02 / Max: 565.3 Min: 96.21 / Avg: 219.64 / Max: 381.28 Min: 49.33 / Avg: 128.89 / Max: 223.87 Min: 60.69 / Avg: 231.16 / Max: 380.35 Min: 31.67 / Avg: 118.98 / Max: 227.28 Min: 25.79 / Avg: 105.15 / Max: 208.71 Min: 56.44 / Avg: 206.94 / Max: 347.98 Min: 19.23 / Avg: 84.14 / Max: 169.24 Min: 38.31 / Avg: 171.31 / Max: 283.81 Min: 16.06 / Avg: 60.52 / Max: 126.9 Min: 14.1 / Avg: 55.32 / Max: 107.14 Min: 104.02 / Avg: 131.43 / Max: 193.79 Min: 43.57 / Avg: 69.02 / Max: 130.57 Min: 43.43 / Avg: 73.7 / Max: 142.81 Min: 106.17 / Avg: 142.03 / Max: 219.81
OpenBenchmarking.org Frames Per Second Per Watt, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 13 - Input: Bosphorus 4K Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.6239 1.2478 1.8717 2.4956 3.1195 0.659 1.334 1.042 0.486 0.773 0.308 0.801 0.310 0.632 1.033 0.698 1.366 1.644 0.808 1.942 0.933 2.657 2.773 0.824 1.660 1.691 0.821
Result
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 13 - Input: Bosphorus 4K Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 40 80 120 160 200 SE +/- 2.84, N = 15 SE +/- 2.83, N = 15 SE +/- 2.31, N = 15 SE +/- 2.18, N = 15 SE +/- 1.44, N = 15 SE +/- 1.63, N = 15 SE +/- 1.62, N = 15 SE +/- 1.67, N = 15 SE +/- 3.34, N = 15 SE +/- 1.11, N = 15 SE +/- 1.54, N = 15 SE +/- 3.81, N = 15 SE +/- 4.38, N = 15 SE +/- 4.23, N = 15 SE +/- 4.48, N = 15 SE +/- 4.46, N = 15 SE +/- 4.25, N = 15 SE +/- 3.84, N = 15 SE +/- 0.80, N = 15 SE +/- 1.01, N = 8 SE +/- 1.12, N = 7 SE +/- 1.79, N = 15 162.98 174.83 162.47 154.50 144.70 122.62 150.00 124.26 138.72 133.19 161.34 162.48 172.88 167.22 163.41 159.75 160.79 153.42 108.29 114.54 124.60 116.62 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq Frames Per Second Per Watt
OpenBenchmarking.org Frames Per Second Per Watt, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 13 - Input: Bosphorus 4K Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.6239 1.2478 1.8717 2.4956 3.1195 0.659 1.334 1.042 0.486 0.773 0.308 0.801 0.310 0.632 1.033 0.698 1.366 1.644 0.808 1.942 0.933 2.657 2.773 0.824 1.660 1.691 0.821 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better SVT-AV1 2.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 100 200 300 400 500 Min: 70.69 / Avg: 247.31 / Max: 459.08 Min: 26.49 / Avg: 131.08 / Max: 275.44 Min: 59.06 / Avg: 155.98 / Max: 273.08 Min: 160.44 / Avg: 317.58 / Max: 460.42 Min: 73.18 / Avg: 187.24 / Max: 299.74 Min: 196.97 / Avg: 398.41 / Max: 555.31 Min: 69.14 / Avg: 187.17 / Max: 307.31 Min: 193.69 / Avg: 401.02 / Max: 565.3 Min: 96.21 / Avg: 219.64 / Max: 381.28 Min: 49.33 / Avg: 128.89 / Max: 223.87 Min: 60.69 / Avg: 231.16 / Max: 380.35 Min: 31.67 / Avg: 118.98 / Max: 227.28 Min: 25.79 / Avg: 105.15 / Max: 208.71 Min: 56.44 / Avg: 206.94 / Max: 347.98 Min: 19.23 / Avg: 84.14 / Max: 169.24 Min: 38.31 / Avg: 171.31 / Max: 283.81 Min: 16.06 / Avg: 60.52 / Max: 126.9 Min: 14.1 / Avg: 55.32 / Max: 107.14 Min: 104.02 / Avg: 131.43 / Max: 193.79 Min: 43.57 / Avg: 69.02 / Max: 130.57 Min: 43.43 / Avg: 73.7 / Max: 142.81 Min: 106.17 / Avg: 142.03 / Max: 219.81 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 2407 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 1197 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 1497 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 3176 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 1972 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 5020 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 1947 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 4946 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 2387 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 1349 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 2450 Joules per run. 12. EPYC 9684X: Approximate power consumption of 1222 Joules per run. 13. EPYC 9654: Approximate power consumption of 1052 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 2111 Joules per run. 15. EPYC 9754: Approximate power consumption of 898 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 1862 Joules per run. 17. EPYC 8534P: Approximate power consumption of 658 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 605 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 1682 Joules per run. 20. Xeon 6766E: Approximate power consumption of 828 Joules per run. 21. Xeon 6780E: Approximate power consumption of 842 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 1742 Joules per run.
LuxCoreRender OpenBenchmarking.org Watts, Fewer Is Better LuxCoreRender 2.6 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 150 300 450 600 750 Min: 82.44 / Avg: 639.12 / Max: 751.58 Min: 34.75 / Avg: 320.73 / Max: 377.48 Min: 61.77 / Avg: 323.08 / Max: 377.72 Min: 172.79 / Avg: 646.27 / Max: 748.56 Min: 75.77 / Avg: 326.79 / Max: 375.2 Min: 204.79 / Avg: 656.04 / Max: 751.44 Min: 83.75 / Avg: 327.46 / Max: 377.5 Min: 201.92 / Avg: 656.25 / Max: 748.81 Min: 100.16 / Avg: 499.14 / Max: 582.6 Min: 53 / Avg: 249.69 / Max: 290.48 Min: 66.69 / Avg: 722.97 / Max: 825.83 Min: 33.09 / Avg: 373.72 / Max: 411.13 Min: 27.54 / Avg: 296.6 / Max: 330.72 Min: 57.15 / Avg: 586.21 / Max: 670.16 Min: 22.04 / Avg: 298.61 / Max: 336.88 Min: 41.55 / Avg: 551.09 / Max: 677.8 Min: 19.16 / Avg: 150.1 / Max: 167.85 Min: 17.62 / Avg: 128.09 / Max: 142.09 Min: 104.86 / Avg: 321.3 / Max: 495.12 Min: 43.68 / Avg: 191.46 / Max: 222.84 Min: 43.49 / Avg: 223.98 / Max: 283.31 Min: 107.87 / Avg: 364.17 / Max: 576.89
OpenBenchmarking.org M samples/sec Per Watt, More Is Better LuxCoreRender 2.6 Scene: Orange Juice - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0227 0.0454 0.0681 0.0908 0.1135 0.031 0.046 0.042 0.029 0.036 0.026 0.038 0.025 0.029 0.035 0.046 0.066 0.072 0.051 0.080 0.059 0.092 0.101 0.053 0.083 0.071 0.048
Result
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Orange Juice - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 8 16 24 32 40 SE +/- 0.30, N = 15 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 SE +/- 0.10, N = 3 SE +/- 0.16, N = 15 SE +/- 0.04, N = 3 SE +/- 0.28, N = 15 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 1.06, N = 15 SE +/- 0.28, N = 5 SE +/- 0.18, N = 15 SE +/- 0.84, N = 15 SE +/- 0.07, N = 3 SE +/- 1.12, N = 15 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.46, N = 12 SE +/- 0.19, N = 3 SE +/- 0.06, N = 3 SE +/- 0.46, N = 15 19.91 14.74 13.46 18.70 11.86 16.91 12.50 16.64 14.31 8.82 33.08 24.69 21.32 29.61 23.76 32.26 13.81 13.00 16.88 15.90 15.83 17.45 M samples/sec Per Watt
OpenBenchmarking.org M samples/sec Per Watt, More Is Better LuxCoreRender 2.6 Scene: Orange Juice - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0227 0.0454 0.0681 0.0908 0.1135 0.031 0.046 0.042 0.029 0.036 0.026 0.038 0.025 0.029 0.035 0.046 0.066 0.072 0.051 0.080 0.059 0.092 0.101 0.053 0.083 0.071 0.048 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better LuxCoreRender 2.6 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 150 300 450 600 750 Min: 82.44 / Avg: 639.12 / Max: 751.58 Min: 34.75 / Avg: 320.73 / Max: 377.48 Min: 61.77 / Avg: 323.08 / Max: 377.72 Min: 172.79 / Avg: 646.27 / Max: 748.56 Min: 75.77 / Avg: 326.79 / Max: 375.2 Min: 204.79 / Avg: 656.04 / Max: 751.44 Min: 83.75 / Avg: 327.46 / Max: 377.5 Min: 201.92 / Avg: 656.25 / Max: 748.81 Min: 100.16 / Avg: 499.14 / Max: 582.6 Min: 53 / Avg: 249.69 / Max: 290.48 Min: 66.69 / Avg: 722.97 / Max: 825.83 Min: 33.09 / Avg: 373.72 / Max: 411.13 Min: 27.54 / Avg: 296.6 / Max: 330.72 Min: 57.15 / Avg: 586.21 / Max: 670.16 Min: 22.04 / Avg: 298.61 / Max: 336.88 Min: 41.55 / Avg: 551.09 / Max: 677.8 Min: 19.16 / Avg: 150.1 / Max: 167.85 Min: 17.62 / Avg: 128.09 / Max: 142.09 Min: 104.86 / Avg: 321.3 / Max: 495.12 Min: 43.68 / Avg: 191.46 / Max: 222.84 Min: 43.49 / Avg: 223.98 / Max: 283.31 Min: 107.87 / Avg: 364.17 / Max: 576.89 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 43332 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 21810 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21970 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 44593 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 22113 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 44786 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 22158 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 44800 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 34108 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16979 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 48921 Joules per run. 12. EPYC 9684X: Approximate power consumption of 25189 Joules per run. 13. EPYC 9654: Approximate power consumption of 20030 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 39745 Joules per run. 15. EPYC 9754: Approximate power consumption of 20306 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 37364 Joules per run. 17. EPYC 8534P: Approximate power consumption of 10207 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 8753 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 22518 Joules per run. 20. Xeon 6766E: Approximate power consumption of 13211 Joules per run. 21. Xeon 6780E: Approximate power consumption of 15380 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 25346 Joules per run.
OpenBenchmarking.org Watts, Fewer Is Better LuxCoreRender 2.6 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 150 300 450 600 750 Min: 76.68 / Avg: 654.92 / Max: 755.35 Min: 24.28 / Avg: 326.43 / Max: 375.69 Min: 59.67 / Avg: 330.53 / Max: 373.83 Min: 173.98 / Avg: 664.56 / Max: 753.01 Min: 74.56 / Avg: 331.26 / Max: 374.04 Min: 195.7 / Avg: 665.76 / Max: 753.2 Min: 72.86 / Avg: 330.29 / Max: 377.65 Min: 203.55 / Avg: 668.4 / Max: 754.98 Min: 101.11 / Avg: 511.71 / Max: 580 Min: 51.32 / Avg: 255.3 / Max: 289.97 Min: 65.89 / Avg: 739.45 / Max: 837.69 Min: 34.75 / Avg: 384.12 / Max: 412.45 Min: 29.9 / Avg: 299.39 / Max: 326.71 Min: 59.66 / Avg: 573.93 / Max: 661.76 Min: 20.73 / Avg: 311.89 / Max: 340.37 Min: 42.95 / Avg: 561.1 / Max: 675.69 Min: 18.62 / Avg: 156.14 / Max: 171.55 Min: 18.19 / Avg: 128.95 / Max: 140.58 Min: 104.02 / Avg: 295.99 / Max: 409.35 Min: 43.65 / Avg: 180.3 / Max: 223.44 Min: 43.51 / Avg: 225.44 / Max: 288.32 Min: 79.88 / Avg: 341.83 / Max: 482.57
OpenBenchmarking.org M samples/sec Per Watt, More Is Better LuxCoreRender 2.6 Scene: DLSC - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0149 0.0298 0.0447 0.0596 0.0745 0.019 0.029 0.026 0.017 0.023 0.015 0.024 0.016 0.018 0.022 0.031 0.042 0.048 0.031 0.054 0.039 0.060 0.066 0.026 0.052 0.045 0.023
Result
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: DLSC - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 5 10 15 20 25 SE +/- 0.24, N = 15 SE +/- 0.02, N = 3 SE +/- 0.06, N = 15 SE +/- 0.23, N = 15 SE +/- 0.08, N = 3 SE +/- 0.12, N = 3 SE +/- 0.10, N = 3 SE +/- 0.20, N = 15 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.91, N = 15 SE +/- 0.18, N = 15 SE +/- 0.13, N = 3 SE +/- 0.12, N = 3 SE +/- 0.28, N = 15 SE +/- 1.02, N = 15 SE +/- 0.06, N = 15 SE +/- 0.03, N = 3 SE +/- 0.22, N = 12 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.22, N = 15 12.74 9.38 8.72 11.12 7.46 10.17 8.00 10.44 8.98 5.63 22.58 16.21 14.29 17.89 16.79 22.00 9.39 8.48 7.71 9.40 10.09 7.99 M samples/sec Per Watt
OpenBenchmarking.org M samples/sec Per Watt, More Is Better LuxCoreRender 2.6 Scene: DLSC - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0149 0.0298 0.0447 0.0596 0.0745 0.019 0.029 0.026 0.017 0.023 0.015 0.024 0.016 0.018 0.022 0.031 0.042 0.048 0.031 0.054 0.039 0.060 0.066 0.026 0.052 0.045 0.023 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better LuxCoreRender 2.6 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 150 300 450 600 750 Min: 76.68 / Avg: 654.92 / Max: 755.35 Min: 24.28 / Avg: 326.43 / Max: 375.69 Min: 59.67 / Avg: 330.53 / Max: 373.83 Min: 173.98 / Avg: 664.56 / Max: 753.01 Min: 74.56 / Avg: 331.26 / Max: 374.04 Min: 195.7 / Avg: 665.76 / Max: 753.2 Min: 72.86 / Avg: 330.29 / Max: 377.65 Min: 203.55 / Avg: 668.4 / Max: 754.98 Min: 101.11 / Avg: 511.71 / Max: 580 Min: 51.32 / Avg: 255.3 / Max: 289.97 Min: 65.89 / Avg: 739.45 / Max: 837.69 Min: 34.75 / Avg: 384.12 / Max: 412.45 Min: 29.9 / Avg: 299.39 / Max: 326.71 Min: 59.66 / Avg: 573.93 / Max: 661.76 Min: 20.73 / Avg: 311.89 / Max: 340.37 Min: 42.95 / Avg: 561.1 / Max: 675.69 Min: 18.62 / Avg: 156.14 / Max: 171.55 Min: 18.19 / Avg: 128.95 / Max: 140.58 Min: 104.02 / Avg: 295.99 / Max: 409.35 Min: 43.65 / Avg: 180.3 / Max: 223.44 Min: 43.51 / Avg: 225.44 / Max: 288.32 Min: 79.88 / Avg: 341.83 / Max: 482.57 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 42919 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 21327 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21572 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 43595 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 21532 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 43052 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 21469 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 43491 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 33261 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16595 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 47818 Joules per run. 12. EPYC 9684X: Approximate power consumption of 24993 Joules per run. 13. EPYC 9654: Approximate power consumption of 19560 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 37497 Joules per run. 15. EPYC 9754: Approximate power consumption of 20335 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 36696 Joules per run. 17. EPYC 8534P: Approximate power consumption of 10128 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 8468 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 19363 Joules per run. 20. Xeon 6766E: Approximate power consumption of 11780 Joules per run. 21. Xeon 6780E: Approximate power consumption of 14654 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 22356 Joules per run.
NAS Parallel Benchmarks OpenBenchmarking.org Watts, Fewer Is Better NAS Parallel Benchmarks 3.4 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 140 280 420 560 700 Min: 68.69 / Avg: 471.7 / Max: 753.27 Min: 26.35 / Avg: 276.68 / Max: 375.06 Min: 57.58 / Avg: 291.31 / Max: 376.98 Min: 155.56 / Avg: 520.43 / Max: 752.57 Min: 73.35 / Avg: 254.67 / Max: 351.04 Min: 200.97 / Avg: 537.97 / Max: 722.6 Min: 76.21 / Avg: 270.13 / Max: 345.76 Min: 196.31 / Avg: 561.84 / Max: 754.16 Min: 100.12 / Avg: 440.29 / Max: 581.61 Min: 51.37 / Avg: 242.36 / Max: 290.59 Min: 65.8 / Avg: 495.73 / Max: 819.01 Min: 31.93 / Avg: 307.77 / Max: 409.54 Min: 26.47 / Avg: 242.89 / Max: 334.43 Min: 56.44 / Avg: 416.97 / Max: 683.16 Min: 21.19 / Avg: 234.01 / Max: 336.9 Min: 40.5 / Avg: 379.03 / Max: 677.9 Min: 18.8 / Avg: 129.08 / Max: 158.73 Min: 17.1 / Avg: 113.27 / Max: 135.62
OpenBenchmarking.org Total Mop/s Per Watt, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: EP.D Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 13 26 39 52 65 33.93 29.24 25.96 28.72 21.07 20.39 23.86 22.77 20.17 18.48 44.72 37.12 43.86 46.56 53.74 58.09 49.71 50.72
Result
OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: EP.D Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 5K 10K 15K 20K 25K SE +/- 30.19, N = 4 SE +/- 22.33, N = 3 SE +/- 6.77, N = 3 SE +/- 100.23, N = 4 SE +/- 155.10, N = 12 SE +/- 4.83, N = 4 SE +/- 6.53, N = 3 SE +/- 10.93, N = 4 SE +/- 17.53, N = 3 SE +/- 13.82, N = 3 SE +/- 602.37, N = 15 SE +/- 309.03, N = 15 SE +/- 122.47, N = 15 SE +/- 530.31, N = 15 SE +/- 367.88, N = 12 SE +/- 1274.85, N = 12 SE +/- 14.68, N = 3 SE +/- 50.01, N = 8 16004.07 8089.14 7562.80 14946.76 5366.69 10970.45 6445.09 12793.01 8880.82 4479.28 22166.60 11424.05 10652.03 19414.94 12575.30 22017.75 6416.34 5745.04 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6 Total Mop/s Per Watt
OpenBenchmarking.org Total Mop/s Per Watt, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: EP.D Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 13 26 39 52 65 33.93 29.24 25.96 28.72 21.07 20.39 23.86 22.77 20.17 18.48 44.72 37.12 43.86 46.56 53.74 58.09 49.71 50.72 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better NAS Parallel Benchmarks 3.4 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 140 280 420 560 700 Min: 68.69 / Avg: 471.7 / Max: 753.27 Min: 26.35 / Avg: 276.68 / Max: 375.06 Min: 57.58 / Avg: 291.31 / Max: 376.98 Min: 155.56 / Avg: 520.43 / Max: 752.57 Min: 73.35 / Avg: 254.67 / Max: 351.04 Min: 200.97 / Avg: 537.97 / Max: 722.6 Min: 76.21 / Avg: 270.13 / Max: 345.76 Min: 196.31 / Avg: 561.84 / Max: 754.16 Min: 100.12 / Avg: 440.29 / Max: 581.61 Min: 51.37 / Avg: 242.36 / Max: 290.59 Min: 65.8 / Avg: 495.73 / Max: 819.01 Min: 31.93 / Avg: 307.77 / Max: 409.54 Min: 26.47 / Avg: 242.89 / Max: 334.43 Min: 56.44 / Avg: 416.97 / Max: 683.16 Min: 21.19 / Avg: 234.01 / Max: 336.9 Min: 40.5 / Avg: 379.03 / Max: 677.9 Min: 18.8 / Avg: 129.08 / Max: 158.73 Min: 17.1 / Avg: 113.27 / Max: 135.62 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 8373 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 6364 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 6894 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 8977 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 7895 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 10491 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 7203 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 10113 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 9393 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 8644 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 7403 Joules per run. 12. EPYC 9684X: Approximate power consumption of 5335 Joules per run. 13. EPYC 9654: Approximate power consumption of 4388 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 6560 Joules per run. 15. EPYC 9754: Approximate power consumption of 3998 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 7296 Joules per run. 17. EPYC 8534P: Approximate power consumption of 3399 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 3271 Joules per run.
Pennant OpenBenchmarking.org Watts, Fewer Is Better Pennant 1.0.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 140 280 420 560 700 Min: 64.47 / Avg: 342.65 / Max: 753.04 Min: 25.17 / Avg: 191.11 / Max: 377.76 Min: 57.31 / Avg: 222.1 / Max: 377.34 Min: 144.69 / Avg: 414.55 / Max: 753.5 Min: 71.8 / Avg: 241.62 / Max: 375.61 Min: 187.85 / Avg: 448.22 / Max: 752.01 Min: 74.45 / Avg: 234.93 / Max: 375.6 Min: 191.18 / Avg: 450.17 / Max: 753.29 Min: 100.92 / Avg: 344.84 / Max: 581.63 Min: 52.7 / Avg: 215.77 / Max: 289.7 Min: 63.33 / Avg: 370.49 / Max: 818.97 Min: 33.15 / Avg: 196.35 / Max: 409.53 Min: 27.07 / Avg: 170.76 / Max: 330.73 Min: 54.46 / Avg: 322.18 / Max: 670.5 Min: 20.01 / Avg: 156.67 / Max: 328.66 Min: 41.42 / Avg: 291.74 / Max: 665.7 Min: 18.14 / Avg: 107.18 / Max: 164.25 Min: 16.11 / Avg: 95.67 / Max: 145.23
Result
OpenBenchmarking.org Hydro Cycle Time - Seconds, Fewer Is Better Pennant 1.0.1 Test: leblancbig Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 3 6 9 12 15 SE +/- 0.013568, N = 6 SE +/- 0.022698, N = 7 SE +/- 0.022393, N = 7 SE +/- 0.019069, N = 15 SE +/- 0.025580, N = 6 SE +/- 0.010204, N = 7 SE +/- 0.023904, N = 7 SE +/- 0.008354, N = 7 SE +/- 0.037316, N = 9 SE +/- 0.010812, N = 4 SE +/- 0.055800, N = 15 SE +/- 0.115724, N = 15 SE +/- 0.115723, N = 15 SE +/- 0.063684, N = 15 SE +/- 0.115702, N = 15 SE +/- 0.022246, N = 15 SE +/- 0.057580, N = 6 SE +/- 0.045713, N = 13 2.159459 4.182707 4.955865 2.529807 5.930957 2.881099 5.114161 2.527363 4.702557 11.852130 2.076835 3.360453 3.754835 2.312977 3.654303 2.084384 6.541768 6.852712 1. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better Pennant 1.0.1 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN 140 280 420 560 700 Min: 64.47 / Avg: 342.65 / Max: 753.04 Min: 25.17 / Avg: 191.11 / Max: 377.76 Min: 57.31 / Avg: 222.1 / Max: 377.34 Min: 144.69 / Avg: 414.55 / Max: 753.5 Min: 71.8 / Avg: 241.62 / Max: 375.61 Min: 187.85 / Avg: 448.22 / Max: 752.01 Min: 74.45 / Avg: 234.93 / Max: 375.6 Min: 191.18 / Avg: 450.17 / Max: 753.29 Min: 100.92 / Avg: 344.84 / Max: 581.63 Min: 52.7 / Avg: 215.77 / Max: 289.7 Min: 63.33 / Avg: 370.49 / Max: 818.97 Min: 33.15 / Avg: 196.35 / Max: 409.53 Min: 27.07 / Avg: 170.76 / Max: 330.73 Min: 54.46 / Avg: 322.18 / Max: 670.5 Min: 20.01 / Avg: 156.67 / Max: 328.66 Min: 41.42 / Avg: 291.74 / Max: 665.7 Min: 18.14 / Avg: 107.18 / Max: 164.25 Min: 16.11 / Avg: 95.67 / Max: 145.23 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 3826 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 1884 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 2284 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 4201 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 2658 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 4418 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 2416 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 4437 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 3525 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 3560 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 4026 Joules per run. 12. EPYC 9684X: Approximate power consumption of 1780 Joules per run. 13. EPYC 9654: Approximate power consumption of 1537 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 3544 Joules per run. 15. EPYC 9754: Approximate power consumption of 1556 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 4279 Joules per run. 17. EPYC 8534P: Approximate power consumption of 1233 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1126 Joules per run.
NAMD OpenBenchmarking.org Watts, Fewer Is Better NAMD 3.0b6 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 73.13 / Avg: 510.74 / Max: 686.96 Min: 33.09 / Avg: 260.62 / Max: 349.3 Min: 55.23 / Avg: 273.91 / Max: 344.33 Min: 163.14 / Avg: 552.42 / Max: 653.46 Min: 71.79 / Avg: 281.33 / Max: 364.12 Min: 192.28 / Avg: 560.13 / Max: 714.79 Min: 72.24 / Avg: 295.54 / Max: 371.41 Min: 194.25 / Avg: 565.07 / Max: 686.05 Min: 103.57 / Avg: 411.33 / Max: 527.15 Min: 51.87 / Avg: 233.31 / Max: 276.8 Min: 65.49 / Avg: 343.59 / Max: 811.63 Min: 32.28 / Avg: 274.76 / Max: 406.72 Min: 28.55 / Avg: 235.77 / Max: 330 Min: 57.51 / Avg: 289.28 / Max: 672.46 Min: 21.48 / Avg: 206.2 / Max: 309.47 Min: 42.36 / Avg: 249.94 / Max: 651.86 Min: 18.33 / Avg: 130.18 / Max: 164.25 Min: 15.81 / Avg: 114.62 / Max: 140.3 Min: 104.7 / Avg: 241.31 / Max: 387.86 Min: 43.64 / Avg: 119.15 / Max: 229.24 Min: 43.54 / Avg: 140.31 / Max: 283.29 Min: 62.83 / Avg: 273.53 / Max: 463.21
OpenBenchmarking.org ns/day Per Watt, More Is Better NAMD 3.0b6 Input: STMV with 1,066,628 Atoms Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0052 0.0104 0.0156 0.0208 0.026 0.004 0.006 0.004 0.002 0.005 0.003 0.005 0.003 0.004 0.005 0.019 0.012 0.012 0.018 0.014 0.023 0.012 0.013 0.003 0.004 0.004 0.002
Result
OpenBenchmarking.org ns/day, More Is Better NAMD 3.0b6 Input: STMV with 1,066,628 Atoms Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 2 4 6 8 10 SE +/- 0.08185, N = 13 SE +/- 0.02648, N = 15 SE +/- 0.01396, N = 15 SE +/- 0.04403, N = 15 SE +/- 0.05087, N = 15 SE +/- 0.05644, N = 12 SE +/- 0.05862, N = 15 SE +/- 0.05463, N = 15 SE +/- 0.00911, N = 3 SE +/- 0.00653, N = 3 SE +/- 0.01739, N = 3 SE +/- 0.00206, N = 3 SE +/- 0.00537, N = 3 SE +/- 0.02927, N = 3 SE +/- 0.00847, N = 3 SE +/- 0.00332, N = 3 SE +/- 0.00440, N = 3 SE +/- 0.00540, N = 3 SE +/- 0.04439, N = 8 SE +/- 0.00423, N = 3 SE +/- 0.00540, N = 3 SE +/- 0.03216, N = 9 2.25422 1.43787 1.05274 1.10900 1.45223 1.88679 1.50214 1.76778 1.61232 1.11056 6.38343 3.41085 2.87877 5.27839 2.88869 5.83606 1.51901 1.46163 0.70757 0.52357 0.56717 0.57694 ns/day Per Watt
OpenBenchmarking.org ns/day Per Watt, More Is Better NAMD 3.0b6 Input: STMV with 1,066,628 Atoms Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0052 0.0104 0.0156 0.0208 0.026 0.004 0.006 0.004 0.002 0.005 0.003 0.005 0.003 0.004 0.005 0.019 0.012 0.012 0.018 0.014 0.023 0.012 0.013 0.003 0.004 0.004 0.002 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better NAMD 3.0b6 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 73.13 / Avg: 510.74 / Max: 686.96 Min: 33.09 / Avg: 260.62 / Max: 349.3 Min: 55.23 / Avg: 273.91 / Max: 344.33 Min: 163.14 / Avg: 552.42 / Max: 653.46 Min: 71.79 / Avg: 281.33 / Max: 364.12 Min: 192.28 / Avg: 560.13 / Max: 714.79 Min: 72.24 / Avg: 295.54 / Max: 371.41 Min: 194.25 / Avg: 565.07 / Max: 686.05 Min: 103.57 / Avg: 411.33 / Max: 527.15 Min: 51.87 / Avg: 233.31 / Max: 276.8 Min: 65.49 / Avg: 343.59 / Max: 811.63 Min: 32.28 / Avg: 274.76 / Max: 406.72 Min: 28.55 / Avg: 235.77 / Max: 330 Min: 57.51 / Avg: 289.28 / Max: 672.46 Min: 21.48 / Avg: 206.2 / Max: 309.47 Min: 42.36 / Avg: 249.94 / Max: 651.86 Min: 18.33 / Avg: 130.18 / Max: 164.25 Min: 15.81 / Avg: 114.62 / Max: 140.3 Min: 104.7 / Avg: 241.31 / Max: 387.86 Min: 43.64 / Avg: 119.15 / Max: 229.24 Min: 43.54 / Avg: 140.31 / Max: 283.29 Min: 62.83 / Avg: 273.53 / Max: 463.21 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 50760 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 18956 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 26587 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 63270 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 20743 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 37202 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 17713 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 43661 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 46618 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 17032 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 38825 Joules per run. 12. EPYC 9684X: Approximate power consumption of 7144 Joules per run. 13. EPYC 9654: Approximate power consumption of 6680 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 29217 Joules per run. 15. EPYC 9754: Approximate power consumption of 6186 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 25827 Joules per run. 17. EPYC 8534P: Approximate power consumption of 5511 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 4929 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 68621 Joules per run. 20. Xeon 6766E: Approximate power consumption of 30186 Joules per run. 21. Xeon 6780E: Approximate power consumption of 35171 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 76709 Joules per run.
OpenBenchmarking.org Watts, Fewer Is Better NAMD 3.0b6 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 75.47 / Avg: 484.77 / Max: 671.95 Min: 33.34 / Avg: 236.13 / Max: 373.62 Min: 55.01 / Avg: 258.53 / Max: 352.06 Min: 165.98 / Avg: 533.68 / Max: 633.47 Min: 73.54 / Avg: 248.99 / Max: 374.54 Min: 194.24 / Avg: 522.05 / Max: 693.75 Min: 73.99 / Avg: 269.88 / Max: 376.76 Min: 190.7 / Avg: 550.3 / Max: 686.19 Min: 101.59 / Avg: 389.17 / Max: 564.97 Min: 54.68 / Avg: 216.04 / Max: 281.76 Min: 62.44 / Avg: 326.5 / Max: 779.77 Min: 29.28 / Avg: 180.85 / Max: 379.02 Min: 27.01 / Avg: 187.68 / Max: 312.41 Min: 58.84 / Avg: 262.91 / Max: 648.62 Min: 20.68 / Avg: 165.67 / Max: 289.24 Min: 40.88 / Avg: 225.05 / Max: 615.88 Min: 17 / Avg: 109.51 / Max: 166.07 Min: 16.45 / Avg: 96.77 / Max: 141.98 Min: 72.63 / Avg: 236.64 / Max: 427.46 Min: 43.66 / Avg: 112.28 / Max: 262.76 Min: 43.48 / Avg: 132.04 / Max: 342.42 Min: 106.87 / Avg: 266.5 / Max: 492.66
OpenBenchmarking.org ns/day Per Watt, More Is Better NAMD 3.0b6 Input: ATPase with 327,506 Atoms Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0189 0.0378 0.0567 0.0756 0.0945 0.012 0.020 0.011 0.004 0.024 0.014 0.022 0.005 0.017 0.017 0.064 0.052 0.044 0.068 0.048 0.084 0.052 0.056 0.011 0.034 0.029 0.009
Result
OpenBenchmarking.org ns/day, More Is Better NAMD 3.0b6 Input: ATPase with 327,506 Atoms Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 5 10 15 20 25 SE +/- 0.34017, N = 12 SE +/- 0.54361, N = 15 SE +/- 0.21567, N = 12 SE +/- 0.17435, N = 15 SE +/- 0.16058, N = 15 SE +/- 0.26203, N = 15 SE +/- 0.14537, N = 15 SE +/- 0.44989, N = 15 SE +/- 0.07204, N = 4 SE +/- 0.02582, N = 3 SE +/- 0.08771, N = 3 SE +/- 0.02148, N = 6 SE +/- 0.01368, N = 5 SE +/- 0.04751, N = 3 SE +/- 0.04917, N = 5 SE +/- 0.02125, N = 3 SE +/- 0.04338, N = 5 SE +/- 0.00431, N = 4 SE +/- 0.19805, N = 15 SE +/- 0.02593, N = 3 SE +/- 0.17734, N = 15 SE +/- 0.20408, N = 12 5.85267 4.64814 2.97021 2.21948 5.97130 7.30065 5.92501 2.56319 6.72663 3.60479 20.75259 9.33534 8.18275 17.81105 7.99756 18.97454 5.70672 5.44971 2.55400 3.76811 3.76348 2.39770 ns/day Per Watt
OpenBenchmarking.org ns/day Per Watt, More Is Better NAMD 3.0b6 Input: ATPase with 327,506 Atoms Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 0.0189 0.0378 0.0567 0.0756 0.0945 0.012 0.020 0.011 0.004 0.024 0.014 0.022 0.005 0.017 0.017 0.064 0.052 0.044 0.068 0.048 0.084 0.052 0.056 0.011 0.034 0.029 0.009 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better NAMD 3.0b6 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 75.47 / Avg: 484.77 / Max: 671.95 Min: 33.34 / Avg: 236.13 / Max: 373.62 Min: 55.01 / Avg: 258.53 / Max: 352.06 Min: 165.98 / Avg: 533.68 / Max: 633.47 Min: 73.54 / Avg: 248.99 / Max: 374.54 Min: 194.24 / Avg: 522.05 / Max: 693.75 Min: 73.99 / Avg: 269.88 / Max: 376.76 Min: 190.7 / Avg: 550.3 / Max: 686.19 Min: 101.59 / Avg: 389.17 / Max: 564.97 Min: 54.68 / Avg: 216.04 / Max: 281.76 Min: 62.44 / Avg: 326.5 / Max: 779.77 Min: 29.28 / Avg: 180.85 / Max: 379.02 Min: 27.01 / Avg: 187.68 / Max: 312.41 Min: 58.84 / Avg: 262.91 / Max: 648.62 Min: 20.68 / Avg: 165.67 / Max: 289.24 Min: 40.88 / Avg: 225.05 / Max: 615.88 Min: 17 / Avg: 109.51 / Max: 166.07 Min: 16.45 / Avg: 96.77 / Max: 141.98 Min: 72.63 / Avg: 236.64 / Max: 427.46 Min: 43.66 / Avg: 112.28 / Max: 262.76 Min: 43.48 / Avg: 132.04 / Max: 342.42 Min: 106.87 / Avg: 266.5 / Max: 492.66 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 21572 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 7666 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 10621 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 25937 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 6424 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 13434 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 7521 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 24177 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 18972 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 5905 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 24270 Joules per run. 12. EPYC 9684X: Approximate power consumption of 2803 Joules per run. 13. EPYC 9654: Approximate power consumption of 2440 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 16651 Joules per run. 15. EPYC 9754: Approximate power consumption of 2286 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 13353 Joules per run. 17. EPYC 8534P: Approximate power consumption of 1686 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1524 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 27135 Joules per run. 20. Xeon 6766E: Approximate power consumption of 11976 Joules per run. 21. Xeon 6780E: Approximate power consumption of 13442 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 30381 Joules per run.
miniFE OpenBenchmarking.org Watts, Fewer Is Better miniFE 2.2 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 73.08 / Avg: 366.83 / Max: 700.4 Min: 31.62 / Avg: 198.71 / Max: 331.13 Min: 61.92 / Avg: 224.98 / Max: 377.92 Min: 168.8 / Avg: 424.3 / Max: 732.03 Min: 75.77 / Avg: 253.53 / Max: 365.64 Min: 189.32 / Avg: 498.77 / Max: 730.29 Min: 73.91 / Avg: 260.35 / Max: 366.7 Min: 199.32 / Avg: 500.61 / Max: 723.88 Min: 99.06 / Avg: 326.82 / Max: 539.95 Min: 53.33 / Avg: 190.48 / Max: 282.32 Min: 63.04 / Avg: 330.55 / Max: 718.24 Min: 33.7 / Avg: 177.88 / Max: 364.34 Min: 28.79 / Avg: 152.24 / Max: 300.13 Min: 53.09 / Avg: 309.09 / Max: 579.88 Min: 21.36 / Avg: 127.63 / Max: 261.53 Min: 40.05 / Avg: 258.88 / Max: 518.97 Min: 19.07 / Avg: 96.36 / Max: 147.72 Min: 15.16 / Avg: 86.83 / Max: 132.07 Min: 104.71 / Avg: 215.79 / Max: 487.65 Min: 43.59 / Avg: 108.34 / Max: 211.25 Min: 43.53 / Avg: 119.29 / Max: 232.16 Min: 106.66 / Avg: 225.73 / Max: 522.28
OpenBenchmarking.org CG Mflops Per Watt, More Is Better miniFE 2.2 Problem Size: Small Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 90 180 270 360 450 114.81 160.18 156.59 110.48 79.24 39.85 71.52 43.11 95.00 120.52 179.90 298.90 334.41 140.84 392.87 162.67 254.52 282.72 183.43 373.28 340.56 165.96
Result
OpenBenchmarking.org CG Mflops, More Is Better miniFE 2.2 Problem Size: Small Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 13K 26K 39K 52K 65K SE +/- 1633.92, N = 15 SE +/- 135.77, N = 4 SE +/- 11.14, N = 4 SE +/- 467.78, N = 4 SE +/- 601.03, N = 12 SE +/- 1097.75, N = 15 SE +/- 572.00, N = 12 SE +/- 283.44, N = 3 SE +/- 366.08, N = 4 SE +/- 54.57, N = 4 SE +/- 2182.93, N = 15 SE +/- 92.04, N = 5 SE +/- 42.89, N = 5 SE +/- 1510.37, N = 15 SE +/- 53.07, N = 5 SE +/- 2087.13, N = 15 SE +/- 49.20, N = 4 SE +/- 42.17, N = 4 SE +/- 1039.71, N = 15 SE +/- 19.87, N = 4 SE +/- 8.42, N = 4 SE +/- 712.94, N = 12 42114.6 31830.2 35230.1 46877.5 20091.1 19876.5 18621.2 21583.2 31046.5 22957.3 59466.6 53167.8 50909.6 43531.0 50139.9 42113.5 24526.0 24548.8 39580.9 40441.0 40626.4 37461.1 1. (CXX) g++ options: -O3 -fopenmp -lmpi_cxx -lmpi CG Mflops Per Watt
OpenBenchmarking.org CG Mflops Per Watt, More Is Better miniFE 2.2 Problem Size: Small Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 90 180 270 360 450 114.81 160.18 156.59 110.48 79.24 39.85 71.52 43.11 95.00 120.52 179.90 298.90 334.41 140.84 392.87 162.67 254.52 282.72 183.43 373.28 340.56 165.96 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better miniFE 2.2 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 130 260 390 520 650 Min: 73.08 / Avg: 366.83 / Max: 700.4 Min: 31.62 / Avg: 198.71 / Max: 331.13 Min: 61.92 / Avg: 224.98 / Max: 377.92 Min: 168.8 / Avg: 424.3 / Max: 732.03 Min: 75.77 / Avg: 253.53 / Max: 365.64 Min: 189.32 / Avg: 498.77 / Max: 730.29 Min: 73.91 / Avg: 260.35 / Max: 366.7 Min: 199.32 / Avg: 500.61 / Max: 723.88 Min: 99.06 / Avg: 326.82 / Max: 539.95 Min: 53.33 / Avg: 190.48 / Max: 282.32 Min: 63.04 / Avg: 330.55 / Max: 718.24 Min: 33.7 / Avg: 177.88 / Max: 364.34 Min: 28.79 / Avg: 152.24 / Max: 300.13 Min: 53.09 / Avg: 309.09 / Max: 579.88 Min: 21.36 / Avg: 127.63 / Max: 261.53 Min: 40.05 / Avg: 258.88 / Max: 518.97 Min: 19.07 / Avg: 96.36 / Max: 147.72 Min: 15.16 / Avg: 86.83 / Max: 132.07 Min: 104.71 / Avg: 215.79 / Max: 487.65 Min: 43.59 / Avg: 108.34 / Max: 211.25 Min: 43.53 / Avg: 119.29 / Max: 232.16 Min: 106.66 / Avg: 225.73 / Max: 522.28 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 6114 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 3328 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 3656 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 6895 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 5388 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 12802 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 5814 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 11681 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 5964 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 3905 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 4584 Joules per run. 12. EPYC 9684X: Approximate power consumption of 2419 Joules per run. 13. EPYC 9654: Approximate power consumption of 2101 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 4719 Joules per run. 15. EPYC 9754: Approximate power consumption of 1914 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 4297 Joules per run. 17. EPYC 8534P: Approximate power consumption of 1927 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 1758 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 4503 Joules per run. 20. Xeon 6766E: Approximate power consumption of 1815 Joules per run. 21. Xeon 6780E: Approximate power consumption of 1939 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 5022 Joules per run.
RocksDB OpenBenchmarking.org Watts, Fewer Is Better RocksDB 9.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 67.94 / Avg: 558.28 / Max: 752.93 Min: 33.11 / Avg: 323.9 / Max: 378.14 Min: 52.65 / Avg: 330.54 / Max: 376.66 Min: 157.04 / Avg: 656.04 / Max: 755.91 Min: 72.31 / Avg: 332.58 / Max: 376.04 Min: 200.41 / Avg: 651.38 / Max: 755.47 Min: 74.89 / Avg: 331.82 / Max: 375.82 Min: 185.7 / Avg: 663.3 / Max: 752.58 Min: 98.57 / Avg: 510.9 / Max: 583.45 Min: 55.14 / Avg: 255.9 / Max: 290.56 Min: 67.1 / Avg: 671.28 / Max: 820.11 Min: 34.3 / Avg: 383.63 / Max: 411.02 Min: 24.6 / Avg: 300.55 / Max: 337.2 Min: 56.63 / Avg: 576.34 / Max: 690.47 Min: 22 / Avg: 301.4 / Max: 339.84 Min: 43.23 / Avg: 505.19 / Max: 682.09 Min: 17.34 / Avg: 155.39 / Max: 168.8 Min: 17.36 / Avg: 134 / Max: 149.2 Min: 107.56 / Avg: 350.26 / Max: 540.44 Min: 43.66 / Avg: 179.48 / Max: 270.38 Min: 43.57 / Avg: 208.52 / Max: 356.32 Min: 108.91 / Avg: 400.79 / Max: 709.44
OpenBenchmarking.org Op/s Per Watt, More Is Better RocksDB 9.0 Test: Read While Writing Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 15K 30K 45K 60K 75K 22256.95 27560.28 23723.76 18781.27 22369.26 14775.49 22200.62 16920.46 19253.52 21648.99 29572.89 36906.83 48605.69 34889.65 52342.46 45330.18 60067.21 66672.70 69851.75 63183.03 56900.62 67516.29
Result
OpenBenchmarking.org Op/s, More Is Better RocksDB 9.0 Test: Read While Writing Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 6M 12M 18M 24M 30M SE +/- 215352.04, N = 15 SE +/- 28201.44, N = 3 SE +/- 61518.27, N = 10 SE +/- 343737.14, N = 15 SE +/- 83772.27, N = 13 SE +/- 218479.19, N = 15 SE +/- 26369.56, N = 3 SE +/- 254193.37, N = 15 SE +/- 113154.86, N = 4 SE +/- 23120.76, N = 3 SE +/- 236709.61, N = 3 SE +/- 93669.97, N = 15 SE +/- 36524.26, N = 3 SE +/- 506458.47, N = 15 SE +/- 109424.14, N = 3 SE +/- 273109.47, N = 3 SE +/- 28098.62, N = 3 SE +/- 81998.56, N = 3 SE +/- 426084.70, N = 15 SE +/- 45015.86, N = 3 SE +/- 136761.19, N = 4 SE +/- 726178.20, N = 12 12425519 8926893 7841738 12321300 7439663 9624417 7366500 11223329 9836689 5539870 19851664 14158419 14608544 20108289 15776186 22900152 9333645 8934176 24466143 11340389 11864815 27059786 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread Op/s Per Watt
OpenBenchmarking.org Op/s Per Watt, More Is Better RocksDB 9.0 Test: Read While Writing Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 15K 30K 45K 60K 75K 22256.95 27560.28 23723.76 18781.27 22369.26 14775.49 22200.62 16920.46 19253.52 21648.99 29572.89 36906.83 48605.69 34889.65 52342.46 45330.18 60067.21 66672.70 69851.75 63183.03 56900.62 67516.29 CPU Power Consumption
OpenBenchmarking.org Watts, Fewer Is Better RocksDB 9.0 CPU Power Consumption Monitor Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8380 2P Xeon Platinum 8380 EPYC 9684X 2P EPYC 9684X EPYC 9654 EPYC 9654 2P EPYC 9754 EPYC 9754 2P EPYC 8534P EPYC 8534PN Xeon 6766E 2P Xeon 6766E Xeon 6780E Xeon 6780E 2P 140 280 420 560 700 Min: 67.94 / Avg: 558.28 / Max: 752.93 Min: 33.11 / Avg: 323.9 / Max: 378.14 Min: 52.65 / Avg: 330.54 / Max: 376.66 Min: 157.04 / Avg: 656.04 / Max: 755.91 Min: 72.31 / Avg: 332.58 / Max: 376.04 Min: 200.41 / Avg: 651.38 / Max: 755.47 Min: 74.89 / Avg: 331.82 / Max: 375.82 Min: 185.7 / Avg: 663.3 / Max: 752.58 Min: 98.57 / Avg: 510.9 / Max: 583.45 Min: 55.14 / Avg: 255.9 / Max: 290.56 Min: 67.1 / Avg: 671.28 / Max: 820.11 Min: 34.3 / Avg: 383.63 / Max: 411.02 Min: 24.6 / Avg: 300.55 / Max: 337.2 Min: 56.63 / Avg: 576.34 / Max: 690.47 Min: 22 / Avg: 301.4 / Max: 339.84 Min: 43.23 / Avg: 505.19 / Max: 682.09 Min: 17.34 / Avg: 155.39 / Max: 168.8 Min: 17.36 / Avg: 134 / Max: 149.2 Min: 107.56 / Avg: 350.26 / Max: 540.44 Min: 43.66 / Avg: 179.48 / Max: 270.38 Min: 43.57 / Avg: 208.52 / Max: 356.32 Min: 108.91 / Avg: 400.79 / Max: 709.44 1. Xeon Platinum 8592+ 2P: Approximate power consumption of 35767 Joules per run. 2. Xeon Platinum 8592+: Approximate power consumption of 20838 Joules per run. 3. Xeon Platinum 8490H: Approximate power consumption of 21188 Joules per run. 4. Xeon Platinum 8490H 2P: Approximate power consumption of 42030 Joules per run. 5. Xeon Max 9468: Approximate power consumption of 21285 Joules per run. 6. Xeon Max 9468 2P: Approximate power consumption of 41688 Joules per run. 7. Xeon Max 9480: Approximate power consumption of 21347 Joules per run. 8. Xeon Max 9480 2P: Approximate power consumption of 42407 Joules per run. 9. Xeon Platinum 8380 2P: Approximate power consumption of 32826 Joules per run. 10. Xeon Platinum 8380: Approximate power consumption of 16463 Joules per run. 11. EPYC 9684X 2P: Approximate power consumption of 42738 Joules per run. 12. EPYC 9684X: Approximate power consumption of 24450 Joules per run. 13. EPYC 9654: Approximate power consumption of 19235 Joules per run. 14. EPYC 9654 2P: Approximate power consumption of 36694 Joules per run. 15. EPYC 9754: Approximate power consumption of 19390 Joules per run. 16. EPYC 9754 2P: Approximate power consumption of 32163 Joules per run. 17. EPYC 8534P: Approximate power consumption of 9997 Joules per run. 18. EPYC 8534PN: Approximate power consumption of 8621 Joules per run. 19. Xeon 6766E 2P: Approximate power consumption of 22463 Joules per run. 20. Xeon 6766E: Approximate power consumption of 11487 Joules per run. 21. Xeon 6780E: Approximate power consumption of 13397 Joules per run. 22. Xeon 6780E 2P: Approximate power consumption of 25717 Joules per run.
Xeon Platinum 8592+ 2P Processor: 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 8 April 2024 10:49 by user phoronix.
Xeon Platinum 8592+ Processor: INTEL XEON PLATINUM 8592+ @ 3.90GHz (64 Cores / 128 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 512GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 11 April 2024 18:15 by user phoronix.
Xeon Platinum 8490H Processor: Intel Xeon Platinum 8490H @ 3.50GHz (60 Cores / 120 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 512GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 16 April 2024 00:42 by user phoronix.
Xeon Platinum 8490H 2P Processor: 2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 17 April 2024 09:38 by user phoronix.
Xeon Max 9468 Processor: Intel Xeon Max 9468 @ 3.50GHz (48 Cores / 96 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 576GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 21 April 2024 09:58 by user phoronix.
Xeon Max 9468 2P Processor: 2 x Intel Xeon Max 9468 @ 3.50GHz (96 Cores / 192 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1136GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 22 April 2024 15:30 by user phoronix.
Xeon Max 9480 Processor: Intel Xeon Max 9480 @ 3.50GHz (56 Cores / 112 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 576GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 26 April 2024 09:38 by user phoronix.
Xeon Max 9480 2P Processor: 2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1136GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 27 April 2024 16:18 by user phoronix.
Xeon Platinum 8380 2P Processor: 2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads), Motherboard: Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS), Chipset: Intel Ice Lake IEH, Memory: 512GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd0003d1Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Mitigation of Microcode + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 7 May 2024 16:33 by user phoronix.
Xeon Platinum 8380 Processor: Intel Xeon Platinum 8380 @ 3.40GHz (40 Cores / 80 Threads), Motherboard: Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS), Chipset: Intel Ice Lake IEH, Memory: 256GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd0003d1Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Mitigation of Microcode + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 9 May 2024 13:53 by user phoronix.
EPYC 9684X 2P Processor: 2 x AMD EPYC 9684X 96-Core @ 2.55GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 11 May 2024 02:04 by user phoronix.
EPYC 9684X Processor: AMD EPYC 9684X 96-Core @ 2.55GHz (96 Cores / 192 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEG, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 12 May 2024 12:29 by user phoronix.
EPYC 9654 Processor: AMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEG, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 13 May 2024 14:14 by user phoronix.
EPYC 9654 2P Processor: 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 14 May 2024 15:08 by user phoronix.
EPYC 9754 Processor: AMD EPYC 9754 128-Core @ 2.25GHz (128 Cores / 256 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEG, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00116Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 15 May 2024 21:09 by user phoronix.
EPYC 9754 2P Processor: 2 x AMD EPYC 9754 128-Core @ 2.25GHz (256 Cores / 512 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00116Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 17 May 2024 00:34 by user phoronix.
EPYC 8534P Processor: AMD EPYC 8534P 64-Core @ 2.30GHz (64 Cores / 128 Threads), Motherboard: AMD Cinnabar (RCB1009C BIOS), Chipset: AMD Device 14a4, Memory: 6 x 32GB DDR5-4800MT/s Samsung M321R4GA0BB0-CQKMG, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92 + 2000GB Corsair MP700 PRO, Graphics: ASPEED, Network: 2 x Broadcom NetXtreme BCM5720 PCIe
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00213Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 18 May 2024 13:07 by user phoronix.
EPYC 8534PN Processor: AMD EPYC 8534PN 64-Core @ 2.00GHz (64 Cores / 128 Threads), Motherboard: AMD Cinnabar (RCB1009C BIOS), Chipset: AMD Device 14a4, Memory: 6 x 32GB DDR5-4800MT/s Samsung M321R4GA0BB0-CQKMG, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: 2 x Broadcom NetXtreme BCM5720 PCIe
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00213Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 19 May 2024 17:06 by user phoronix.
Xeon 6766E 2P Processor: 2 x Intel Xeon 6766E @ 2.70GHz (288 Cores), Motherboard: Quanta Cloud QuantaGrid D55Q-2U S7Q-MB-MPS-MDP (2A05.QCT001 BIOS), Chipset: Intel Ice Lake IEH, Memory: 512GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS + 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: 2 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 24 May 2024 12:45 by user phoronix.
Xeon 6766E Processor: Intel Xeon 6766E @ 2.70GHz (144 Cores), Motherboard: Quanta Cloud QuantaGrid D55Q-2U S7Q-MB-MPS-MDP (2A05.QCT001 BIOS), Chipset: Intel Ice Lake IEH, Memory: 256GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92 + 3201GB Micron_7450_MTFDKCB3T2TFS, Graphics: ASPEED, Network: 2 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 25 May 2024 14:43 by user phoronix.
Xeon 6780E Processor: Intel Xeon 6780E @ 3.00GHz (144 Cores), Motherboard: Quanta Cloud QuantaGrid D55Q-2U S7Q-MB-MPS-MDP (2A05.QCT001 BIOS), Chipset: Intel Ice Lake IEH, Memory: 256GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS + 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: 2 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 26 May 2024 18:38 by user phoronix.
Xeon 6780E 2P Processor: 2 x Intel Xeon 6780E @ 3.00GHz (288 Cores), Motherboard: Quanta Cloud QuantaGrid D55Q-2U S7Q-MB-MPS-MDP (2A05.QCT001 BIOS), Chipset: Intel Ice Lake IEH, Memory: 512GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS + 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: 2 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA
OS: Ubuntu 24.04, Kernel: 6.9.0-060900rc3-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131Java Notes: OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Notes: Python 3.12.2Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 27 May 2024 18:06 by user phoronix.