Ampere Altra Mt Jade vs. Xeon vs. EPYC Benchmarks Benchmarks for a future article. Compared to prior out-of-the-box Ubuntu results, this round of testing is with the performance governor forced on all CPUs. Also with the CFLAGS/CXXFLAGS being catered on each server to the processor microarchitecture under test. Ampere Altra "Boost" run is when force enabling CPUFreq boost on Ubuntu.
HTML result view exported from: https://openbenchmarking.org/result/2012148-HA-2012099HA05&sor&grt&export=pdf .
Ampere Altra Mt Jade vs. Xeon vs. EPYC Benchmarks Processor Motherboard Chipset Memory Disk Graphics Monitor Network OS Kernel Display Server Display Driver Compiler File-System Screen Resolution Desktop Ampere Altra 2P Xeon Platinum 8280 2P EPYC 7742 2P Ampere Altra Q80-33 Ampere Altra ARMv8 Neoverse-N1 @ 3.00GHz (160 Cores) WIWYNN Mt.Jade (1.1.20201019 BIOS) Ampere Computing LLC Device e100 16 x 32 GB DDR4-3200MT/s Samsung M393A4K40DB3-CWE 3841GB Micron_9300_MTFDHAL3T8TDP ASPEED VE228 Mellanox MT28908 + Intel I210 Ubuntu 20.10 5.8.0-29-generic (aarch64) X Server 1.20.9 modesetting 1.20.9 GCC 10.2.0 ext4 1920x1080 2 x Intel Xeon Platinum 8280 @ 4.00GHz (56 Cores / 112 Threads) GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS) Intel Sky Lake-E DMI3 Registers 12 x 32 GB DDR4-2933MT/s HMA84GR7CJR4N-WM 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE 5.8.0-29-generic (x86_64) GNOME Shell 3.38.1 X Server 1.20.8 modesetting 1.20.8 1024x768 2 x AMD EPYC 7742 64-Core @ 2.25GHz (128 Cores / 256 Threads) AMD DAYTONA_X (RDY1006G BIOS) AMD Starship/Matisse 16 x 32 GB DDR4-3200MT/s 36ASF4G72PZ-3G2E2 VE228 2 x Mellanox MT27710 1920x1080 Ampere Altra ARMv8 Neoverse-N1 @ 3.30GHz (160 Cores) WIWYNN Mt.Jade (1.1.20201019 BIOS) Ampere Computing LLC Device e100 16 x 32 GB DDR4-3200MT/s Samsung M393A4K40DB3-CWE 3841GB Micron_9300_MTFDHAL3T8TDP + 960GB SAMSUNG MZ1LB960HAJQ-00007 Mellanox MT28908 + Intel I210 5.10.0-051000rc6daily20201206-generic (aarch64) 20201206 X Server 1.20.9 modesetting 1.20.9 OpenBenchmarking.org Environment Details - Ampere Altra 2P: CXXFLAGS="-O3 -march=armv8.2-a -mtune=neoverse-n1" CFLAGS="-O3 -march=armv8.2-a -mtune=neoverse-n1" - Xeon Platinum 8280 2P: CXXFLAGS="-O3 -march=native" CFLAGS="-O3 -march=native" - EPYC 7742 2P: CXXFLAGS="-O3 -march=native" CFLAGS="-O3 -march=native" - Ampere Altra Q80-33: CXXFLAGS=-O3 CFLAGS=-O3 Compiler Details - Ampere Altra 2P: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - Xeon Platinum 8280 2P: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - EPYC 7742 2P: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Ampere Altra Q80-33: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v Disk Details - Ampere Altra 2P: NONE / relatime,rw / Block Size: 4096 - Xeon Platinum 8280 2P: NONE / errors=remount-ro,relatime,rw / Block Size: 4096 - EPYC 7742 2P: NONE / errors=remount-ro,relatime,rw / Block Size: 4096 Processor Details - Ampere Altra 2P: Scaling Governor: cppc_cpufreq performance (Boost: Enabled) - Xeon Platinum 8280 2P: Scaling Governor: intel_pstate performance - CPU Microcode: 0x5003003 - EPYC 7742 2P: Scaling Governor: acpi-cpufreq performance - CPU Microcode: 0x8301034 - Ampere Altra Q80-33: Scaling Governor: cppc_cpufreq performance (Boost: Enabled) Java Details - Ampere Altra 2P, Xeon Platinum 8280 2P, EPYC 7742 2P: OpenJDK Runtime Environment (build 11.0.9.1+1-Ubuntu-0ubuntu1.20.10) Python Details - Ampere Altra 2P: Python 3.8.6 - Xeon Platinum 8280 2P: Python 2.7.18 + Python 3.8.6 - EPYC 7742 2P: Python 2.7.18 + Python 3.8.6 - Ampere Altra Q80-33: Python 3.8.6 Security Details - Ampere Altra 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Xeon Platinum 8280 2P: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled - EPYC 7742 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected - Ampere Altra Q80-33: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Ampere Altra Mt Jade vs. Xeon vs. EPYC Benchmarks astcenc: Exhaustive basis: UASTC Level 3 blender: Classroom - CPU-Only coremark: CoreMark Size 666 - Iterations Per Second rocksdb: Rand Read hpcg: compress-lz4: 1 - Compression Speed compress-lz4: 9 - Compression Speed compress-lz4: 9 - Decompression Speed compress-lz4: 1 - Decompression Speed m-queens: Time To Solve mbw: Memory Copy - 4096 MiB numpy: openssl: RSA 4096-bit Performance phpbench: PHP Benchmark Suite pgbench: 1000 - 250 - Read Write pgbench: 1000 - 250 - Read Write - Average Latency pybench: Total For Average Test Times redis: GET rodinia: OpenMP LavaMD stream: Copy stream: Scale stream: Add stream: Triad build-ffmpeg: Time To Compile build-llvm: Time To Compile build-php: Time To Compile tnn: CPU - MobileNet v2 tnn: CPU - SqueezeNet v1.1 Ampere Altra 2P Xeon Platinum 8280 2P EPYC 7742 2P Ampere Altra Q80-33 25.05 11.509 65.33 3705087.522089 890738361 44.8021 9460.62 44.69 9548.0 6.257 237.16 8573.4 529344 23154 10.857 1304 1846629.65 31.771 20.060 281.122 54.162 317.810 290.800 52.20 19.626 84.56 1844054.141034 247216815 28.8477 5417.76 47.68 6361.8 17.984 329.32 13716.6 652140 37660 6.657 1096 2488006.9 56.423 19.959 225.600 38.376 337.357 326.466 21.60 13.613 44.96 4002710.553017 482174282 32.3962 9477.91 44.35 10378.5 7.693 300.56 25075.0 515977 24214 10.618 1173 1973922.33 31.317 16.403 203.918 39.368 332.587 300.670 25.38 11.396 66.02 4079566.577837 921702693 44.6253 9396.47 45.10 9343.5 10281.3 6.479 9892.006 240.93 8637.1 522274 24043 10.458 1306 1979828.78 29.491 267437.4 282282.0 300788.9 303290.4 19.397 282.642 60.173 318.949 253.657 OpenBenchmarking.org
ASTC Encoder Preset: Exhaustive OpenBenchmarking.org Seconds, Fewer Is Better ASTC Encoder 2.0 Preset: Exhaustive EPYC 7742 2P Ampere Altra 2P Ampere Altra Q80-33 Xeon Platinum 8280 2P 12 24 36 48 60 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.12, N = 3 SE +/- 0.02, N = 3 21.60 25.05 25.38 52.20 -mfpmath=sse -mavx2 -mpopcnt -mfpmath=sse -mavx2 -mpopcnt 1. (CXX) g++ options: -std=c++14 -fvisibility=hidden -O3 -flto -lpthread
ASTC Encoder CPU Power Consumption Monitor Min Avg Max Ampere Altra Q80-33 36.0 288.1 409.0 Ampere Altra 2P 37.0 291.0 405.0 Xeon Platinum 8280 2P 28.9 328.0 382.7 EPYC 7742 2P 103.6 332.9 453.7 OpenBenchmarking.org Watts, Fewer Is Better ASTC Encoder 2.0 CPU Power Consumption Monitor 120 240 360 480 600
ASTC Encoder CPU Temperature Monitor Min Avg Max Xeon Platinum 8280 2P 37.0 62.3 69.0 EPYC 7742 2P 54.0 64.0 70.0 Ampere Altra Q80-33 45.0 73.1 86.0 Ampere Altra 2P 47.0 74.4 88.0 OpenBenchmarking.org Celsius, Fewer Is Better ASTC Encoder 2.0 CPU Temperature Monitor 20 40 60 80 100
Basis Universal Settings: UASTC Level 3 OpenBenchmarking.org Seconds, Fewer Is Better Basis Universal 1.12 Settings: UASTC Level 3 Ampere Altra Q80-33 Ampere Altra 2P EPYC 7742 2P Xeon Platinum 8280 2P 5 10 15 20 25 SE +/- 0.12, N = 4 SE +/- 0.07, N = 4 SE +/- 0.07, N = 4 SE +/- 0.00, N = 3 11.40 11.51 13.61 19.63 1. (CXX) g++ options: -std=c++11 -fvisibility=hidden -fPIC -fno-strict-aliasing -O3 -rdynamic -lm -lpthread
Basis Universal CPU Power Consumption Monitor Min Avg Max Ampere Altra 2P 37.0 120.3 321.0 Ampere Altra Q80-33 37.0 125.9 323.0 EPYC 7742 2P 98.9 219.5 434.3 Xeon Platinum 8280 2P 28.6 239.4 425.8 OpenBenchmarking.org Watts, Fewer Is Better Basis Universal 1.12 CPU Power Consumption Monitor 110 220 330 440 550
Basis Universal CPU Temperature Monitor Min Avg Max Xeon Platinum 8280 2P 37.0 51.1 66.0 Ampere Altra 2P 47.0 54.5 75.0 Ampere Altra Q80-33 48.0 55.3 76.0 EPYC 7742 2P 53.8 59.3 66.8 OpenBenchmarking.org Celsius, Fewer Is Better Basis Universal 1.12 CPU Temperature Monitor 20 40 60 80 100
Blender Blend File: Classroom - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.83.5 Blend File: Classroom - Compute: CPU-Only EPYC 7742 2P Ampere Altra 2P Ampere Altra Q80-33 Xeon Platinum 8280 2P 20 40 60 80 100 SE +/- 0.31, N = 3 SE +/- 0.20, N = 3 SE +/- 0.58, N = 3 SE +/- 0.16, N = 3 44.96 65.33 66.02 84.56
Blender CPU Power Consumption Monitor Min Avg Max Ampere Altra 2P 37.0 283.5 337.0 Ampere Altra Q80-33 35.0 286.0 334.0 OpenBenchmarking.org Watts, Fewer Is Better Blender 2.83.5 CPU Power Consumption Monitor 80 160 240 320 400
Blender CPU Temperature Monitor Min Avg Max Ampere Altra 2P 47.0 72.2 80.0 Ampere Altra Q80-33 48.0 73.7 82.0 OpenBenchmarking.org Celsius, Fewer Is Better Blender 2.83.5 CPU Temperature Monitor 20 40 60 80 100
Coremark CoreMark Size 666 - Iterations Per Second OpenBenchmarking.org Iterations/Sec, More Is Better Coremark 1.0 CoreMark Size 666 - Iterations Per Second Ampere Altra Q80-33 EPYC 7742 2P Ampere Altra 2P Xeon Platinum 8280 2P 900K 1800K 2700K 3600K 4500K SE +/- 5587.87, N = 3 SE +/- 877.48, N = 3 SE +/- 113984.01, N = 15 SE +/- 9763.66, N = 3 4079566.58 4002710.55 3705087.52 1844054.14 -march=native -march=armv8.2-a -mtune=neoverse-n1 -march=native 1. (CC) gcc options: -O2 -O3 -lrt" -lrt
Coremark CoreMark Size 666 - Iterations Per Second OpenBenchmarking.org Iterations/Sec Per Watt, More Is Better Coremark 1.0 CoreMark Size 666 - Iterations Per Second Ampere Altra Q80-33 Ampere Altra 2P EPYC 7742 2P Xeon Platinum 8280 2P 4K 8K 12K 16K 20K 19293.66 18385.43 11499.36 5733.84
Coremark CPU Power Consumption Monitor Min Avg Max Ampere Altra 2P 35.0 201.5 304.0 Ampere Altra Q80-33 39.0 211.4 307.0 Xeon Platinum 8280 2P 28.7 321.6 437.6 EPYC 7742 2P 109.3 348.1 434.2 OpenBenchmarking.org Watts, Fewer Is Better Coremark 1.0 CPU Power Consumption Monitor 110 220 330 440 550
Coremark CPU Temperature Monitor Min Avg Max Xeon Platinum 8280 2P 34.0 58.8 71.0 Ampere Altra 2P 48.0 64.7 76.0 Ampere Altra Q80-33 47.0 64.9 75.0 EPYC 7742 2P 54.8 65.6 72.8 OpenBenchmarking.org Celsius, Fewer Is Better Coremark 1.0 CPU Temperature Monitor 20 40 60 80 100
CPU Power Consumption Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Watts CPU Power Consumption Monitor Phoronix Test Suite System Monitoring Ampere Altra Q80-33 80 160 240 320 400 Min: 34 / Avg: 145.21 / Max: 454
CPU Temperature Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Celsius CPU Temperature Monitor Phoronix Test Suite System Monitoring Ampere Altra Q80-33 20 40 60 80 100 Min: 45 / Avg: 58.88 / Max: 102
Facebook RocksDB Test: Random Read OpenBenchmarking.org Op/s, More Is Better Facebook RocksDB 6.3.6 Test: Random Read Ampere Altra Q80-33 Ampere Altra 2P EPYC 7742 2P Xeon Platinum 8280 2P 200M 400M 600M 800M 1000M SE +/- 1326768.24, N = 3 SE +/- 10379193.81, N = 15 SE +/- 5369165.24, N = 3 SE +/- 385263.55, N = 3 921702693 890738361 482174282 247216815 -march=armv8-a+crc -march=armv8-a+crc 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread
Facebook RocksDB Test: Random Read OpenBenchmarking.org Op/s Per Watt, More Is Better Facebook RocksDB 6.3.6 Test: Random Read Ampere Altra Q80-33 Ampere Altra 2P EPYC 7742 2P Xeon Platinum 8280 2P 500K 1000K 1500K 2000K 2500K 2283044.43 2204937.01 1129501.20 642060.42
Facebook RocksDB CPU Power Consumption Monitor Min Avg Max Xeon Platinum 8280 2P 28.9 385.0 466.1 Ampere Altra Q80-33 37.0 403.7 454.0 Ampere Altra 2P 36.0 404.0 462.0 EPYC 7742 2P 98.9 426.9 454.4 OpenBenchmarking.org Watts, Fewer Is Better Facebook RocksDB 6.3.6 CPU Power Consumption Monitor 120 240 360 480 600
Facebook RocksDB CPU Temperature Monitor Min Avg Max EPYC 7742 2P 56.8 66.1 68.8 Xeon Platinum 8280 2P 34.0 67.8 73.0 Ampere Altra Q80-33 46.0 94.5 102.0 Ampere Altra 2P 47.0 95.5 104.0 OpenBenchmarking.org Celsius, Fewer Is Better Facebook RocksDB 6.3.6 CPU Temperature Monitor 20 40 60 80 100
High Performance Conjugate Gradient OpenBenchmarking.org GFLOP/s, More Is Better High Performance Conjugate Gradient 3.1 Ampere Altra 2P Ampere Altra Q80-33 EPYC 7742 2P Xeon Platinum 8280 2P 10 20 30 40 50 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 44.80 44.63 32.40 28.85 1. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -pthread -lmpi_cxx -lmpi
High Performance Conjugate Gradient OpenBenchmarking.org GFLOP/s Per Watt, More Is Better High Performance Conjugate Gradient 3.1 Ampere Altra 2P Ampere Altra Q80-33 EPYC 7742 2P Xeon Platinum 8280 2P 0.0293 0.0586 0.0879 0.1172 0.1465 0.13 0.12 0.08 0.08
High Performance Conjugate Gradient CPU Power Consumption Monitor Min Avg Max Xeon Platinum 8280 2P 28.5 348.8 389.4 Ampere Altra 2P 37.0 352.3 423.0 Ampere Altra Q80-33 37.0 359.1 424.0 EPYC 7742 2P 111.5 417.9 438.1 OpenBenchmarking.org Watts, Fewer Is Better High Performance Conjugate Gradient 3.1 CPU Power Consumption Monitor 110 220 330 440 550
High Performance Conjugate Gradient CPU Temperature Monitor Min Avg Max Xeon Platinum 8280 2P 30.0 62.6 69.0 EPYC 7742 2P 57.3 66.6 72.0 Ampere Altra 2P 46.0 81.6 88.0 Ampere Altra Q80-33 47.0 82.5 87.0 OpenBenchmarking.org Celsius, Fewer Is Better High Performance Conjugate Gradient 3.1 CPU Temperature Monitor 20 40 60 80 100
LZ4 Compression Compression Level: 1 - Compression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.3 Compression Level: 1 - Compression Speed EPYC 7742 2P Ampere Altra 2P Ampere Altra Q80-33 Xeon Platinum 8280 2P 2K 4K 6K 8K 10K SE +/- 19.87, N = 3 SE +/- 20.24, N = 3 SE +/- 38.50, N = 3 SE +/- 16.87, N = 3 9477.91 9460.62 9396.47 5417.76 1. (CC) gcc options: -O3
LZ4 Compression Compression Level: 9 - Compression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.3 Compression Level: 9 - Compression Speed Xeon Platinum 8280 2P Ampere Altra Q80-33 Ampere Altra 2P EPYC 7742 2P 11 22 33 44 55 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.19, N = 3 SE +/- 0.59, N = 5 47.68 45.10 44.69 44.35 1. (CC) gcc options: -O3
LZ4 Compression Compression Level: 9 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.3 Compression Level: 9 - Decompression Speed EPYC 7742 2P Ampere Altra 2P Ampere Altra Q80-33 Xeon Platinum 8280 2P 2K 4K 6K 8K 10K SE +/- 46.44, N = 5 SE +/- 36.79, N = 3 SE +/- 107.19, N = 3 SE +/- 29.10, N = 3 10378.5 9548.0 9343.5 6361.8 1. (CC) gcc options: -O3
LZ4 Compression Compression Level: 9 - Decompression Speed OpenBenchmarking.org MB/s Per Watt, More Is Better LZ4 Compression 1.9.3 Compression Level: 9 - Decompression Speed Ampere Altra 2P Ampere Altra Q80-33 Xeon Platinum 8280 2P EPYC 7742 2P 30 60 90 120 150 124.17 117.05 67.45 67.36
LZ4 Compression CPU Power Consumption Monitor Min Avg Max Ampere Altra 2P 34.0 76.9 89.0 Ampere Altra Q80-33 36.0 79.8 90.0 Xeon Platinum 8280 2P 28.6 94.3 100.4 EPYC 7742 2P 94.5 154.1 169.2 OpenBenchmarking.org Watts, Fewer Is Better LZ4 Compression 1.9.3 CPU Power Consumption Monitor 50 100 150 200 250
LZ4 Compression CPU Temperature Monitor Min Avg Max Xeon Platinum 8280 2P 30.0 36.5 38.0 Ampere Altra Q80-33 48.0 49.9 51.0 Ampere Altra 2P 47.0 50.0 51.0 EPYC 7742 2P 54.5 58.9 61.5 OpenBenchmarking.org Celsius, Fewer Is Better LZ4 Compression 1.9.3 CPU Temperature Monitor 20 40 60 80 100
LZ4 Compression Compression Level: 1 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.3 Compression Level: 1 - Decompression Speed Ampere Altra Q80-33 2K 4K 6K 8K 10K SE +/- 36.75, N = 3 10281.3 1. (CC) gcc options: -O3
LZ4 Compression Compression Level: 1 - Decompression Speed OpenBenchmarking.org MB/s Per Watt, More Is Better LZ4 Compression 1.9.3 Compression Level: 1 - Decompression Speed Ampere Altra Q80-33 30 60 90 120 150 127.18
LZ4 Compression CPU Power Consumption Monitor Min Avg Max Ampere Altra Q80-33 38.0 80.8 93.0 OpenBenchmarking.org Watts, Fewer Is Better LZ4 Compression 1.9.3 CPU Power Consumption Monitor 20 40 60 80 100
LZ4 Compression CPU Temperature Monitor Min Avg Max Ampere Altra Q80-33 49.0 50.8 51.0 OpenBenchmarking.org Celsius, Fewer Is Better LZ4 Compression 1.9.3 CPU Temperature Monitor 15 30 45 60 75
m-queens Time To Solve OpenBenchmarking.org Seconds, Fewer Is Better m-queens 1.2 Time To Solve Ampere Altra 2P Ampere Altra Q80-33 EPYC 7742 2P Xeon Platinum 8280 2P 4 8 12 16 20 SE +/- 0.065, N = 8 SE +/- 0.079, N = 15 SE +/- 0.042, N = 6 SE +/- 0.069, N = 3 6.257 6.479 7.693 17.984 -march=armv8.2-a -mtune=neoverse-n1 1. (CXX) g++ options: -fopenmp -O3 -O2 -march=native
m-queens CPU Power Consumption Monitor Min Avg Max Ampere Altra 2P 37.0 185.7 327.0 Ampere Altra Q80-33 36.0 189.4 330.0 EPYC 7742 2P 112.8 306.6 429.6 Xeon Platinum 8280 2P 28.4 333.7 410.6 OpenBenchmarking.org Watts, Fewer Is Better m-queens 1.2 CPU Power Consumption Monitor 110 220 330 440 550
m-queens CPU Temperature Monitor Min Avg Max Xeon Platinum 8280 2P 32.0 55.9 67.0 EPYC 7742 2P 54.3 62.9 72.3 Ampere Altra Q80-33 50.0 63.8 80.0 Ampere Altra 2P 50.0 66.8 81.0 OpenBenchmarking.org Celsius, Fewer Is Better m-queens 1.2 CPU Temperature Monitor 20 40 60 80 100
MBW Test: Memory Copy - Array Size: 4096 MiB OpenBenchmarking.org MiB/s, More Is Better MBW 2018-09-08 Test: Memory Copy - Array Size: 4096 MiB Ampere Altra Q80-33 2K 4K 6K 8K 10K SE +/- 10.44, N = 3 9892.01 1. (CC) gcc options: -O3 -march=native
MBW Test: Memory Copy - Array Size: 4096 MiB OpenBenchmarking.org MiB/s Per Watt, More Is Better MBW 2018-09-08 Test: Memory Copy - Array Size: 4096 MiB Ampere Altra Q80-33 30 60 90 120 150 117.04
MBW CPU Power Consumption Monitor Min Avg Max Ampere Altra Q80-33 42.0 84.5 98.0 OpenBenchmarking.org Watts, Fewer Is Better MBW 2018-09-08 CPU Power Consumption Monitor 20 40 60 80 100
MBW CPU Temperature Monitor Min Avg Max Ampere Altra Q80-33 50.0 52.4 53.0 OpenBenchmarking.org Celsius, Fewer Is Better MBW 2018-09-08 CPU Temperature Monitor 15 30 45 60 75
Meta Performance Per Watts Performance Per Watts OpenBenchmarking.org Performance Per Watts, More Is Better Meta Performance Per Watts Performance Per Watts Ampere Altra Q80-33 20K 40K 60K 80K 100K 90208.12
Numpy Benchmark OpenBenchmarking.org Score, More Is Better Numpy Benchmark Xeon Platinum 8280 2P EPYC 7742 2P Ampere Altra Q80-33 Ampere Altra 2P 70 140 210 280 350 SE +/- 0.43, N = 3 SE +/- 0.51, N = 3 SE +/- 1.07, N = 3 SE +/- 0.21, N = 3 329.32 300.56 240.93 237.16
Numpy Benchmark OpenBenchmarking.org Score Per Watt, More Is Better Numpy Benchmark Xeon Platinum 8280 2P Ampere Altra Q80-33 Ampere Altra 2P EPYC 7742 2P 0.765 1.53 2.295 3.06 3.825 3.40 2.93 2.93 1.94
Numpy Benchmark CPU Power Consumption Monitor Min Avg Max Ampere Altra 2P 35.0 80.9 93.0 Ampere Altra Q80-33 38.0 82.3 99.0 Xeon Platinum 8280 2P 28.5 97.0 101.3 EPYC 7742 2P 103.7 155.0 166.9 OpenBenchmarking.org Watts, Fewer Is Better Numpy Benchmark CPU Power Consumption Monitor 50 100 150 200 250
Numpy Benchmark CPU Temperature Monitor Min Avg Max Xeon Platinum 8280 2P 32.0 36.4 38.0 Ampere Altra Q80-33 47.0 50.9 51.0 Ampere Altra 2P 48.0 51.0 52.0 EPYC 7742 2P 54.8 56.6 59.5 OpenBenchmarking.org Celsius, Fewer Is Better Numpy Benchmark CPU Temperature Monitor 16 32 48 64 80
OpenSSL RSA 4096-bit Performance OpenBenchmarking.org Signs Per Second, More Is Better OpenSSL 1.1.1 RSA 4096-bit Performance EPYC 7742 2P Xeon Platinum 8280 2P Ampere Altra Q80-33 Ampere Altra 2P 5K 10K 15K 20K 25K SE +/- 2.28, N = 3 SE +/- 22.54, N = 3 SE +/- 31.92, N = 3 SE +/- 45.96, N = 3 25075.0 13716.6 8637.1 8573.4 -m64 -march=native -m64 -march=native -march=armv8.2-a -mtune=neoverse-n1 1. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl
OpenSSL RSA 4096-bit Performance OpenBenchmarking.org Signs Per Second Per Watt, More Is Better OpenSSL 1.1.1 RSA 4096-bit Performance EPYC 7742 2P Ampere Altra 2P Ampere Altra Q80-33 Xeon Platinum 8280 2P 16 32 48 64 80 72.01 46.85 46.62 39.61
OpenSSL CPU Power Consumption Monitor Min Avg Max Ampere Altra 2P 39.0 183.0 227.0 Ampere Altra Q80-33 37.0 185.3 230.0 Xeon Platinum 8280 2P 28.8 346.3 460.8 EPYC 7742 2P 96.1 348.2 409.5 OpenBenchmarking.org Watts, Fewer Is Better OpenSSL 1.1.1 CPU Power Consumption Monitor 120 240 360 480 600
OpenSSL CPU Temperature Monitor Min Avg Max Xeon Platinum 8280 2P 32.0 59.3 69.0 Ampere Altra Q80-33 48.0 63.4 68.0 Ampere Altra 2P 48.0 63.8 69.0 EPYC 7742 2P 56.8 66.1 70.8 OpenBenchmarking.org Celsius, Fewer Is Better OpenSSL 1.1.1 CPU Temperature Monitor 20 40 60 80 100
PHPBench PHP Benchmark Suite OpenBenchmarking.org Score, More Is Better PHPBench 0.8.1 PHP Benchmark Suite Xeon Platinum 8280 2P Ampere Altra 2P Ampere Altra Q80-33 EPYC 7742 2P 140K 280K 420K 560K 700K SE +/- 716.89, N = 4 SE +/- 658.53, N = 3 SE +/- 2691.19, N = 3 SE +/- 5524.79, N = 3 652140 529344 522274 515977
PHPBench PHP Benchmark Suite OpenBenchmarking.org Score Per Watt, More Is Better PHPBench 0.8.1 PHP Benchmark Suite Xeon Platinum 8280 2P Ampere Altra 2P Ampere Altra Q80-33 EPYC 7742 2P 2K 4K 6K 8K 10K 7783.17 7387.18 7076.35 3455.11
PHPBench CPU Power Consumption Monitor Min Avg Max Ampere Altra 2P 35.0 71.7 82.0 Ampere Altra Q80-33 38.0 73.8 87.0 Xeon Platinum 8280 2P 28.6 83.8 99.2 EPYC 7742 2P 108.6 149.3 155.3 OpenBenchmarking.org Watts, Fewer Is Better PHPBench 0.8.1 CPU Power Consumption Monitor 40 80 120 160 200
PHPBench CPU Temperature Monitor Min Avg Max Xeon Platinum 8280 2P 32.0 33.1 34.0 Ampere Altra 2P 48.0 49.6 50.0 Ampere Altra Q80-33 49.0 50.6 51.0 EPYC 7742 2P 56.5 58.1 59.0 OpenBenchmarking.org Celsius, Fewer Is Better PHPBench 0.8.1 CPU Temperature Monitor 16 32 48 64 80
PostgreSQL pgbench Scaling Factor: 1000 - Clients: 250 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL pgbench 13.0 Scaling Factor: 1000 - Clients: 250 - Mode: Read Write Xeon Platinum 8280 2P EPYC 7742 2P Ampere Altra Q80-33 Ampere Altra 2P 8K 16K 24K 32K 40K SE +/- 366.26, N = 9 SE +/- 1158.09, N = 12 SE +/- 256.09, N = 12 SE +/- 247.30, N = 12 37660 24214 24043 23154 -march=native -march=native -march=armv8.2-a -mtune=neoverse-n1 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O3 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
PostgreSQL pgbench Scaling Factor: 1000 - Clients: 250 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL pgbench 13.0 Scaling Factor: 1000 - Clients: 250 - Mode: Read Write - Average Latency Xeon Platinum 8280 2P Ampere Altra Q80-33 EPYC 7742 2P Ampere Altra 2P 3 6 9 12 15 SE +/- 0.062, N = 9 SE +/- 0.112, N = 12 SE +/- 0.483, N = 12 SE +/- 0.124, N = 12 6.657 10.458 10.618 10.857 -march=native -march=native -march=armv8.2-a -mtune=neoverse-n1 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O3 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
PostgreSQL pgbench CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better PostgreSQL pgbench 13.0 CPU Power Consumption Monitor Ampere Altra 2P Ampere Altra Q80-33 Xeon Platinum 8280 2P EPYC 7742 2P 60 120 180 240 300 Min: 34 / Avg: 83.83 / Max: 208 Min: 35 / Avg: 86.28 / Max: 191 Min: 28.69 / Avg: 111.71 / Max: 293.1 Min: 101.94 / Avg: 170.82 / Max: 334.86
PostgreSQL pgbench CPU Temperature Monitor Min Avg Max Xeon Platinum 8280 2P 31.0 33.7 45.0 Ampere Altra 2P 48.0 51.5 58.0 Ampere Altra Q80-33 49.0 52.5 59.0 EPYC 7742 2P 54.8 60.6 69.5 OpenBenchmarking.org Celsius, Fewer Is Better PostgreSQL pgbench 13.0 CPU Temperature Monitor 20 40 60 80 100
PyBench Total For Average Test Times OpenBenchmarking.org Milliseconds, Fewer Is Better PyBench 2018-02-16 Total For Average Test Times Xeon Platinum 8280 2P EPYC 7742 2P Ampere Altra 2P Ampere Altra Q80-33 300 600 900 1200 1500 SE +/- 0.88, N = 3 SE +/- 1.20, N = 3 SE +/- 6.11, N = 3 1096 1173 1304 1306
PyBench CPU Power Consumption Monitor Min Avg Max Ampere Altra 2P 37.0 73.3 82.0 Ampere Altra Q80-33 36.0 76.2 87.0 Xeon Platinum 8280 2P 28.5 88.8 99.6 EPYC 7742 2P 113.6 150.2 155.4 OpenBenchmarking.org Watts, Fewer Is Better PyBench 2018-02-16 CPU Power Consumption Monitor 40 80 120 160 200
PyBench CPU Temperature Monitor Min Avg Max Xeon Platinum 8280 2P 30.0 32.1 33.0 Ampere Altra 2P 47.0 48.9 50.0 Ampere Altra Q80-33 48.0 50.5 51.0 EPYC 7742 2P 53.8 55.3 58.3 OpenBenchmarking.org Celsius, Fewer Is Better PyBench 2018-02-16 CPU Temperature Monitor 16 32 48 64 80
Redis Test: GET OpenBenchmarking.org Requests Per Second, More Is Better Redis 6.0.9 Test: GET Xeon Platinum 8280 2P Ampere Altra Q80-33 EPYC 7742 2P Ampere Altra 2P 500K 1000K 1500K 2000K 2500K SE +/- 4383.55, N = 5 SE +/- 23363.74, N = 15 SE +/- 34420.11, N = 15 SE +/- 25760.99, N = 15 2488006.90 1979828.78 1973922.33 1846629.65 -march=native -march=native -march=armv8.2-a -mtune=neoverse-n1 1. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3
Redis Test: GET OpenBenchmarking.org Requests Per Second Per Watt, More Is Better Redis 6.0.9 Test: GET Xeon Platinum 8280 2P Ampere Altra Q80-33 Ampere Altra 2P EPYC 7742 2P 20K 40K 60K 80K 100K 79620.82 48091.24 46643.73 16146.33
Redis CPU Power Consumption Monitor Min Avg Max Xeon Platinum 8280 2P 28.3 31.2 59.2 Ampere Altra 2P 34.0 39.6 78.0 Ampere Altra Q80-33 34.0 41.2 83.0 EPYC 7742 2P 102.2 122.3 150.7 OpenBenchmarking.org Watts, Fewer Is Better Redis 6.0.9 CPU Power Consumption Monitor 40 80 120 160 200
Redis CPU Temperature Monitor Min Avg Max Xeon Platinum 8280 2P 25.0 26.0 26.0 Ampere Altra 2P 44.0 44.5 47.0 Ampere Altra Q80-33 46.0 46.5 48.0 EPYC 7742 2P 51.0 52.8 55.3 OpenBenchmarking.org Celsius, Fewer Is Better Redis 6.0.9 CPU Temperature Monitor 15 30 45 60 75
Rodinia Test: OpenMP LavaMD OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 3.1 Test: OpenMP LavaMD Ampere Altra Q80-33 EPYC 7742 2P Ampere Altra 2P Xeon Platinum 8280 2P 13 26 39 52 65 SE +/- 0.47, N = 15 SE +/- 0.15, N = 3 SE +/- 0.80, N = 15 SE +/- 0.10, N = 3 29.49 31.32 31.77 56.42 1. (CXX) g++ options: -O2 -lOpenCL
Rodinia CPU Power Consumption Monitor Min Avg Max Ampere Altra 2P 37.0 246.4 440.0 Ampere Altra Q80-33 38.0 249.1 436.0 Xeon Platinum 8280 2P 29.0 351.3 466.0 EPYC 7742 2P 107.2 355.0 452.8 OpenBenchmarking.org Watts, Fewer Is Better Rodinia 3.1 CPU Power Consumption Monitor 120 240 360 480 600
Rodinia CPU Temperature Monitor Min Avg Max Xeon Platinum 8280 2P 35.0 63.2 73.0 EPYC 7742 2P 54.8 65.0 73.5 Ampere Altra 2P 49.0 71.6 97.0 Ampere Altra Q80-33 50.0 73.0 96.0 OpenBenchmarking.org Celsius, Fewer Is Better Rodinia 3.1 CPU Temperature Monitor 20 40 60 80 100
Stream Type: Copy OpenBenchmarking.org MB/s, More Is Better Stream 2013-01-17 Type: Copy Ampere Altra Q80-33 60K 120K 180K 240K 300K SE +/- 7256.23, N = 20 267437.4 1. (CC) gcc options: -O3 -march=native -fopenmp
Stream Type: Copy OpenBenchmarking.org MB/s Per Watt, More Is Better Stream 2013-01-17 Type: Copy Ampere Altra Q80-33 500 1000 1500 2000 2500 2109.77
Stream CPU Power Consumption Monitor Min Avg Max Ampere Altra Q80-33 38.0 126.8 300.0 OpenBenchmarking.org Watts, Fewer Is Better Stream 2013-01-17 CPU Power Consumption Monitor 80 160 240 320 400
Stream CPU Temperature Monitor Min Avg Max Ampere Altra Q80-33 49.0 58.8 68.0 OpenBenchmarking.org Celsius, Fewer Is Better Stream 2013-01-17 CPU Temperature Monitor 20 40 60 80 100
Stream Type: Scale OpenBenchmarking.org MB/s, More Is Better Stream 2013-01-17 Type: Scale Ampere Altra Q80-33 60K 120K 180K 240K 300K SE +/- 5320.69, N = 5 282282.0 1. (CC) gcc options: -O3 -march=native -fopenmp
Stream Type: Scale OpenBenchmarking.org MB/s Per Watt, More Is Better Stream 2013-01-17 Type: Scale Ampere Altra Q80-33 1400 2800 4200 5600 7000 6615.98
Stream Type: Add OpenBenchmarking.org MB/s, More Is Better Stream 2013-01-17 Type: Add Ampere Altra Q80-33 60K 120K 180K 240K 300K SE +/- 6193.82, N = 5 300788.9 1. (CC) gcc options: -O3 -march=native -fopenmp
Stream Type: Add OpenBenchmarking.org MB/s Per Watt, More Is Better Stream 2013-01-17 Type: Add Ampere Altra Q80-33 1400 2800 4200 5600 7000 6538.89
Stream Type: Triad OpenBenchmarking.org MB/s, More Is Better Stream 2013-01-17 Type: Triad Ampere Altra Q80-33 60K 120K 180K 240K 300K SE +/- 4797.76, N = 5 303290.4 1. (CC) gcc options: -O3 -march=native -fopenmp
Stream Type: Triad OpenBenchmarking.org MB/s Per Watt, More Is Better Stream 2013-01-17 Type: Triad Ampere Altra Q80-33 1500 3000 4500 6000 7500 6999.01
Timed FFmpeg Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed FFmpeg Compilation 4.2.2 Time To Compile EPYC 7742 2P Ampere Altra Q80-33 Xeon Platinum 8280 2P Ampere Altra 2P 5 10 15 20 25 SE +/- 0.04, N = 3 SE +/- 0.41, N = 12 SE +/- 0.13, N = 3 SE +/- 0.33, N = 15 16.40 19.40 19.96 20.06
Timed FFmpeg Compilation CPU Power Consumption Monitor Min Avg Max Ampere Altra 2P 34.0 131.3 364.0 Ampere Altra Q80-33 36.0 133.9 364.0 Xeon Platinum 8280 2P 28.8 216.1 466.2 EPYC 7742 2P 118.2 217.9 457.2 OpenBenchmarking.org Watts, Fewer Is Better Timed FFmpeg Compilation 4.2.2 CPU Power Consumption Monitor 120 240 360 480 600
Timed FFmpeg Compilation CPU Temperature Monitor Min Avg Max Xeon Platinum 8280 2P 32.0 45.1 59.0 Ampere Altra 2P 46.0 55.6 77.0 Ampere Altra Q80-33 48.0 57.0 77.0 EPYC 7742 2P 57.0 61.5 69.0 OpenBenchmarking.org Celsius, Fewer Is Better Timed FFmpeg Compilation 4.2.2 CPU Temperature Monitor 20 40 60 80 100
Timed LLVM Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 10.0 Time To Compile EPYC 7742 2P Xeon Platinum 8280 2P Ampere Altra 2P Ampere Altra Q80-33 60 120 180 240 300 SE +/- 0.64, N = 3 SE +/- 1.51, N = 3 SE +/- 3.72, N = 4 SE +/- 3.93, N = 4 203.92 225.60 281.12 282.64
Timed LLVM Compilation CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Timed LLVM Compilation 10.0 CPU Power Consumption Monitor Ampere Altra 2P Ampere Altra Q80-33 EPYC 7742 2P Xeon Platinum 8280 2P 80 160 240 320 400 Min: 38 / Avg: 145.71 / Max: 341 Min: 37 / Avg: 147.93 / Max: 344 Min: 108.16 / Avg: 257.9 / Max: 457.83 Min: 29.29 / Avg: 275.86 / Max: 466.34
Timed LLVM Compilation CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Timed LLVM Compilation 10.0 CPU Temperature Monitor Ampere Altra 2P Xeon Platinum 8280 2P Ampere Altra Q80-33 EPYC 7742 2P 15 30 45 60 75 Min: 48 / Avg: 57.25 / Max: 77 Min: 38 / Avg: 57.29 / Max: 71 Min: 48 / Avg: 57.64 / Max: 77 Min: 54.25 / Avg: 61.8 / Max: 71.25
Timed PHP Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed PHP Compilation 7.4.2 Time To Compile Xeon Platinum 8280 2P EPYC 7742 2P Ampere Altra 2P Ampere Altra Q80-33 13 26 39 52 65 SE +/- 0.23, N = 3 SE +/- 0.03, N = 3 SE +/- 0.49, N = 3 SE +/- 1.70, N = 12 38.38 39.37 54.16 60.17
Timed PHP Compilation CPU Power Consumption Monitor Min Avg Max Ampere Altra 2P 37.0 102.6 312.0 Ampere Altra Q80-33 37.0 105.1 314.0 Xeon Platinum 8280 2P 28.8 142.2 466.0 EPYC 7742 2P 99.2 179.9 454.9 OpenBenchmarking.org Watts, Fewer Is Better Timed PHP Compilation 7.4.2 CPU Power Consumption Monitor 120 240 360 480 600
Timed PHP Compilation CPU Temperature Monitor Min Avg Max Xeon Platinum 8280 2P 35.0 41.7 61.0 Ampere Altra 2P 47.0 52.8 67.0 Ampere Altra Q80-33 49.0 54.6 70.0 EPYC 7742 2P 54.8 57.7 65.3 OpenBenchmarking.org Celsius, Fewer Is Better Timed PHP Compilation 7.4.2 CPU Temperature Monitor 20 40 60 80 100
TNN Target: CPU - Model: MobileNet v2 OpenBenchmarking.org ms, Fewer Is Better TNN 0.2.3 Target: CPU - Model: MobileNet v2 Ampere Altra 2P Ampere Altra Q80-33 EPYC 7742 2P Xeon Platinum 8280 2P 70 140 210 280 350 SE +/- 1.09, N = 3 SE +/- 2.91, N = 15 SE +/- 3.93, N = 3 SE +/- 0.62, N = 3 317.81 318.95 332.59 337.36 -march=armv8.2-a -mtune=neoverse-n1 - MIN: 297.54 / MAX: 422.5 MIN: 296.87 / MAX: 461.95 -march=native - MIN: 321.8 / MAX: 864.72 -march=native - MIN: 335.4 / MAX: 423.46 1. (CXX) g++ options: -O3 -fopenmp -pthread -fvisibility=hidden -rdynamic -ldl
TNN CPU Power Consumption Monitor Min Avg Max Ampere Altra 2P 38.0 79.8 170.0 Ampere Altra Q80-33 35.0 83.6 156.0 Xeon Platinum 8280 2P 28.4 110.3 139.5 EPYC 7742 2P 102.7 190.7 209.5 OpenBenchmarking.org Watts, Fewer Is Better TNN 0.2.3 CPU Power Consumption Monitor 60 120 180 240 300
TNN CPU Temperature Monitor Min Avg Max Xeon Platinum 8280 2P 28.0 31.9 34.0 Ampere Altra 2P 48.0 50.6 52.0 Ampere Altra Q80-33 50.0 53.0 55.0 EPYC 7742 2P 55.0 60.4 63.5 OpenBenchmarking.org Celsius, Fewer Is Better TNN 0.2.3 CPU Temperature Monitor 20 40 60 80 100
TNN Target: CPU - Model: SqueezeNet v1.1 OpenBenchmarking.org ms, Fewer Is Better TNN 0.2.3 Target: CPU - Model: SqueezeNet v1.1 Ampere Altra Q80-33 Ampere Altra 2P EPYC 7742 2P Xeon Platinum 8280 2P 70 140 210 280 350 SE +/- 0.59, N = 3 SE +/- 3.77, N = 15 SE +/- 0.45, N = 3 SE +/- 0.04, N = 3 253.66 290.80 300.67 326.47 MIN: 251.55 / MAX: 255.17 -march=armv8.2-a -mtune=neoverse-n1 - MIN: 249.46 / MAX: 443.15 -march=native - MIN: 298.85 / MAX: 303.55 -march=native - MIN: 326.02 / MAX: 327.08 1. (CXX) g++ options: -O3 -fopenmp -pthread -fvisibility=hidden -rdynamic -ldl
TNN CPU Power Consumption Monitor Min Avg Max Ampere Altra 2P 34.0 72.0 84.0 Ampere Altra Q80-33 36.0 72.5 88.0 Xeon Platinum 8280 2P 28.4 85.4 96.9 EPYC 7742 2P 104.0 146.4 153.8 OpenBenchmarking.org Watts, Fewer Is Better TNN 0.2.3 CPU Power Consumption Monitor 40 80 120 160 200
TNN CPU Temperature Monitor Min Avg Max Xeon Platinum 8280 2P 30.0 31.0 32.0 Ampere Altra 2P 47.0 49.5 50.0 Ampere Altra Q80-33 49.0 51.0 52.0 EPYC 7742 2P 53.5 60.6 66.5 OpenBenchmarking.org Celsius, Fewer Is Better TNN 0.2.3 CPU Temperature Monitor 20 40 60 80 100
Phoronix Test Suite v10.8.5