HPC Challenge

HPC Challenge (HPCC) is a cluster-focused benchmark consisting of the HPL Linpack TPP benchmark, DGEMM, STREAM, PTRANS, RandomAccess, FFT, and communication bandwidth and latency. This HPC Challenge test profile attempts to ship with standard yet versatile configuration/input files though they can be modified.

Supported install-time optional variables include $MPI_PATH, $MPI_INCLUDE, $MPI_CC, $MPI_LIBS, $LA_PATH, $LA_INCLUDE, $LA_LIBS, $CFLAGS, $LD_FLAGS, and $MPI_LD

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark hpcc.

Project Site

icl.cs.utk.edu

Test Created

2 November 2013

Last Updated

19 November 2020

Test Maintainer

Michael Larabel

Test Type

Processor

Test Dependencies

C/C++ Compiler Toolchain + Fortran + OpenMPI + BLAS (Basic Linear Algebra Sub-Routine) + Linear Algebra Pack + LAPACK (Linear Algebra Pack)

Accolades

300k+ Downloads

Supported Platforms

* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data current as of 25 November 2022.

Revision History

pts/hpcc-1.2.8 [View Source] Thu, 19 Nov 2020 18:15:58 GMT
Fix for building on AArch64 Ubuntu.

pts/hpcc-1.2.7 [View Source] Sat, 19 Oct 2019 20:41:59 GMT
Add --allow-run-as-root option.

pts/hpcc-1.2.6 [View Source] Fri, 14 Jun 2019 10:51:22 GMT
Build fixes for latest Ubuntu, also use NUM_CPU_PHYSICAL_CORES over NUM_CPU_CORES to avoid issue running on many SMT/HT systems from being oversubscribed.

pts/hpcc-1.2.5 [View Source] Tue, 15 Jan 2019 11:26:27 GMT
Minor fixes to HPCC build script contributed by Daniel Blueman.

pts/hpcc-1.2.4 [View Source] Sat, 28 Jul 2018 13:36:05 GMT
Fix for Ubuntu 18.04 building.

pts/hpcc-1.2.3 [View Source] Sun, 17 Jun 2018 14:59:58 GMT
Fix for build script on Ubuntu 18.04.

pts/hpcc-1.2.2 [View Source] Tue, 21 Nov 2017 09:36:15 GMT
Fix build on Debian

pts/hpcc-1.2.1 [View Source] Fri, 29 Sep 2017 16:04:42 GMT
Fix HPCC build on distributions like Clear Linux

pts/hpcc-1.2.0 [View Source] Tue, 08 Aug 2017 13:31:12 GMT
Rebase against HPCC 1.5.0 upstream

pts/hpcc-1.1.8 [View Source] Tue, 08 Aug 2017 13:23:14 GMT
Fix build against Ubuntu 17.04

pts/hpcc-1.1.7 [View Source] Mon, 10 Apr 2017 10:05:06 GMT
Be explicit about the hpcc location for mpirun

pts/hpcc-1.1.6 [View Source] Thu, 25 Aug 2016 13:54:15 GMT
Update CFLAGS handling

pts/hpcc-1.1.5 [View Source] Wed, 03 Dec 2014 12:18:19 GMT
Fix for building HPCC on Fedora

pts/hpcc-1.1.4 [View Source] Sun, 08 Dec 2013 18:59:40 GMT
Add modified PATH and LD_PRELOAD to hpcc so the test profile can work out-of-the-box on Fedora 20.

pts/hpcc-1.1.3 [View Source] Fri, 15 Nov 2013 09:35:33 GMT
Environment variable fix.

pts/hpcc-1.1.2 [View Source] Thu, 14 Nov 2013 19:10:19 GMT
Still tweaking input file. Also add PreInstall and PostInstall messages.

pts/hpcc-1.1.1 [View Source] Thu, 14 Nov 2013 18:59:07 GMT
Fix operand issue.

pts/hpcc-1.1.0 [View Source] Thu, 14 Nov 2013 18:51:31 GMT
Readjust N and NB input file calculation for HPCC and also allow values to be overrode through N and NB environment variables.

pts/hpcc-1.0.5 [View Source] Wed, 13 Nov 2013 22:58:38 GMT
Updates for customer.

pts/hpcc-1.0.4 [View Source] Wed, 13 Nov 2013 08:48:14 GMT
Latest version.

pts/hpcc-1.0.3 [View Source] Thu, 07 Nov 2013 12:35:40 GMT
More RHEL work for the Amazon EC2 cloud.

pts/hpcc-1.0.2 [View Source] Thu, 07 Nov 2013 12:26:04 GMT
RHEL typo update.

pts/hpcc-1.0.1 [View Source] Thu, 07 Nov 2013 12:23:03 GMT
Update HPCC with some stock locations for libraries on RHEL6.

pts/hpcc-1.0.0 [View Source] Thu, 07 Nov 2013 09:59:19 GMT
HPC Challenge 1.0. Test profile should be in good shape. Also captures some new output test values.

pts/hpcc-0.4.0 [View Source] Thu, 07 Nov 2013 07:37:37 GMT
Update to use MPI_NUM_THREADS and overall seems mostly in good shape now for verified test state.

pts/hpcc-0.3.2 [View Source] Wed, 06 Nov 2013 09:45:45 GMT
Set LIB on latency, LA reporting.

pts/hpcc-0.3.1 [View Source] Wed, 06 Nov 2013 08:47:41 GMT
Report linear algebra library name. Add in random ring bandwidth and latency result options.

pts/hpcc-0.3.0 [View Source] Tue, 05 Nov 2013 14:26:03 GMT
Calculate NBs based off multiple of Pqs for input file to HPC challenge and other small work.

pts/hpcc-0.2.1 [View Source] Tue, 05 Nov 2013 11:09:06 GMT
Add support for install-footnote and other minor changes.

pts/hpcc-0.2.0 [View Source] Tue, 05 Nov 2013 09:48:57 GMT
Adjust CFLAGS, add support for new ResultPrecision parser XML tag.

pts/hpcc-0.1.7 [View Source] Mon, 04 Nov 2013 23:03:23 GMT
With pts-core changes, reupload to OpenBenchmarking.org with ResultScale support.

pts/hpcc-0.1.6 [View Source] Mon, 04 Nov 2013 22:48:24 GMT
HPC Challenge should now be working. Adds in use of new pts-core interfaces for result scale, plus other changes. Appears to be in good shape based upon local runs.

pts/hpcc-0.1.5 [View Source] Mon, 04 Nov 2013 18:43:42 GMT
Allow HOSTFILE to be passed to MPI, allow overriding OMP_NUM_THREADS, and remove disabling of certain BLAS path checks. Almost ready for HPC Challenge benchmarking...

pts/hpcc-0.1.4 [View Source] Mon, 04 Nov 2013 18:24:25 GMT
Support finding different linear algebra packages. Also support setting different MPI and LA packages via environment variables.

pts/hpcc-0.1.3 [View Source] Sun, 03 Nov 2013 21:34:06 GMT
Simplify MPI_INCLUDE handling.

pts/hpcc-0.1.2 [View Source] Sat, 02 Nov 2013 21:50:02 GMT
Add dynmic detection of OpenMPI, MPICH, and MPICH2 when generating HPCC Makefile.. Still WIP in getting HPC Challenge working on PTS>

pts/hpcc-0.1.1 [View Source] Sat, 02 Nov 2013 18:16:00 GMT
Add initial HPL.dat generation script provided for HPCC. Not yet hooked up, etc. Still WIP.

pts/hpcc-0.1.0 [View Source] Sat, 02 Nov 2013 16:08:47 GMT
Initial commit of HPC Challenge (HPCC) test profile as part of contracted work. This test profile is still early work in progress and not yet complete or operational. Uploading for reference and to work from other system.

Suites Using This Test

CPU Massive

HPC - High Performance Computing

Scientific Computing

MPI Benchmarks

Linear Algebra

Programmer / Developer System Benchmarks

Performance Metrics

Analyze Test Configuration:

HPC Challenge 1.5.0

Test / Class: G-HPL

OpenBenchmarking.org metrics for this test profile configuration based on 445 public results since 8 August 2017 with the latest data as of 25 October 2022.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component

Percentile Rank

# Compatible Public Results

GFLOPS (Average)

AMD Ryzen Threadripper 3990X 64-Core

88th

149

2 x Intel Xeon Platinum 8280

86th

147

Intel Xeon E-2288G

80th

129 ^{+/- 6}

AMD EPYC 7502 32-Core

79th

128 ^{+/- 1}

Mid-Tier

75th

< 112

AMD Ryzen 7 3800XT 8-Core

73rd

107 ^{+/- 2}

2 x AMD EPYC 7F72 24-Core

71st

100 ^{+/- 1}

AMD EPYC 7313 16-Core

69th

Intel Core i7-4790K

65th

89 ^{+/- 4}

AMD EPYC 7F72 24-Core

64th

Intel Core i3-7100

62nd

86 ^{+/- 1}

Intel Core i7-5775C

56th

81 ^{+/- 2}

AMD Ryzen Threadripper 3970X 32-Core

54th

80 ^{+/- 5}

Intel Core i3-8100

52nd

AMD Ryzen 7 2700 Eight-Core

51st

76 ^{+/- 10}

Intel Core i9-11980HK

51st

75 ^{+/- 6}

Median

50th

Intel Core i7-11700K

46th

70 ^{+/- 5}

AMD Ryzen 7 1800X Eight-Core

44th

66 ^{+/- 1}

AMD Ryzen Threadripper 3960X 24-Core

42nd

63 ^{+/- 1}

AMD Ryzen 9 3900XT 12-Core

39th

60 ^{+/- 1}

Intel Xeon E3-1260L v5

39th

60 ^{+/- 2}

Intel Core i7-1065G7

36th

2 x Intel Xeon Platinum 8124M

31st

Intel Core i5-6500

29th

AMD Ryzen 5 4500U

29th

Intel Xeon Silver 4216

28th

Low-Tier

25th

< 45

Intel Core i7-10700T

24th

Intel Core i7-1165G7

17th

Intel Core i7-7820X

5th

Based on OpenBenchmarking.org data, the selected test / test configuration (HPC Challenge 1.5.0 - Test / Class: G-HPL) has an average run-time of 2 hours, 38 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.5%.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture

Kernel Identifier

Verified On

Intel / AMD x86 64-bit

x86_64

(Many Processors)

ARMv8 64-bit

aarch64

ARMv8 rev 3 6-Core

progo 1 System - 75 Benchmark Results	AMD Ryzen 9 5950X 16-Core - Gigabyte X570 AORUS ULTRA - AMD Starship Arch rolling - 6.0.9-AMD - KDE Plasma 5.26.3
linear0 1 System - 4 Benchmark Results	AMD Ryzen 9 5950X 16-Core - Gigabyte X570 AORUS ULTRA - AMD Starship Arch rolling - 6.0.9-AMD - KDE Plasma 5.26.3
realsysprogrammerbench 1 System - 60 Benchmark Results	AMD Ryzen 7 5800X 8-Core - ASRock X470 Taichi - AMD Starship ManjaroLinux 22.0.0 - 6.0.8-1-MANJARO - Xfce 4.16
hpl-5600x 2 Systems - 2 Benchmark Results	AMD Ryzen 5 5600X 6-Core - Gigabyte B550 AORUS ELITE - AMD Starship Ubuntu 22.04 - 5.15.0-53-generic - GNOME Shell 42.5
Benchmark.md 1 System - 75 Benchmark Results	Intel Core i7-12700KF - MSI PRO Z690-A DDR4 - Intel Alder Lake-S PCH EndeavourOS rolling - 6.0.8-arch1-1 - Sway 1.7
2022-10-25-0836 1 System - 9 Benchmark Results	Intel Core 2 Duo T7700 - Bochs - Intel 440FX 82441FX PMC Ubuntu 18.04 - 4.15.0-20-generic - GCC 7.5.0
original 1 System - 5 Benchmark Results	Intel Core i9-11900H - Microsoft Virtual Machine - 16GB Ubuntu 22.04 - 5.15.0-50-generic - GNOME Shell 42.4
baseline2 1 System - 75 Benchmark Results	AMD Ryzen 9 7950X 16-Core - Gigabyte B650 AORUS ELITE AX - AMD Device 14d8 Linuxmint 21 - 5.15.0-50-generic - Cinnamon 5.4.12
batchbenchmark3pc 1 System - 91 Benchmark Results	Intel Core i7-5820K - ASUS X99-A/USB 3.1 - Intel Xeon E7 v3 Fedora Linux 36 - 5.19.4-200.fc36.x86_64 - X Server 1.20.14
batchbenchmark3t14 1 System - 86 Benchmark Results	AMD Ryzen 7 PRO 4750U - LENOVO 20UES00L00 - AMD Renoir Fedora 36 - 5.19.6-200.fc36.x86_64 - GNOME Shell 42.4
multi-1 1 System - 3 Benchmark Results	Intel Core i9-11900H - ASUS FX506HM v1.0 - Intel Tiger Lake-H Clear Linux OS 36750 - 5.18.16-1165.native - GNOME Shell 42.3.1
multi-1 1 System - 3 Benchmark Results	Intel Core i9-11900H - ASUS FX506HM v1.0 - Intel Tiger Lake-H Clear Linux OS 36750 - 5.18.16-1165.native - GNOME Shell 42.3.1
phoronix2 1 System - 73 Benchmark Results	AMD Ryzen 5 3600 6-Core - Microsoft Virtual Machine - 655MB Ubuntu 22.04 - 5.15.0-41-generic - 1.2.204
first_test 1 System - 72 Benchmark Results	AMD Ryzen 5 3600 6-Core - Microsoft Virtual Machine - 696MB Ubuntu 22.04 - 5.15.0-41-generic - 1.2.204
programmer-10900F-3060ti-kernel-5_18_1 1 System - 73 Benchmark Results	Intel Core i9-10900F - Dell 0M6C7G - Intel Comet Lake PCH EndeavourOS rolling - 5.18.1-arch1-1 - GNOME Shell 42.2

Debian Linux GCC 8 Benchmark -mindirect-branch=thunk 3 Systems - 18 Benchmark Results	Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Device 2020 Debian 9.3 - 4.15.0-rc8-retpo-underflow - GNOME Shell 3.22.3
AMD EPYC Benchmarks With Intel Xeon Whitepaper Recommended Benchmarks 15 Systems - 38 Benchmark Results	2 x Intel Xeon Gold 6258R - Supermicro X11DAi-N v1.10 - Intel Sky Lake-E DMI3 Registers Fedora 32 - 5.6.14-300.fc32.x86_64 - GNOME Shell 3.36.2
AMD Threadripper 3960X vs. Intel Core i9 10980XE Featured Processor Comparison	AMD Ryzen Threadripper 3960X 24-Core - MSI Creator TRX40 - AMD Starship Ubuntu 19.10 - 5.3.0-23-generic - GNOME Shell 3.34.1
tx26coresprocessor 1 System - 84 Benchmark Results	ARMv8 rev 3 - 8192MB - 31GB 032G34 Ubuntu 16.04 - 4.4.38-tegra - Unity 7.4.0
Ubuntu Linux 4.18 Intel / AMD High-End Desktop Benchmarks 6 Systems - 104 Benchmark Results	Intel Core i7-5960X - ASRock X99 Extreme3 - Intel Xeon E7 v3 Ubuntu 18.04 - 4.18.0-999-generic - GNOME Shell 3.28.2
Xeon E 8 Systems - 84 Benchmark Results	Intel Xeon E-2288G - Compulab SBC-ATCFL v1.2 - Intel Cannon Lake PCH Ubuntu 20.10 - 5.8.0-26-generic - GNOME Shell 3.38.1
Threadripper 1950X HPCC HPCG Stream 1 System - 12 Benchmark Results	AMD Ryzen Threadripper 1950X 16-Core - Gigabyte X399 AORUS Gaming 7 - AMD Device 1450 Ubuntu 17.04 - 4.10.0-32-generic - Unity 7.5.0
Ryzen 9 5900X LInux 5.11 Featured Kernel Comparison	AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.10 - 5.10.0-051000daily20201222-generic - GNOME Shell 3.38.1
AMD EPYC 7642 Linux 5.0 To 5.4 Kernel Benchmarks Featured Kernel Comparison	AMD EPYC 7642 48-Core - ASRockRack EPYCD8 - AMD Starship Ubuntu 19.10 - 5.1.0-050100-generic - GNOME Shell 3.34.1
Ryzen 9 3900X Znver2 Compiler Tuning Featured Compiler Comparison	AMD Ryzen 9 3900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Device 1480 Ubuntu 18.04 - 5.3.0-999-generic - GNOME Shell 3.28.4
AMD EPYC vs. Threadripper 3 Systems - 48 Benchmark Results	AMD EPYC 7601 32-Core - TYAN B8026T70AE24HR - AMD Device 1450 Ubuntu 17.04 - 4.13.0-041300-generic - modesetting 1.19.3
Big Threadripper 2 Systems - 475 Benchmark Results	AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship Ubuntu 19.10 - 5.3.0-18-generic - GNOME Shell 3.34.1
intel-core-i5-6200u-280ghz 5 Systems - 1840 Benchmark Results	Intel Core i5-6200U - HP 8079 - Intel Xeon E3-1200 v5 Ubuntu 18.04 - 4.18.0-21-generic - GNOME Shell 3.28.4
intel-core-i5-6200u-280ghz 5 Systems - 1839 Benchmark Results	Intel Core i5-6200U - HP 8079 - Intel Xeon E3-1200 v5 Ubuntu 18.04 - 4.18.0-21-generic - GNOME Shell 3.28.4
intel-core-i5-6200u-280ghz 5 Systems - 2540 Benchmark Results	Intel Core i5-6200U - HP 8079 - Intel Xeon E3-1200 v5 Ubuntu 18.04 - 4.18.0-21-generic - GNOME Shell 3.28.4