HPC Challenge

HPC Challenge (HPCC) is a cluster-focused benchmark consisting of the HPL Linpack TPP benchmark, DGEMM, STREAm, PTRANS, RandomAccess, FFT, and communication bandwidth and latency. This HPC Challenge test profile attempts to ship with standard yet versatile configuration/input files though they can be modified. Most of this HPCC super-computing testing has been done on Ubuntu and Red Hat Enterprise Linux installations.

Learn more about this test at the upstream project site: http://icl.cs.utk.edu/hpcc/index.html.

This benchmark test profile is maintained by Michael Larabel. This OpenBenchmarking.org test profile was created on 2 November 2013 and last updated on 19 November 2020. To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark hpcc.

200k+ Downloads + Recently Updated Test Profile

Installation StatsTest Completion StatsPublic Result UploadsOpenBenchmarking.orgEventsHPC Challenge Popularitypts/hpcc2015.122016.022016.042016.062016.082016.102016.122017.022017.042017.062017.082017.102017.122018.022018.042018.062018.082018.102018.122019.022019.042019.062019.082019.102019.122020.022020.042020.062020.082020.10400800120016002000

* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting.

Max Ping Pong Bandwidth10.3%G-Ffte16.2%EP-DGEMM10.9%Random Ring Latency9.2%EP-STREAM Triad10.7%G-Random Access9.8%G-HPL13.3%G-Ptrans10.4%Random Ring Bandwidth9.2%Test / Class Option PopularityOpenBenchmarking.org

Revision History

pts/hpcc-1.2.8   [View Source]   19 Nov 2020 18:15 EST
Fix for building on AArch64 Ubuntu.

pts/hpcc-1.2.7   [View Source]   19 Oct 2019 20:41 EDT
Add --allow-run-as-root option.

pts/hpcc-1.2.6   [View Source]   14 Jun 2019 10:51 EDT
Build fixes for latest Ubuntu, also use NUM_CPU_PHYSICAL_CORES over NUM_CPU_CORES to avoid issue running on many SMT/HT systems from being oversubscribed.

pts/hpcc-1.2.5   [View Source]   15 Jan 2019 11:26 EST
Minor fixes to HPCC build script contributed by Daniel Blueman.

pts/hpcc-1.2.4   [View Source]   28 Jul 2018 13:36 EDT
Fix for Ubuntu 18.04 building.

pts/hpcc-1.2.3   [View Source]   17 Jun 2018 14:59 EDT
Fix for build script on Ubuntu 18.04.

pts/hpcc-1.2.2   [View Source]   21 Nov 2017 09:36 EST
Fix build on Debian

pts/hpcc-1.2.1   [View Source]   29 Sep 2017 16:04 EDT
Fix HPCC build on distributions like Clear Linux

pts/hpcc-1.2.0   [View Source]   08 Aug 2017 13:31 EDT
Rebase against HPCC 1.5.0 upstream

pts/hpcc-1.1.8   [View Source]   08 Aug 2017 13:23 EDT
Fix build against Ubuntu 17.04

pts/hpcc-1.1.7   [View Source]   10 Apr 2017 10:05 EDT
Be explicit about the hpcc location for mpirun

pts/hpcc-1.1.6   [View Source]   25 Aug 2016 13:54 EDT
Update CFLAGS handling

pts/hpcc-1.1.5   [View Source]   03 Dec 2014 12:18 EST
Fix for building HPCC on Fedora

pts/hpcc-1.1.4   [View Source]   08 Dec 2013 18:59 EST
Add modified PATH and LD_PRELOAD to hpcc so the test profile can work out-of-the-box on Fedora 20.

pts/hpcc-1.1.3   [View Source]   15 Nov 2013 09:35 EST
Environment variable fix.

pts/hpcc-1.1.2   [View Source]   14 Nov 2013 19:10 EST
Still tweaking input file. Also add PreInstall and PostInstall messages.

pts/hpcc-1.1.1   [View Source]   14 Nov 2013 18:59 EST
Fix operand issue.

pts/hpcc-1.1.0   [View Source]   14 Nov 2013 18:51 EST
Readjust N and NB input file calculation for HPCC and also allow values to be overrode through N and NB environment variables.

pts/hpcc-1.0.5   [View Source]   13 Nov 2013 22:58 EST
Updates for customer.

pts/hpcc-1.0.4   [View Source]   13 Nov 2013 08:48 EST
Latest version.

pts/hpcc-1.0.3   [View Source]   07 Nov 2013 12:35 EST
More RHEL work for the Amazon EC2 cloud.

pts/hpcc-1.0.2   [View Source]   07 Nov 2013 12:26 EST
RHEL typo update.

pts/hpcc-1.0.1   [View Source]   07 Nov 2013 12:23 EST
Update HPCC with some stock locations for libraries on RHEL6.

pts/hpcc-1.0.0   [View Source]   07 Nov 2013 09:59 EST
HPC Challenge 1.0. Test profile should be in good shape. Also captures some new output test values.

pts/hpcc-0.4.0   [View Source]   07 Nov 2013 07:37 EST
Update to use MPI_NUM_THREADS and overall seems mostly in good shape now for verified test state.

pts/hpcc-0.3.2   [View Source]   06 Nov 2013 09:45 EST
Set LIB on latency, LA reporting.

pts/hpcc-0.3.1   [View Source]   06 Nov 2013 08:47 EST
Report linear algebra library name. Add in random ring bandwidth and latency result options.

pts/hpcc-0.3.0   [View Source]   05 Nov 2013 14:26 EST
Calculate NBs based off multiple of Pqs for input file to HPC challenge and other small work.

pts/hpcc-0.2.1   [View Source]   05 Nov 2013 11:09 EST
Add support for install-footnote and other minor changes.

pts/hpcc-0.2.0   [View Source]   05 Nov 2013 09:48 EST
Adjust CFLAGS, add support for new ResultPrecision parser XML tag.

pts/hpcc-0.1.7   [View Source]   04 Nov 2013 23:03 EST
With pts-core changes, reupload to OpenBenchmarking.org with ResultScale support.

pts/hpcc-0.1.6   [View Source]   04 Nov 2013 22:48 EST
HPC Challenge should now be working. Adds in use of new pts-core interfaces for result scale, plus other changes. Appears to be in good shape based upon local runs.

pts/hpcc-0.1.5   [View Source]   04 Nov 2013 18:43 EST
Allow HOSTFILE to be passed to MPI, allow overriding OMP_NUM_THREADS, and remove disabling of certain BLAS path checks. Almost ready for HPC Challenge benchmarking...

pts/hpcc-0.1.4   [View Source]   04 Nov 2013 18:24 EST
Support finding different linear algebra packages. Also support setting different MPI and LA packages via environment variables.

pts/hpcc-0.1.3   [View Source]   03 Nov 2013 21:34 EST
Simplify MPI_INCLUDE handling.

pts/hpcc-0.1.2   [View Source]   02 Nov 2013 21:50 EDT
Add dynmic detection of OpenMPI, MPICH, and MPICH2 when generating HPCC Makefile.. Still WIP in getting HPC Challenge working on PTS>

pts/hpcc-0.1.1   [View Source]   02 Nov 2013 18:16 EDT
Add initial HPL.dat generation script provided for HPCC. Not yet hooked up, etc. Still WIP.

pts/hpcc-0.1.0   [View Source]   02 Nov 2013 16:08 EDT
Initial commit of HPC Challenge (HPCC) test profile as part of contracted work. This test profile is still early work in progress and not yet complete or operational. Uploading for reference and to work from other system.

Suites Using This Test

CPU Massive

Scientific Computing

MPI Benchmarks

HPC - High Performance Computing

Linear Algebra

Performance Metrics

Analyze Test Configuration:

HPC Challenge 1.5.0

Test / Class: G-HPL

OpenBenchmarking.org metrics for this test profile configuration based on 287 public samples since 8 August 2017 with the latest data as of 30 November 2020.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

OpenBenchmarking.orgDistribution Of Public Results - Test / Class: G-HPL287 Results Range From 0 To 418 GFLOPS0204060801001201401601802002202402602803003203403603804004201224364860

Based on OpenBenchmarking.org data, the selected test / test configuration (HPC Challenge 1.5.0 - Test / Class: G-HPL) has an average run-time of 1 hour, 55 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkTest / Class: G-HPLRun-Time2004006008001000Min: 1 / Avg: 114.29 / Max: 965

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.5%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsTest / Class: G-HPLDeviation246810Min: 0 / Avg: 0.48 / Max: 4

Recent Test Results

Compare

3 Systems - 218 Benchmark Results

AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.10 - 5.8.0-29-generic - GNOME Shell 3.38.1

3 Systems - 178 Benchmark Results

AMD Ryzen 3 3100 4-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.10 - 5.8.0-29-generic - GNOME Shell 3.38.1

3 Systems - 178 Benchmark Results

AMD Ryzen 3 3100 4-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.10 - 5.8.0-29-generic - GNOME Shell 3.38.1

3 Systems - 46 Benchmark Results

AMD EPYC 7502 32-Core - ASRockRack EPYCD8 - AMD Starship

Ubuntu 20.10 - 5.8.0-29-generic - GNOME Shell 3.38.1

4 Systems - 23 Benchmark Results

AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship

Ubuntu 20.10 - 5.8.0-28-generic - GNOME Shell 3.38.1

3 Systems - 23 Benchmark Results

AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship

Ubuntu 20.10 - 5.8.0-28-generic - GNOME Shell 3.38.1

4 Systems - 22 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-23-generic - GNOME Shell 3.38.1

3 Systems - 48 Benchmark Results

AMD Ryzen 7 2700 Eight-Core - Gigabyte AB350N-Gaming WIFI-CF - AMD 17h

Ubuntu 19.10 - 5.9.0-050900rc7daily20201004-generic - GNOME Shell 3.34.1

3 Systems - 35 Benchmark Results

AMD Ryzen 7 5800X 8-Core - ASRock X570 Pro4 - AMD Starship

Ubuntu 20.10 - 5.8.0-28-generic - GNOME Shell 3.38.1

3 Systems - 9 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship

Pop 20.10 - 5.8.0-7625-generic - GNOME Shell 3.38.1

3 Systems - 15 Benchmark Results

Intel Core i7-1165G7 - Dell 0GG9PT - Intel Tiger Lake-LP

Ubuntu 20.10 - 5.9.2-050902-generic - GNOME Shell 3.38.1

3 Systems - 19 Benchmark Results

Intel Xeon Silver 4216 - TYAN S7100AG2NR - Intel Sky Lake-E DMI3 Registers

Debian 10 - 4.19.0-9-amd64 - GNOME Shell 3.30.2

Most Popular Test Results

Compare

15 Systems - 38 Benchmark Results

2 x Intel Xeon Platinum 8124M - GIGABYTE MR91-FS0-00 v01000100 - Intel Sky Lake-E DMI3 Registers

Fedora 32 - 5.6.14-300.fc32.x86_64 - GNOME Shell 3.36.2

1 System - 248 Benchmark Results

AMD Ryzen 9 3900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Device 1480

Ubuntu 18.04 - 5.2.0-999-generic - GNOME Shell 3.28.3

5 Systems - 1840 Benchmark Results

Intel Core i5-6200U - HP 8079 - Intel Xeon E3-1200 v5

Ubuntu 18.04 - 4.18.0-21-generic - GNOME Shell 3.28.4

5 Systems - 1839 Benchmark Results

Intel Core i5-6200U - HP 8079 - Intel Xeon E3-1200 v5

Ubuntu 18.04 - 4.18.0-21-generic - GNOME Shell 3.28.4

1 System - 263 Benchmark Results

AMD Ryzen 7 3700X 8-Core - MSI MEG X570 GODLIKE - AMD Device 1480

Ubuntu 18.04 - 5.2.0-999-generic - GNOME Shell 3.28.4

9 Systems - 57 Benchmark Results

Intel Core i9-7960X - MSI X299 SLI PLUS - Intel Sky Lake-E DMI3 Registers

Ubuntu 18.04 - 4.18.0-999-generic - GNOME Shell 3.28.2

6 Systems - 33 Benchmark Results

AMD Ryzen 7 2700X Eight-Core - ASUS ROG CROSSHAIR VII HERO - AMD Family 17h

Ubuntu 18.04 - 4.18.0-999-generic - GNOME Shell 3.28.2

5 Systems - 1853 Benchmark Results

Intel Core i5-6200U - HP 8079 - Intel Xeon E3-1200 v5

Ubuntu 18.04 - 4.18.0-21-generic - GNOME Shell 3.28.4

6 Systems - 104 Benchmark Results

AMD Ryzen 7 2700X Eight-Core - ASUS ROG CROSSHAIR VII HERO - AMD Family 17h

Ubuntu 18.04 - 4.18.0-999-generic - GNOME Shell 3.28.2

3 Systems - 48 Benchmark Results

AMD EPYC 7601 32-Core - TYAN B8026T70AE24HR - AMD Device 1450

Ubuntu 17.04 - 4.13.0-041300-generic - Unity 7.5.0

2 Systems - 475 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Ubuntu 19.10 - 5.3.0-18-generic - GNOME Shell 3.34.1

Find More Test Results


User Comments

Minimum Ram Required

I tried to do some CentOS ClearLinux comparison on a Dual 2637 V3 64gb ram system. Unfortunally I cannot get surpased the first test G-HPL because is tries to allocate more ram than available.
What amount of ram is required to run it or is something going wrong?

Post by worksasintended on 23 January 2019, 07.40.

Post A Comment