NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark npb.

Project Site

nas.nasa.gov

Test Created

6 December 2010

Last Updated

21 January 2021

Test Maintainer

Michael Larabel

Test Type

Processor

Average Install Time

35 Seconds

Average Run Time

2 Minutes, 17 Seconds

Test Dependencies

C/C++ Compiler Toolchain + Fortran + OpenMPI

Accolades

200k+ Downloads + 5k+ Public Benchmark Results + Recently Updated Test Profile

Supported Platforms


Public Result UploadsTest Completions*Reported Installs*OpenBenchmarking.orgEventsNAS Parallel Benchmarks Popularity Statisticspts/npb2011.012011.052011.092012.012012.052012.092013.012013.052013.092014.012014.052014.092015.012015.052015.092016.012016.052016.092017.012017.052017.092018.012018.052018.092019.012019.052019.092020.012020.052020.092021.0115K30K45K60K75K
* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Tue, 26 Jan 2021 11:28:34 GMT.
EP.C12.6%BT.C13.8%CG.C7.6%LU.C14.1%FT.C12.7%MG.C13.2%SP.B12.9%EP.D13.1%Test / Class Option PopularityOpenBenchmarking.org

Revision History

pts/npb-1.4.2   [View Source]   Thu, 21 Jan 2021 12:22:20 GMT
Build fix for GCC 10 gfortran/

pts/npb-1.4.1   [View Source]   Sat, 07 Mar 2020 12:22:08 GMT
Add --alow-run-as-root, ended up being missed until now.

pts/npb-1.4.0   [View Source]   Wed, 28 Aug 2019 11:43:04 GMT
Update against upstream NPB 3.4, add new test cases.

pts/npb-1.3.1   [View Source]   Tue, 15 Jan 2019 11:37:52 GMT
Update against upstream NPB 3.1.1

pts/npb-1.3.0   [View Source]   Fri, 09 Nov 2018 12:39:01 GMT
Use physical core count rather than logical cores to avoid MPI breaking on high core count systems with SMT.

pts/npb-1.2.4   [View Source]   Sat, 09 Sep 2017 10:30:50 GMT
ft.B not ft.C size

pts/npb-1.2.3   [View Source]   Sat, 09 Sep 2017 10:15:47 GMT
Update MPI handling, add some larger test sizes

pts/npb-1.2.2   [View Source]   Thu, 25 Aug 2016 13:51:56 GMT
Update CFLAGS handling

pts/npb-1.2.1   [View Source]   Thu, 27 Nov 2014 18:42:33 GMT
MG.B and IS.D do not build / run properly on modern systems.

pts/npb-1.2.0   [View Source]   Tue, 05 Nov 2013 22:57:21 GMT
Working on new version of NPB test that makes use of some of the HPCC test profile MPI improvements and other multi-core/cluster work for better benchmarking. Seems to have MPI rank errors right now though for NPB on this build.

pts/npb-1.1.1   [View Source]   Sun, 10 Jun 2012 19:11:43 GMT
Remove tests not in MPI NPB version.

pts/npb-1.1.0   [View Source]   Sun, 10 Jun 2012 16:56:25 GMT
Switch to the MPI version of NPB benchmarks.

pts/npb-1.0.0   [View Source]   Mon, 06 Dec 2010 15:00:08 GMT
Initial import into OpenBenchmarking.org

Suites Using This Test

Multi-Core

CPU Massive

Server CPU Tests

MPI Benchmarks

HPC - High Performance Computing


Performance Metrics

Analyze Test Configuration:

NAS Parallel Benchmarks 3.4

Test / Class: CG.C

OpenBenchmarking.org metrics for this test profile configuration based on 412 public results since 28 August 2019 with the latest data as of 26 January 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Matching Public Results
Total Mop/s (Average)
99th
17
47713 +/- 2382
98th
5
46378 +/- 1303
92nd
5
21417 +/- 660
92nd
3
21008 +/- 601
90th
5
17744 +/- 528
88th
5
17013 +/- 153
85th
3
15754 +/- 48
83rd
6
15550 +/- 227
80th
9
13989 +/- 1609
Mid-Tier
75th
< 11612
73rd
18
11354 +/- 341
70th
3
11053 +/- 644
66th
3
10473 +/- 291
Median
50th
7010
50th
9
6998 +/- 391
50th
3
6964 +/- 96
49th
19
6906 +/- 229
46th
3
6599 +/- 70
39th
7
5791 +/- 247
37th
5
5461 +/- 60
36th
6
5290 +/- 264
36th
4
5274 +/- 647
33rd
3
4960 +/- 106
32nd
3
4718 +/- 5
30th
4
4679 +/- 25
30th
4
4672 +/- 97
27th
3
4433 +/- 13
Low-Tier
25th
< 4223
25th
5
4012 +/- 306
22nd
6
3674 +/- 28
20th
6
3293 +/- 16
18th
3
2929 +/- 7
17th
3
2880 +/- 26
15th
3
2598 +/- 25
11th
3
1828 +/- 229
OpenBenchmarking.orgDistribution Of Public Results - Test / Class: CG.C412 Results Range From 18 To 50233 Total Mop/s181023202830334038504360487053805890631006811073120781308314088150931609817103181081911320118211232212823133241382514326148271532815829163301683117332178331833418835193361983720338208392134021841223422284323344238452434624847253482584926350268918273645

Based on OpenBenchmarking.org data, the selected test / test configuration (NAS Parallel Benchmarks 3.4 - Test / Class: CG.C) has an average run-time of 4 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkTest / Class: CG.CRun-Time306090120150Min: 1 / Avg: 3.59 / Max: 142

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.5%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsTest / Class: CG.CDeviation246810Min: 0 / Avg: 0.49 / Max: 5

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

IntelAMDOpenBenchmarking.orgRelative Core Scaling To BaseNAS Parallel Benchmarks CPU Core ScalingTest / Class: CG.C481632641.713.425.136.848.55

Recent Test Results

OpenBenchmarking.org Results Compare

3 Systems - 82 Benchmark Results

AMD Ryzen 7 2700 Eight-Core - Gigabyte AB350N-Gaming WIFI-CF - AMD 17h

Ubuntu 19.10 - 5.9.0-050900rc7daily20201004-generic - GNOME Shell 3.34.1

6 Systems - 78 Benchmark Results

AMD Ryzen Threadripper 2990WX 32-Core - ASUS ROG ZENITH EXTREME - AMD 17h

Ubuntu 20.10 - 5.8.0-34-generic - GNOME Shell 3.38.1

3 Systems - 99 Benchmark Results

AMD EPYC 7601 32-Core - TYAN B8026T70AE24HR - AMD 17h

Ubuntu 20.04 - 5.4.0-58-generic - GNOME Shell 3.36.4

2 Systems - 220 Benchmark Results

AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.10 - 5.11.0-rc4-max-boost-inv-patch - GNOME Shell 3.38.1

3 Systems - 52 Benchmark Results

AMD Ryzen 7 5800X 8-Core - ASRock X570 Pro4 - AMD Starship

Ubuntu 20.10 - 5.11.0-rc1-phx - GNOME Shell 3.38.1

4 Systems - 45 Benchmark Results

AMD Ryzen 3 3300X 4-Core - MSI B350M GAMING PRO - AMD Starship

Ubuntu 20.04 - 5.9.0-rc5-14sep-patch - GNOME Shell 3.36.4

3 Systems - 58 Benchmark Results

Intel Xeon Gold 6226R - Supermicro X11SPL-F v1.02 - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.04 - 5.9.0-050900rc6daily20200921-generic - GNOME Shell 3.36.4

3 Systems - 54 Benchmark Results

AMD EPYC 7F52 16-Core - Supermicro H11DSi-NT v2.00 - AMD Starship

Ubuntu 20.04 - 5.10.3-051003-generic - GNOME Shell 3.36.1

3 Systems - 34 Benchmark Results

AMD Ryzen 7 1700 Eight-Core - MSI B350 TOMAHAWK - AMD 17h

Ubuntu 20.10 - 5.11.0-rc1-phx - GNOME Shell 3.38.1

4 Systems - 30 Benchmark Results

Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-38-generic - GNOME Shell 3.38.1

3 Systems - 31 Benchmark Results

Intel Core i7-1165G7 - Dell 0GG9PT - Intel Tiger Lake-LP

Ubuntu 20.10 - 5.11.0-rc1-phx - GNOME Shell 3.38.2

Most Popular Test Results

OpenBenchmarking.org Results Compare

4 Systems - 30 Benchmark Results

Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-38-generic - GNOME Shell 3.38.1

3 Systems - 23 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Ubuntu 20.10 - 5.11.0-rc1-phx - GNOME Shell 3.38.1

3 Systems - 24 Benchmark Results

Intel Core i3-10100 - Gigabyte B460M DS3H - Intel Device 9b63

Ubuntu 20.04 - 5.9.0-050900rc7daily20201002-generic - GNOME Shell 3.36.3

3 Systems - 34 Benchmark Results

AMD Ryzen 7 1700 Eight-Core - MSI B350 TOMAHAWK - AMD 17h

Ubuntu 20.10 - 5.11.0-rc1-phx - GNOME Shell 3.38.1

2 Systems - 475 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Ubuntu 19.10 - 5.3.0-40-generic - GNOME Shell 3.34.1

2 Systems - 269 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship

Ubuntu 20.04 - 5.4.0-29-generic - GNOME Shell 3.36.1

3 Systems - 58 Benchmark Results

Intel Xeon Gold 6226R - Supermicro X11SPL-F v1.02 - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.04 - 5.9.0-050900rc6daily20200921-generic - GNOME Shell 3.36.4

4 Systems - 37 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship

Pop 20.10 - 5.8.0-7625-generic - GNOME Shell 3.38.1

2 Systems - 150 Benchmark Results

Intel Core i7-1065G7 - Dell 06CDVY - Intel Device 34ef

Ubuntu 20.04 - 5.7.0-999-generic - GNOME Shell 3.36.1

3 Systems - 173 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Ubuntu 20.04 - 5.4.0-37-generic - GNOME Shell 3.36.2

5 Systems - 40 Benchmark Results

AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.10 - 5.11.0-rc4-max-boost-inv-patch - GNOME Shell 3.38.1

4 Systems - 39 Benchmark Results

AMD EPYC 7702 64-Core - ASRockRack EPYCD8 - AMD Starship

Ubuntu 20.10 - 5.11.0-rc4-max-boost-inv-patch - GNOME Shell 3.38.1

Find More Test Results

OpenBenchmarking.org Community User Comments

Post A Comment