NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark npb.

Project Site

nas.nasa.gov

Test Created

6 December 2010

Last Updated

21 January 2021

Test Maintainer

Michael Larabel

Test Type

Processor

Average Install Time

35 Seconds

Average Run Time

2 Minutes, 17 Seconds

Test Dependencies

C/C++ Compiler Toolchain + Fortran + OpenMPI

Accolades

200k+ Downloads + 5k+ Public Benchmark Results + Recently Updated Test Profile

Supported Platforms


Public Result UploadsTest Completions*Reported Installs*OpenBenchmarking.orgEventsNAS Parallel Benchmarks Popularity Statisticspts/npb2011.012011.052011.092012.012012.052012.092013.012013.052013.092014.012014.052014.092015.012015.052015.092016.012016.052016.092017.012017.052017.092018.012018.052018.092019.012019.052019.092020.012020.052020.092021.0115K30K45K60K75K
* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Tue, 26 Jan 2021 11:28:34 GMT.
EP.C12.6%BT.C13.8%CG.C7.6%LU.C14.1%FT.C12.7%MG.C13.2%SP.B12.9%EP.D13.1%Test / Class Option PopularityOpenBenchmarking.org

Revision History

pts/npb-1.4.2   [View Source]   Thu, 21 Jan 2021 12:22:20 GMT
Build fix for GCC 10 gfortran/

pts/npb-1.4.1   [View Source]   Sat, 07 Mar 2020 12:22:08 GMT
Add --alow-run-as-root, ended up being missed until now.

pts/npb-1.4.0   [View Source]   Wed, 28 Aug 2019 11:43:04 GMT
Update against upstream NPB 3.4, add new test cases.

pts/npb-1.3.1   [View Source]   Tue, 15 Jan 2019 11:37:52 GMT
Update against upstream NPB 3.1.1

pts/npb-1.3.0   [View Source]   Fri, 09 Nov 2018 12:39:01 GMT
Use physical core count rather than logical cores to avoid MPI breaking on high core count systems with SMT.

pts/npb-1.2.4   [View Source]   Sat, 09 Sep 2017 10:30:50 GMT
ft.B not ft.C size

pts/npb-1.2.3   [View Source]   Sat, 09 Sep 2017 10:15:47 GMT
Update MPI handling, add some larger test sizes

pts/npb-1.2.2   [View Source]   Thu, 25 Aug 2016 13:51:56 GMT
Update CFLAGS handling

pts/npb-1.2.1   [View Source]   Thu, 27 Nov 2014 18:42:33 GMT
MG.B and IS.D do not build / run properly on modern systems.

pts/npb-1.2.0   [View Source]   Tue, 05 Nov 2013 22:57:21 GMT
Working on new version of NPB test that makes use of some of the HPCC test profile MPI improvements and other multi-core/cluster work for better benchmarking. Seems to have MPI rank errors right now though for NPB on this build.

pts/npb-1.1.1   [View Source]   Sun, 10 Jun 2012 19:11:43 GMT
Remove tests not in MPI NPB version.

pts/npb-1.1.0   [View Source]   Sun, 10 Jun 2012 16:56:25 GMT
Switch to the MPI version of NPB benchmarks.

pts/npb-1.0.0   [View Source]   Mon, 06 Dec 2010 15:00:08 GMT
Initial import into OpenBenchmarking.org

Suites Using This Test

Multi-Core

CPU Massive

Server CPU Tests

MPI Benchmarks

HPC - High Performance Computing


Performance Metrics

Analyze Test Configuration:

NAS Parallel Benchmarks 3.4

Test / Class: FT.C

OpenBenchmarking.org metrics for this test profile configuration based on 689 public results since 28 August 2019 with the latest data as of 26 January 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Matching Public Results
Total Mop/s (Average)
100th
21
106506 +/- 4472
97th
4
78186 +/- 1592
96th
5
74328 +/- 7384
96th
7
69346 +/- 6227
93rd
6
55489 +/- 941
91st
3
49627 +/- 303
91st
3
48190 +/- 3807
89th
28
47121 +/- 1000
88th
4
46789 +/- 59
85th
5
42414 +/- 2038
82nd
5
38436 +/- 2238
81st
4
36294 +/- 662
76th
5
32253 +/- 138
Mid-Tier
75th
< 31612
73rd
9
29248 +/- 2485
66th
3
25038 +/- 162
63rd
6
22250 +/- 578
53rd
3
18112 +/- 912
Median
50th
16903
46th
8
13176 +/- 769
45th
7
13113 +/- 212
45th
3
13069 +/- 16
43rd
3
12647 +/- 520
41st
19
12356 +/- 323
38th
6
12031 +/- 93
36th
4
11566 +/- 101
36th
7
11530 +/- 159
33rd
7
11100 +/- 16
32nd
5
10789 +/- 252
32nd
4
10785 +/- 134
32nd
6
10635 +/- 279
30th
4
10292 +/- 27
27th
4
9628 +/- 1378
Low-Tier
25th
< 9010
25th
6
9009 +/- 282
25th
3
9007 +/- 43
22nd
5
8746 +/- 951
21st
9
8459 +/- 1059
18th
4
8122 +/- 340
16th
4
7551 +/- 1097
14th
3
7387 +/- 3
14th
6
7277 +/- 270
13th
3
7086 +/- 25
12th
3
6190 +/- 207
9th
3
5490 +/- 4
8th
4
4722 +/- 28
OpenBenchmarking.orgDistribution Of Public Results - Test / Class: FT.C689 Results Range From 18 To 113175 Total Mop/s1822824546681090741133813602158661813020394226582492227186294503171433978362423850640770430344529847562498265209054354566185888261146634106567467938702027246674730769947925881522837868605088314905789284295106973709963410189810416210642610869011095411321820406080100

Based on OpenBenchmarking.org data, the selected test / test configuration (NAS Parallel Benchmarks 3.4 - Test / Class: FT.C) has an average run-time of 3 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkTest / Class: FT.CRun-Time20406080100Min: 1 / Avg: 3.04 / Max: 132

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.4%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsTest / Class: FT.CDeviation3691215Min: 0 / Avg: 0.37 / Max: 7

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

IntelAMDOpenBenchmarking.orgRelative Core Scaling To BaseNAS Parallel Benchmarks CPU Core ScalingTest / Class: FT.C481632641.793.585.377.168.95

Recent Test Results

OpenBenchmarking.org Results Compare

3 Systems - 82 Benchmark Results

AMD Ryzen 7 2700 Eight-Core - Gigabyte AB350N-Gaming WIFI-CF - AMD 17h

Ubuntu 19.10 - 5.9.0-050900rc7daily20201004-generic - GNOME Shell 3.34.1

6 Systems - 78 Benchmark Results

AMD Ryzen Threadripper 2990WX 32-Core - ASUS ROG ZENITH EXTREME - AMD 17h

Ubuntu 20.10 - 5.8.0-34-generic - GNOME Shell 3.38.1

3 Systems - 99 Benchmark Results

AMD EPYC 7601 32-Core - TYAN B8026T70AE24HR - AMD 17h

Ubuntu 20.04 - 5.4.0-58-generic - GNOME Shell 3.36.4

2 Systems - 220 Benchmark Results

AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.10 - 5.11.0-rc4-max-boost-inv-patch - GNOME Shell 3.38.1

3 Systems - 52 Benchmark Results

AMD Ryzen 7 5800X 8-Core - ASRock X570 Pro4 - AMD Starship

Ubuntu 20.10 - 5.11.0-rc1-phx - GNOME Shell 3.38.1

4 Systems - 45 Benchmark Results

AMD Ryzen 3 3300X 4-Core - MSI B350M GAMING PRO - AMD Starship

Ubuntu 20.04 - 5.9.0-rc5-14sep-patch - GNOME Shell 3.36.4

3 Systems - 58 Benchmark Results

Intel Xeon Gold 6226R - Supermicro X11SPL-F v1.02 - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.04 - 5.9.0-050900rc6daily20200921-generic - GNOME Shell 3.36.4

3 Systems - 54 Benchmark Results

AMD EPYC 7F52 16-Core - Supermicro H11DSi-NT v2.00 - AMD Starship

Ubuntu 20.04 - 5.10.3-051003-generic - GNOME Shell 3.36.1

3 Systems - 34 Benchmark Results

AMD Ryzen 7 1700 Eight-Core - MSI B350 TOMAHAWK - AMD 17h

Ubuntu 20.10 - 5.11.0-rc1-phx - GNOME Shell 3.38.1

4 Systems - 30 Benchmark Results

Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-38-generic - GNOME Shell 3.38.1

3 Systems - 31 Benchmark Results

Intel Core i7-1165G7 - Dell 0GG9PT - Intel Tiger Lake-LP

Ubuntu 20.10 - 5.11.0-rc1-phx - GNOME Shell 3.38.2

Most Popular Test Results

OpenBenchmarking.org Results Compare

4 Systems - 30 Benchmark Results

Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-38-generic - GNOME Shell 3.38.1

3 Systems - 23 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Ubuntu 20.10 - 5.11.0-rc1-phx - GNOME Shell 3.38.1

5 Systems - 68 Benchmark Results

AMD Ryzen 9 3900X 12-Core - MSI MPG X570 GAMING PLUS - AMD Starship

Debian testing - 5.7.10-xanmod1 - X Server 1.20.8

3 Systems - 24 Benchmark Results

Intel Core i3-10100 - Gigabyte B460M DS3H - Intel Device 9b63

Ubuntu 20.04 - 5.9.0-050900rc7daily20201002-generic - GNOME Shell 3.36.3

3 Systems - 143 Benchmark Results

ARMv8 Neoverse-N1 - Amazon EC2 m6g.metal v1.0 - 252GB

Ubuntu 20.04 - 5.4.0-1009-aws - GCC 9.3.0

3 Systems - 34 Benchmark Results

AMD Ryzen 7 1700 Eight-Core - MSI B350 TOMAHAWK - AMD 17h

Ubuntu 20.10 - 5.11.0-rc1-phx - GNOME Shell 3.38.1

2 Systems - 475 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Ubuntu 19.10 - 5.3.0-40-generic - GNOME Shell 3.34.1

2 Systems - 269 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship

Pop 20.04 - 5.4.0-7626-generic - GNOME Shell 3.36.1

3 Systems - 58 Benchmark Results

Intel Xeon Gold 6226R - Supermicro X11SPL-F v1.02 - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.04 - 5.9.0-050900rc6daily20200921-generic - GNOME Shell 3.36.4

4 Systems - 37 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship

Pop 20.10 - 5.8.0-7625-generic - GNOME Shell 3.38.1

Find More Test Results

OpenBenchmarking.org Community User Comments

Post A Comment