NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark npb.

Project Site

nas.nasa.gov

Test Created

6 December 2010

Last Updated

21 January 2021

Test Maintainer

Michael Larabel

Test Type

Processor

Average Install Time

35 Seconds

Average Run Time

2 Minutes, 17 Seconds

Test Dependencies

C/C++ Compiler Toolchain + Fortran + OpenMPI

Accolades

200k+ Downloads + 5k+ Public Benchmark Results + Recently Updated Test Profile

Supported Platforms


Public Result UploadsTest Completions*Reported Installs*OpenBenchmarking.orgEventsNAS Parallel Benchmarks Popularity Statisticspts/npb2011.012011.052011.092012.012012.052012.092013.012013.052013.092014.012014.052014.092015.012015.052015.092016.012016.052016.092017.012017.052017.092018.012018.052018.092019.012019.052019.092020.012020.052020.092021.0115K30K45K60K75K
* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Tue, 26 Jan 2021 11:28:34 GMT.
EP.C12.6%BT.C13.8%CG.C7.6%LU.C14.1%FT.C12.7%MG.C13.2%SP.B12.9%EP.D13.1%Test / Class Option PopularityOpenBenchmarking.org

Revision History

pts/npb-1.4.2   [View Source]   Thu, 21 Jan 2021 12:22:20 GMT
Build fix for GCC 10 gfortran/

pts/npb-1.4.1   [View Source]   Sat, 07 Mar 2020 12:22:08 GMT
Add --alow-run-as-root, ended up being missed until now.

pts/npb-1.4.0   [View Source]   Wed, 28 Aug 2019 11:43:04 GMT
Update against upstream NPB 3.4, add new test cases.

pts/npb-1.3.1   [View Source]   Tue, 15 Jan 2019 11:37:52 GMT
Update against upstream NPB 3.1.1

pts/npb-1.3.0   [View Source]   Fri, 09 Nov 2018 12:39:01 GMT
Use physical core count rather than logical cores to avoid MPI breaking on high core count systems with SMT.

pts/npb-1.2.4   [View Source]   Sat, 09 Sep 2017 10:30:50 GMT
ft.B not ft.C size

pts/npb-1.2.3   [View Source]   Sat, 09 Sep 2017 10:15:47 GMT
Update MPI handling, add some larger test sizes

pts/npb-1.2.2   [View Source]   Thu, 25 Aug 2016 13:51:56 GMT
Update CFLAGS handling

pts/npb-1.2.1   [View Source]   Thu, 27 Nov 2014 18:42:33 GMT
MG.B and IS.D do not build / run properly on modern systems.

pts/npb-1.2.0   [View Source]   Tue, 05 Nov 2013 22:57:21 GMT
Working on new version of NPB test that makes use of some of the HPCC test profile MPI improvements and other multi-core/cluster work for better benchmarking. Seems to have MPI rank errors right now though for NPB on this build.

pts/npb-1.1.1   [View Source]   Sun, 10 Jun 2012 19:11:43 GMT
Remove tests not in MPI NPB version.

pts/npb-1.1.0   [View Source]   Sun, 10 Jun 2012 16:56:25 GMT
Switch to the MPI version of NPB benchmarks.

pts/npb-1.0.0   [View Source]   Mon, 06 Dec 2010 15:00:08 GMT
Initial import into OpenBenchmarking.org

Suites Using This Test

Multi-Core

CPU Massive

Server CPU Tests

MPI Benchmarks

HPC - High Performance Computing


Performance Metrics

Analyze Test Configuration:

NAS Parallel Benchmarks 3.4

Test / Class: MG.C

OpenBenchmarking.org metrics for this test profile configuration based on 714 public results since 28 August 2019 with the latest data as of 26 January 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Matching Public Results
Total Mop/s (Average)
100th
5
102263 +/- 1970
100th
4
101096 +/- 1150
98th
22
99055 +/- 1464
96th
7
91379 +/- 4766
94th
3
84777 +/- 2325
92nd
16
69392 +/- 828
89th
5
59521 +/- 721
89th
3
59075 +/- 681
86th
6
51962 +/- 974
85th
5
50391 +/- 4831
83rd
3
47626 +/- 119
82nd
4
46519 +/- 322
80th
3
43949 +/- 360
80th
3
43292 +/- 1348
79th
5
42298 +/- 1859
78th
4
37121 +/- 111
Mid-Tier
75th
< 33194
75th
3
32380 +/- 717
72nd
3
31268 +/- 123
68th
11
29729 +/- 2205
56th
12
19747 +/- 291
53rd
16
18707 +/- 277
51st
6
18252 +/- 45
Median
50th
18196
45th
27
16304 +/- 2169
45th
3
16258 +/- 62
43rd
33
14115 +/- 959
42nd
3
14016 +/- 10
37th
6
12700 +/- 1394
35th
3
11631 +/- 46
34th
7
11219 +/- 37
32nd
7
10900 +/- 194
32nd
9
10877 +/- 653
31st
5
10816 +/- 355
31st
6
10811 +/- 130
29th
4
10562 +/- 406
Low-Tier
25th
< 10097
25th
19
10067 +/- 240
22nd
4
9530 +/- 9
22nd
5
9512 +/- 1334
22nd
6
9453 +/- 255
22nd
4
9432 +/- 36
20th
3
9245 +/- 1162
18th
3
8350 +/- 19
17th
9
8308 +/- 1113
17th
6
8250 +/- 22
16th
4
7877 +/- 35
15th
3
7806 +/- 56
13th
6
7321 +/- 8
9th
3
5668 +/- 43
8th
3
4786 +/- 25
7th
3
4131 +/- 2
OpenBenchmarking.orgDistribution Of Public Results - Test / Class: MG.C711 Results Range From 57 To 106341 Total Mop/s572183430964358561106871281314939170651919121317234432556927695298213194734073361993832540451425774470346829489555108153207553335745959585617116383765963680897021572341744677659378719808458297185097872238934991475936019572797853999791021051042311063571632486480

Based on OpenBenchmarking.org data, the selected test / test configuration (NAS Parallel Benchmarks 3.4 - Test / Class: MG.C) has an average run-time of 2 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkTest / Class: MG.CRun-Time48121620Min: 1 / Avg: 1.28 / Max: 17

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.2%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsTest / Class: MG.CDeviation246810Min: 0 / Avg: 0.23 / Max: 3

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

IntelAMDOpenBenchmarking.orgRelative Core Scaling To BaseNAS Parallel Benchmarks CPU Core ScalingTest / Class: MG.C48161832641.693.385.076.768.45

Recent Test Results

OpenBenchmarking.org Results Compare

3 Systems - 82 Benchmark Results

AMD Ryzen 7 2700 Eight-Core - Gigabyte AB350N-Gaming WIFI-CF - AMD 17h

Ubuntu 19.10 - 5.9.0-050900rc7daily20201004-generic - GNOME Shell 3.34.1

6 Systems - 78 Benchmark Results

AMD Ryzen Threadripper 2990WX 32-Core - ASUS ROG ZENITH EXTREME - AMD 17h

Ubuntu 20.10 - 5.8.0-34-generic - GNOME Shell 3.38.1

3 Systems - 99 Benchmark Results

AMD EPYC 7601 32-Core - TYAN B8026T70AE24HR - AMD 17h

Ubuntu 20.04 - 5.4.0-58-generic - GNOME Shell 3.36.4

2 Systems - 220 Benchmark Results

AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.10 - 5.11.0-rc4-max-boost-inv-patch - GNOME Shell 3.38.1

3 Systems - 52 Benchmark Results

AMD Ryzen 7 5800X 8-Core - ASRock X570 Pro4 - AMD Starship

Ubuntu 20.10 - 5.11.0-rc1-phx - GNOME Shell 3.38.1

4 Systems - 45 Benchmark Results

AMD Ryzen 3 3300X 4-Core - MSI B350M GAMING PRO - AMD Starship

Ubuntu 20.04 - 5.9.0-rc5-14sep-patch - GNOME Shell 3.36.4

3 Systems - 58 Benchmark Results

Intel Xeon Gold 6226R - Supermicro X11SPL-F v1.02 - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.04 - 5.9.0-050900rc6daily20200921-generic - GNOME Shell 3.36.4

3 Systems - 54 Benchmark Results

AMD EPYC 7F52 16-Core - Supermicro H11DSi-NT v2.00 - AMD Starship

Ubuntu 20.04 - 5.10.3-051003-generic - GNOME Shell 3.36.1

3 Systems - 34 Benchmark Results

AMD Ryzen 7 1700 Eight-Core - MSI B350 TOMAHAWK - AMD 17h

Ubuntu 20.10 - 5.11.0-rc1-phx - GNOME Shell 3.38.1

4 Systems - 30 Benchmark Results

Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-38-generic - GNOME Shell 3.38.1

3 Systems - 31 Benchmark Results

Intel Core i7-1165G7 - Dell 0GG9PT - Intel Tiger Lake-LP

Ubuntu 20.10 - 5.11.0-rc1-phx - GNOME Shell 3.38.2

Most Popular Test Results

OpenBenchmarking.org Results Compare

16 Systems - 119 Benchmark Results

AMD EPYC 7R32 48-Core - Supermicro H11SSL-i v2.00 - AMD Starship

Ubuntu 19.10 - 5.3.0-64-generic - GNOME Shell 3.34.1

4 Systems - 30 Benchmark Results

Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-38-generic - GNOME Shell 3.38.1

3 Systems - 23 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Ubuntu 20.10 - 5.11.0-rc1-phx - GNOME Shell 3.38.1

18 Systems - 115 Benchmark Results

AMD Ryzen Threadripper 2920X 12-Core - Gigabyte X399 AORUS Gaming 7 - AMD 17h

Ubuntu 19.10 - 5.3.0-19-generic - GNOME Shell 3.34.1

5 Systems - 68 Benchmark Results

AMD Ryzen 9 3900X 12-Core - MSI MPG X570 GAMING PLUS - AMD Starship

Debian stable-updates - 5.7.10-xanmod1 - X Server 1.20.8

3 Systems - 24 Benchmark Results

Intel Core i3-10100 - Gigabyte B460M DS3H - Intel Device 9b63

Ubuntu 20.04 - 5.9.0-050900rc7daily20201002-generic - GNOME Shell 3.36.3

3 Systems - 143 Benchmark Results

ARMv8 Neoverse-N1 - Amazon EC2 m6g.metal v1.0 - 252GB

Ubuntu 20.04 - 5.4.0-1009-aws - GCC 9.3.0

3 Systems - 34 Benchmark Results

AMD Ryzen 7 1700 Eight-Core - MSI B350 TOMAHAWK - AMD 17h

Ubuntu 20.10 - 5.11.0-rc1-phx - GNOME Shell 3.38.1

2 Systems - 475 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Ubuntu 19.10 - 5.3.0-18-generic - GNOME Shell 3.34.1

2 Systems - 269 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship

Ubuntu 20.04 - 5.4.0-29-generic - GNOME Shell 3.36.1

Find More Test Results

OpenBenchmarking.org Community User Comments

Post A Comment