NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark npb.

Project Site

nas.nasa.gov

Test Created

6 December 2010

Last Updated

21 January 2021

Test Maintainer

Michael Larabel 

Test Type

Processor

Average Install Time

36 Seconds

Average Run Time

2 Minutes, 15 Seconds

Test Dependencies

C/C++ Compiler Toolchain + Fortran + OpenMPI

Accolades

200k+ Downloads + 5k+ Public Benchmark Results

Supported Platforms


Public Result UploadsTest Completions*Reported Installs*OpenBenchmarking.orgEventsNAS Parallel Benchmarks Popularity Statisticspts/npb2011.042011.082011.122012.042012.082012.122013.042013.082013.122014.042014.082014.122015.042015.082015.122016.042016.082016.122017.042017.082017.122018.042018.082018.122019.042019.082019.122020.042020.082020.122021.0415K30K45K60K75K
* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Tue, 13 Apr 2021 13:26:34 GMT.
EP.C14.5%BT.C11.8%CG.C8.1%LU.C15.7%FT.C11.9%MG.C12.3%SP.B11.1%EP.D14.7%Test / Class Option PopularityOpenBenchmarking.org

Revision History

pts/npb-1.4.2   [View Source]   Thu, 21 Jan 2021 12:22:20 GMT
Build fix for GCC 10 gfortran/

pts/npb-1.4.1   [View Source]   Sat, 07 Mar 2020 12:22:08 GMT
Add --alow-run-as-root, ended up being missed until now.

pts/npb-1.4.0   [View Source]   Wed, 28 Aug 2019 11:43:04 GMT
Update against upstream NPB 3.4, add new test cases.

pts/npb-1.3.1   [View Source]   Tue, 15 Jan 2019 11:37:52 GMT
Update against upstream NPB 3.1.1

pts/npb-1.3.0   [View Source]   Fri, 09 Nov 2018 12:39:01 GMT
Use physical core count rather than logical cores to avoid MPI breaking on high core count systems with SMT.

pts/npb-1.2.4   [View Source]   Sat, 09 Sep 2017 10:30:50 GMT
ft.B not ft.C size

pts/npb-1.2.3   [View Source]   Sat, 09 Sep 2017 10:15:47 GMT
Update MPI handling, add some larger test sizes

pts/npb-1.2.2   [View Source]   Thu, 25 Aug 2016 13:51:56 GMT
Update CFLAGS handling

pts/npb-1.2.1   [View Source]   Thu, 27 Nov 2014 18:42:33 GMT
MG.B and IS.D do not build / run properly on modern systems.

pts/npb-1.2.0   [View Source]   Tue, 05 Nov 2013 22:57:21 GMT
Working on new version of NPB test that makes use of some of the HPCC test profile MPI improvements and other multi-core/cluster work for better benchmarking. Seems to have MPI rank errors right now though for NPB on this build.

pts/npb-1.1.1   [View Source]   Sun, 10 Jun 2012 19:11:43 GMT
Remove tests not in MPI NPB version.

pts/npb-1.1.0   [View Source]   Sun, 10 Jun 2012 16:56:25 GMT
Switch to the MPI version of NPB benchmarks.

pts/npb-1.0.0   [View Source]   Mon, 06 Dec 2010 15:00:08 GMT
Initial import into OpenBenchmarking.org

Suites Using This Test

Multi-Core

CPU Massive

Server CPU Tests

MPI Benchmarks

HPC - High Performance Computing


Performance Metrics

Analyze Test Configuration:

NAS Parallel Benchmarks 3.4

Test / Class: LU.C

OpenBenchmarking.org metrics for this test profile configuration based on 1,088 public results since 28 August 2019 with the latest data as of 14 April 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Matching Public Results
Total Mop/s (Average)
100th
7
282087 +/- 2775
100th
6
259754 +/- 9796
100th
4
258531 +/- 894
99th
4
236712 +/- 9928
97th
33
213344 +/- 28013
95th
12
156756 +/- 8251
93rd
10
143387 +/- 13551
93rd
3
142014 +/- 572
90th
30
138262 +/- 4647
89th
10
136076 +/- 8221
88th
4
124355 +/- 13115
88th
5
119650 +/- 1229
86th
3
107063 +/- 1376
86th
4
106715 +/- 9868
85th
8
105397 +/- 2078
85th
11
104879 +/- 4988
85th
6
104802 +/- 1776
84th
10
102859 +/- 1716
81st
5
95442 +/- 663
81st
14
94359 +/- 12550
81st
5
86919 +/- 548
80th
4
84031 +/- 755
79th
3
82640 +/- 3671
79th
4
80153 +/- 756
77th
8
77999 +/- 2883
77th
5
77998 +/- 449
76th
6
74995 +/- 977
76th
3
74830 +/- 639
76th
6
74677 +/- 948
Mid-Tier
75th
< 74662
75th
6
74550 +/- 477
75th
6
74407 +/- 1224
66th
5
61011 +/- 137
65th
9
60677 +/- 1340
65th
5
60666 +/- 6509
64th
5
57018 +/- 360
63rd
11
55588 +/- 4607
60th
6
49295 +/- 1081
57th
17
47047 +/- 2741
56th
7
46125 +/- 1044
53rd
5
43422 +/- 169
53rd
7
43378 +/- 297
Median
50th
41731
49th
4
38672 +/- 687
46th
9
33070 +/- 2808
46th
3
32232 +/- 293
45th
4
31057 +/- 227
45th
3
30091 +/- 2625
45th
13
29341 +/- 2873
42nd
25
27998 +/- 438
40th
10
27038 +/- 393
40th
36
26806 +/- 2454
38th
7
26499 +/- 223
38th
8
26493 +/- 184
37th
5
26366 +/- 400
35th
6
25722 +/- 630
34th
6
25521 +/- 102
34th
10
25490 +/- 1078
32nd
3
25020 +/- 396
32nd
6
24385 +/- 429
31st
10
24156 +/- 1589
30th
12
23641 +/- 1186
29th
5
23632 +/- 384
29th
4
22816 +/- 225
28th
3
22338 +/- 178
27th
4
22034 +/- 328
26th
3
21401 +/- 1258
Low-Tier
25th
< 21096
25th
4
21065 +/- 164
25th
9
20993 +/- 570
25th
7
20489 +/- 1521
25th
3
20408 +/- 2061
24th
5
20293 +/- 15
23rd
4
20196 +/- 11
23rd
3
19575 +/- 9
22nd
5
19312 +/- 1594
22nd
3
18713 +/- 124
22nd
3
18673 +/- 1491
21st
6
18050 +/- 1074
20th
4
17585 +/- 157
20th
4
17498 +/- 77
20th
9
17410 +/- 298
19th
3
17312 +/- 140
18th
5
16754 +/- 167
18th
5
16422 +/- 488
18th
3
16245 +/- 39
17th
6
16060 +/- 521
17th
4
16045 +/- 134
17th
9
15931 +/- 1544
16th
8
15488 +/- 114
15th
9
15278 +/- 371
15th
3
15162 +/- 3
13th
4
14685 +/- 86
13th
7
14164 +/- 204
12th
3
14064 +/- 172
12th
3
13243 +/- 30
10th
3
12400 +/- 224
10th
4
12253 +/- 1225
9th
3
11658 +/- 736
9th
6
11655 +/- 836
9th
7
11336 +/- 153
7th
3
9739 +/- 6
7th
4
9481 +/- 422
5th
4
8168 +/- 13
5th
5
8084 +/- 6
OpenBenchmarking.orgDistribution Of Public Results - Test / Class: LU.C1087 Results Range From 60 To 285622 Total Mop/s605772114841719622908286203433240044457565146857180628926860474316800288574091452971641028761085881143001200121257241314361371481428601485721542841599961657081714201771321828441885561942681999802056922114042171162228282285402342522399642456762513882571002628122685242742362799482856604080120160200

Based on OpenBenchmarking.org data, the selected test / test configuration (NAS Parallel Benchmarks 3.4 - Test / Class: LU.C) has an average run-time of 5 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkTest / Class: LU.CRun-Time20406080100Min: 1 / Avg: 4.2 / Max: 110

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.1%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsTest / Class: LU.CDeviation246810Min: 0 / Avg: 0.1 / Max: 3

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

AMDIntelOpenBenchmarking.orgRelative Core Scaling To BaseNAS Parallel Benchmarks CPU Core ScalingTest / Class: LU.C468121624324864128510152025

Recent Test Results

OpenBenchmarking.org Results Compare

1 System - 111 Benchmark Results

2 x AMD EPYC 7V13 64-Core - Microsoft Virtual Machine - 442GB

CentOS Linux 8 - 4.18.0-147.8.1.el8_1.x86_64 - GCC 8.3.1 20190507

3 Systems - 95 Benchmark Results

2 x AMD EPYC 7V12 64-Core - Microsoft Virtual Machine - 450GB

CentOS Linux 8 - 4.18.0-147.8.1.el8_1.x86_64 - GCC 8.3.1 20190507

2 Systems - 86 Benchmark Results

2 x AMD EPYC 7V13 64-Core - Microsoft Virtual Machine - 442GB

CentOS Linux 8 - 4.18.0-147.8.1.el8_1.x86_64 - GCC 8.3.1 20190507

12 Systems - 453 Benchmark Results

AMD Ryzen 7 5800X 8-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 21.04 - 5.12.0-051200rc3daily20210315-generic - GNOME Shell 3.38.3

1 System - 115 Benchmark Results

Intel Xeon E3-1225 v6 - (2.002 BIOS) - Intel Xeon E3-1200 v6

Ubuntu 20.04 - 5.4.0-70-generic - 1.2.145

1 System - 115 Benchmark Results

Intel Xeon E3-1225 v5 - INTEL H110 - Intel Xeon E3-1200 v5

Ubuntu 20.04 - 5.4.0-66-generic - 1.2.145

1 System - 108 Benchmark Results

2 x Intel Xeon Gold 5218R - Supermicro X11DPX-T - Intel Device 2020

Ubuntu 16.04 - 4.15.0-140-generic - Unity 7.4.0

3 Systems - 21 Benchmark Results

AMD Ryzen 9 5900X 12-Core - MSI B550M PRO-VDH WIFI - AMD Device 1480

Ubuntu 18.04 - 5.4.0-70-generic - LXDE 0.9.3

2 Systems - 21 Benchmark Results

AMD Phenom II X4 945 - Gigabyte GA-MA78GM-S2H - 6144MB

Calculate Linux Desktop 11.15 GNOME - 3.3.3-calculate - GNOME Shell 3.2.2.1

1 System - 212 Benchmark Results

Intel Core i5-8250U - LENOVO 20L7CTO1WW - Intel Xeon E3-1200 v6

Debian testing - 5.10.0-5-amd64 - GNOME Shell 3.38.4

1 System - 89 Benchmark Results

2 x Intel Xeon Gold 5218R - Supermicro X11DPX-T - Intel Device 2020

Ubuntu 16.04 - 4.15.0-140-generic - Unity 7.4.0

9 Systems - 442 Benchmark Results

AMD Ryzen 5 5600X 6-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 21.04 - 5.12.0-051200rc3daily20210315-generic - GNOME Shell 3.38.3

Most Popular Test Results

OpenBenchmarking.org Results Compare

16 Systems - 119 Benchmark Results

2 x Intel Xeon Platinum 8259L - ASRockRack EP2C621D16-4LP - Intel Sky Lake-E DMI3 Registers

Ubuntu 19.10 - 5.3.0-64-generic - GNOME Shell 3.34.1

2 Systems - 151 Benchmark Results

Intel Xeon E-2278GEL - Logic Supply RXM-181 - Intel Cannon Lake PCH

Ubuntu 20.10 - 5.8.0-41-generic - GNOME Shell 3.38.2

3 Systems - 9 Benchmark Results

2 x AMD EPYC 7742 64-Core - AMD DAYTONA_X - AMD Device 1480

Ubuntu 19.04 - 5.3.0-999-generic - GNOME Shell 3.32.2

5 Systems - 89 Benchmark Results

Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.10 - 5.8.0-36-generic - GNOME Shell 3.38.1

3 Systems - 301 Benchmark Results

Intel Core i5-10600K - ASUS PRIME Z490M-PLUS - Intel Comet Lake PCH

Ubuntu 20.04 - 5.4.0-40-generic - GNOME Shell 3.36.3

4 Systems - 30 Benchmark Results

Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-38-generic - GNOME Shell 3.38.1

3 Systems - 108 Benchmark Results

Intel Core i7-3770K - ECS Z77H2-A2X v1.0 - Intel Xeon E3-1200 v2

Ubuntu 20.04 - 5.4.0-58-generic - GNOME Shell 3.36.4

3 Systems - 23 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Ubuntu 20.10 - 5.11.0-rc1-phx - GNOME Shell 3.38.1

18 Systems - 115 Benchmark Results

AMD Ryzen Threadripper 3960X 24-Core - MSI Creator TRX40 - AMD Starship

Fedora 30 - 5.2.6-200.fc30.x86_64 - GNOME Shell 3.32.2

4 Systems - 62 Benchmark Results

AMD Ryzen 5 3600XT 6-Core - MSI X470 GAMING M7 AC - AMD Starship

Ubuntu 20.10 - 5.8.0-28-generic - GNOME Shell 3.38.1

Find More Test Results