nekRS

nekRS is an open-source Navier Stokes solver based on the spectral element method. NekRS supports both CPU and GPU/accelerator support though this test profile is currently configured for CPU execution. NekRS is part of Nek5000 of the Mathematics and Computer Science MCS at Argonne National Laboratory. This nekRS benchmark is primarily relevant to large core count HPC servers and otherwise may be very time consuming on smaller systems.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark nekrs.

Project Site

nek5000.mcs.anl.gov

Source Repository

github.com

Test Created

8 November 2022

Last Updated

4 June 2023

Test Maintainer

Michael Larabel

Test Type

Processor

Average Install Time

1 Minute, 53 Seconds

Average Run Time

18 Minutes, 43 Seconds

Test Dependencies

OpenMPI + CMake + C/C++ Compiler Toolchain

Accolades

10k+ Downloads

Supported Platforms

* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data updated weekly as of 4 December 2023.

Revision History

pts/nekrs-1.1.0 [View Source] Sun, 04 Jun 2023 20:11:43 GMT
Update against nekRS 23 upstream.

pts/nekrs-1.0.0 [View Source] Tue, 08 Nov 2022 18:57:06 GMT
Add nekRS scalable CFD benchmark.

Suites Using This Test

HPC - High Performance Computing

Performance Metrics

Analyze Test Configuration:

nekRS 23.0

Input: Kershaw

OpenBenchmarking.org metrics for this test profile configuration based on 245 public results since 4 June 2023 with the latest data as of 30 October 2023.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component

Percentile Rank

# Compatible Public Results

flops/rank (Average)

2 x AMD EPYC 9554 64-Core

100th

12800353333 ^{+/- 427629288}

2 x AMD EPYC 9124 16-Core

98th

11455766667 ^{+/- 123865115}

2 x AMD EPYC 9254 24-Core

97th

11057966667 ^{+/- 211097355}

AMD EPYC 9124 16-Core

95th

10237225000 ^{+/- 187983110}

AMD EPYC 9334 32-Core

93rd

9192422500 ^{+/- 75560543}

2 x Intel Xeon Gold 6442Y

90th

8562610000

Intel Xeon Gold 6444Y

88th

8285166667 ^{+/- 70519766}

2 x AMD EPYC 9684X 96-Core

87th

8222346667 ^{+/- 465390635}

2 x AMD EPYC 9334 32-Core

86th

8124566667 ^{+/- 26331829}

2 x Intel Xeon Platinum 8468

83rd

7491736667 ^{+/- 43910284}

Intel Core i7-1185G7

81st

7277980000 ^{+/- 9711032}

2 x Intel Xeon Max 9468

80th

6930664444 ^{+/- 330298088}

AMD Ryzen 7 7800X3D 8-Core

79th

6751504167 ^{+/- 523048334}

2 x Intel Xeon Platinum 8490H

78th

6724270000 ^{+/- 242487}

Mid-Tier

75th

< 6603000000

AMD EPYC 7F32 8-Core

72nd

6387210000

2 x Intel Xeon Max 9480

70th

6304686706 ^{+/- 325892703}

Intel Xeon Platinum 8462Y

68th

6084607500 ^{+/- 80874964}

AMD EPYC 9754 128-Core

62nd

5739568889 ^{+/- 42154394}

Intel Xeon Platinum 8468

60th

5710816667 ^{+/- 37396529}

AMD Ryzen 5 7600X 6-Core

59th

5642100000 ^{+/- 108865336}

AMD Ryzen 9 7900X3D 12-Core

56th

4742400000 ^{+/- 71948835}

AMD Ryzen 7 5800X3D 8-Core

54th

4653558889 ^{+/- 180401958}

Median

50th

4495660000

AMD Ryzen 7 7700 8-Core

48th

4442480000 ^{+/- 74928446}

2 x Intel Xeon Platinum 8380

44th

4267857500 ^{+/- 52075869}

AMD Ryzen 9 7900X 12-Core

40th

3634780303 ^{+/- 80515089}

AMD Ryzen 9 7950X3D 16-Core

38th

3624445000 ^{+/- 9897347}

AMD Ryzen 5 5500U

32nd

3289403333 ^{+/- 22254508}

Intel Core i5-12600K

29th

3261400000 ^{+/- 646632}

Intel Xeon Silver 4216

26th

3122730000

Low-Tier

25th

< 3122730000

AMD Ryzen 7 5800X 8-Core

24th

2961128889 ^{+/- 7216717}

2 x AMD EPYC 7773X 64-Core

23rd

2904119524 ^{+/- 108016945}

AMD Ryzen 5 4500U

19th

2667765000 ^{+/- 548483}

AMD Ryzen Threadripper 3970X 32-Core

16th

2116343334 ^{+/- 7740343}

Intel Core i7-1280P

15th

2103476667 ^{+/- 1835657}

AMD Ryzen 9 5900HX

11th

2032139167 ^{+/- 2927330}

AMD Ryzen 7 4700U

8th

1931180000 ^{+/- 7111336}

AMD Ryzen 9 3900XT 12-Core

7th

1774375000 ^{+/- 3423687}

AMD Ryzen Threadripper 3990X 64-Core

4th

1291546250 ^{+/- 1761867}

Based on OpenBenchmarking.org data, the selected test / test configuration (nekRS 23.0 - Input: Kershaw) has an average run-time of 12 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.1%.

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set

Support

Instructions Detected

Advanced Vector Extensions (AVX)

Used by default on supported hardware.
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

VZEROUPPER VBROADCASTSD VINSERTF128 VEXTRACTF128 VBROADCASTSS VPERMILPD VPERMILPS

Advanced Vector Extensions 2 (AVX2)

Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Excavator (2016).

VPBROADCASTD VPBROADCASTW VPERMQ VPBROADCASTQ VEXTRACTI128 VINSERTI128 VPBROADCASTB VGATHERDPD VPERM2I128 VPGATHERDQ VPGATHERDD VGATHERDPS VPSRAVD VPERMPD VPGATHERQQ VPERMD VPGATHERQD

FMA (FMA)

Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Bulldozer (2011).

VFMADD132SD VFNMADD132SD VFMADD213SD VFMADD231SD VFMSUB231SD VFMADD132PD VFNMADD231SD VFMSUB132SD VFMADD231SS VFMADD231PS VFNMADD132PD VFMADD231PD VFMADD213PD VFNMADD231PD VFNMADD213SD VFMSUB132PD VFNMADD213PD VFNMSUB132SD VFMSUB231PD VFNMADD213PS VFNMADD132PS VFNMADD213SS VFNMADD132SS VFMSUB132SS VFMADD213PS VFMADD132PS VFMADD213SS VFMADD132SS VFNMADD231SS VFMSUB231SS VFNMSUB132SS

Advanced Vector Extensions 512 (AVX512)

Requires passing a supported compiler/build flag (verified with targets: cascadelake, sapphirerapids).

(ZMM REGISTER USE)

The test / benchmark does honor compiler flag changes.

Last automated analysis: 24 June 2023

This test profile binary relies on the shared libraries libnekrs.so, libmpi.so.40, libm.so.6, libc.so.6, libnekrs-hypre.so, libnekrs-hypre-device.so, libocca.so, libgomp.so.1, libgfortran.so.5, libopen-pal.so.40, libopen-rte.so.40, libhwloc.so.15, libquadmath.so.0, libz.so.1, libudev.so.1.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture

Kernel Identifier

Verified On

Intel / AMD x86 64-bit

x86_64

(Many Processors)

ARMv8 64-bit

aarch64

ARMv8 Neoverse-N1, ARMv8 Neoverse-V1

okt 2 Systems - 358 Benchmark Results	AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship Ubuntu 22.04 - 6.2.0-35-generic - GNOME Shell 42.2
oktoberfest 2 Systems - 246 Benchmark Results	Intel Core i5-12600K - ASUS PRIME Z690-P WIFI D4 - Intel Device 7aa7 Ubuntu 22.04 - 5.19.0-051900rc6daily20220716-generic - GNOME Shell 42.1
extra tests2 10 Systems - 214 Benchmark Results	2 x AMD EPYC 9254 24-Core - Supermicro H13DSH - 24 x 32 GB DDR5-4800MT AlmaLinux 9.2 - 5.14.0-284.25.1.el9_2.x86_64 - GCC 11.3.1 20221121
GCE c3d-standard-60 6 Systems - 120 Benchmark Results	AMD EPYC 7B13 - Google Compute Engine t2d-standard-60 - Intel 440FX 82441FX PMC Ubuntu 22.04 - 6.2.0-1014-gcp - 1.3.238
GCE c3d-standard-60 4 Systems - 120 Benchmark Results	AMD EPYC 9B14 - Google Compute Engine c3d-standard-60 - Intel 440FX 82441FX PMC Ubuntu 22.04 - 6.2.0-1014-gcp - 1.3.238
GCE c3d-standard-60 3 Systems - 120 Benchmark Results	ARMv8 Neoverse-N1 - Amazon EC2 c6g.16xlarge - Amazon Device 0200 Ubuntu 22.04 - 5.19.0-1025-aws - 1.3.238
Xeon Max Linux Kernels 1 System - 232 Benchmark Results	2 x Intel Xeon Max 9480 - Supermicro X13DEM v1.10 - Intel Device 1bce Ubuntu 23.04 - 6.4.0-060400-generic - GNOME Shell 44.0
GCE c3d-standard-60 2 Systems - 120 Benchmark Results	AMD EPYC 7B13 - Google Compute Engine t2d-standard-60 - Intel 440FX 82441FX PMC Ubuntu 22.04 - 6.2.0-1014-gcp - 1.3.238
GCE c3d-standard-60 1 System - 116 Benchmark Results	AMD EPYC 9B14 - Google Compute Engine c3d-standard-60 - Intel 440FX 82441FX PMC Ubuntu 22.04 - 6.2.0-1014-gcp - 1.3.238
svc05_hpc_run_1_23-09-22 1 System - 543 Benchmark Results	AMD Ryzen Threadripper PRO 5995WX 64-Cores - ASRock WRX80 Creator - AMD Starship Ubuntu 22.04 - 6.2.0-33-generic - GNOME Shell 42.9
extra tests 5 Systems - 200 Benchmark Results	2 x AMD EPYC 9754 128-Core - Supermicro H13DSH - 23 x 32 GB DDR5-4800MT AlmaLinux 9.2 - 5.14.0-284.25.1.el9_2.x86_64 - GCC 11.3.1 20221121
extra tests 4 Systems - 193 Benchmark Results	2 x AMD EPYC 9124 16-Core - Supermicro H13DSH - 24 x 32 GB DDR5-4800MT AlmaLinux 9.2 - 5.14.0-284.25.1.el9_2.x86_64 - GCC 11.3.1 20221121
t1 4 Systems - 2 Benchmark Results	Intel Core i9-12900H - ASUS GU603ZW v1.0 - Intel Alder Lake PCH Pop 22.04 - 6.4.6-76060406-generic - GNOME Shell 42.5
debian 12 xeon 1 System - 80 Benchmark Results	Intel Xeon Silver 4216 - TYAN S7100AG2NR - Intel Sky Lake-E DMI3 Registers Debian 12 - 6.1.0-11-amd64 - X Server
7f32 auggy 1 System - 169 Benchmark Results	AMD EPYC 7F32 8-Core - ASRockRack EPYCD8 - AMD Starship Debian 12 - 6.1.0-11-amd64 - X Server

AMD Ryzen 5000 Series Linux Performance Featured Processor Comparison	AMD Ryzen 5 5500 - ASUS ROG CROSSHAIR VIII HERO - AMD Renoir Ubuntu 22.04 - 5.19.0-46-generic - GNOME Shell 42.5
new wed 2 Systems - 115 Benchmark Results	2 x Intel Xeon Platinum 8490H - Quanta Cloud S6Q-MB-MPS - Intel Device 1bce Ubuntu 22.04 - 5.15.0-47-generic - GNOME Shell 42.4
AMD Ryzen 5000 Series Linux Performance 10 Systems - 272 Benchmark Results	AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 22.04 - 5.19.0-46-generic - GNOME Shell 42.5
AMD Ryzen 5000 Series Linux Performance 8 Systems - 271 Benchmark Results	AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 22.04 - 5.19.0-46-generic - GNOME Shell 42.5
Amazon AWS 2 Systems - 91 Benchmark Results	ARMv8 Neoverse-V1 - Amazon EC2 m7g.16xlarge - Amazon Device 0200 Ubuntu 22.04 - 5.19.0-1025-aws - GCC 11.3.0
AMD Ryzen 5000 Series Linux Performance 8 Systems - 271 Benchmark Results	AMD Ryzen 5 5600G - ASUS ROG CROSSHAIR VIII HERO - AMD Renoir Ubuntu 22.04 - 5.19.0-46-generic - GNOME Shell 42.5
dddas 2 Systems - 234 Benchmark Results	AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship Ubuntu 22.04 - 5.19.0-051900rc7-generic - GNOME Shell 42.2
Amazon AWS 3 Systems - 91 Benchmark Results	ARMv8 Neoverse-V1 - Amazon EC2 m7g.16xlarge - Amazon Device 0200 Ubuntu 22.04 - 5.19.0-1025-aws - GCC 11.3.0
extra tests 5 Systems - 200 Benchmark Results	2 x AMD EPYC 9754 128-Core - Supermicro H13DSH - 23 x 32 GB DDR5-4800MT AlmaLinux 9.2 - 5.14.0-284.25.1.el9_2.x86_64 - GCC 11.3.1 20221121
dddas 2 Systems - 234 Benchmark Results	AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship Ubuntu 22.04 - 5.19.0-051900rc7-generic - GNOME Shell 42.2
nekrs 23 Featured Graphics Comparison	AMD Ryzen 9 5900HX - ASUS G513QY v1.0 - AMD Renoir Ubuntu 22.10 - 5.19.0-41-generic - GNOME Shell 43.0
dsd 3 Systems - 153 Benchmark Results	AMD Ryzen 5 5500U - NB01 NL5xNU - AMD Renoir Tuxedo 22.04 - 6.0.0-1010-oem - KDE Plasma 5.26.5
Ryzen 9 5950X Linux 3 Systems - 284 Benchmark Results	AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 22.04 - 5.19.0-46-generic - GNOME Shell 42.5
Amazon AWS Graviton3E vs. Graviton 2/3 benchmarks 5 Systems - 87 Benchmark Results	ARMv8 Neoverse-V1 - Amazon EC2 c7g.16xlarge - Amazon Device 0200 Ubuntu 22.04 - 5.19.0-1025-aws - GCC 11.3.0
new new 4 Systems - 17 Benchmark Results	AMD Ryzen Threadripper 3990X 64-Core - Gigabyte TRX40 AORUS PRO WIFI - AMD Starship Ubuntu 23.04 - 6.2.0-20-generic - GNOME Shell 44.0