PyHPC Benchmarks

PyHPC-Benchmarks is a suite of Python high performance computing benchmarks for execution on CPUs and GPUs using various popular Python HPC libraries. The PyHPC CPU-based benchmarks focus on sequential CPU performance.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark pyhpc.

Project Site

github.com

Test Created

22 October 2021

Last Updated

28 October 2021

Test Maintainer

Michael Larabel 

Test Type

System

Average Install Time

2 Minutes, 45 Seconds

Average Run Time

49 Seconds

Test Dependencies

Python

Accolades

5k+ Downloads

Supported Platforms


Public Result Uploads *Reported Installs **Reported Test Completions **Test Profile Page ViewsOpenBenchmarking.orgEventsPyHPC Benchmarks Popularity Statisticspts/pyhpc2021.102021.112021.122022.012022.022022.032022.042022.052022.062022.072022.082022.092022.102022.112022.122023.012023.022023.032023.042023.052023.062023.072023.082023.092023.102023.112023.122024.012024.022024.032024.046K12K18K24K30K
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data updated weekly as of 14 April 2024.
JAX15.0%Numba17.3%Aesara17.2%TensorFlow7.5%PyTorch15.9%Numpy27.1%Backend Option PopularityOpenBenchmarking.org
104857620.0%1638416.3%26214418.0%6553617.3%419430428.4%Project Size Option PopularityOpenBenchmarking.org
Isoneutral Mixing47.5%Equation of State52.5%Benchmark Option PopularityOpenBenchmarking.org

Revision History

pts/pyhpc-3.0.0   [View Source]   Thu, 28 Oct 2021 15:13:30 GMT
Update against upstream PyHPC 3.0.

pts/pyhpc-1.0.0   [View Source]   Fri, 22 Oct 2021 15:05:19 GMT
Initial commit of PyHPC-Benchmarks.

Suites Using This Test

HPC - High Performance Computing

Python


Performance Metrics

Analyze Test Configuration:

PyHPC Benchmarks 3.0

Device: CPU - Backend: Numpy - Project Size: 4194304 - Benchmark: Equation of State

OpenBenchmarking.org metrics for this test profile configuration based on 540 public results since 28 October 2021 with the latest data as of 23 March 2024.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
Seconds (Average)
100th
6
0.697 +/- 0.064
98th
8
0.742 +/- 0.017
95th
5
0.751 +/- 0.002
95th
10
0.753 +/- 0.023
95th
9
0.754 +/- 0.013
92nd
3
0.801 +/- 0.059
91st
6
0.809 +/- 0.019
90th
7
0.832 +/- 0.003
89th
12
0.843 +/- 0.068
84th
10
0.922 +/- 0.085
82nd
10
0.954 +/- 0.080
78th
4
0.981 +/- 0.011
76th
5
0.993 +/- 0.043
Mid-Tier
75th
> 0.998
75th
5
1.001 +/- 0.007
71st
7
1.016 +/- 0.008
70th
5
1.020 +/- 0.026
68th
8
1.027 +/- 0.012
68th
8
1.027 +/- 0.040
68th
11
1.028 +/- 0.033
64th
12
1.054 +/- 0.022
61st
7
1.105 +/- 0.008
55th
3
1.245 +/- 0.017
54th
8
1.271 +/- 0.062
53rd
9
1.277 +/- 0.076
Median
50th
1.309
50th
4
1.312 +/- 0.014
50th
6
1.315 +/- 0.013
49th
4
1.327 +/- 0.012
49th
5
1.329 +/- 0.014
49th
16
1.330 +/- 0.134
44th
6
1.362 +/- 0.021
43rd
3
1.390 +/- 0.051
42nd
3
1.413 +/- 0.008
39th
7
1.451 +/- 0.027
39th
3
1.456 +/- 0.018
37th
5
1.472 +/- 0.006
35th
6
1.520 +/- 0.179
33rd
5
1.547 +/- 0.008
33rd
7
1.554 +/- 0.022
32nd
5
1.561 +/- 0.021
30th
9
1.574 +/- 0.012
28th
4
1.584 +/- 0.015
26th
4
1.650 +/- 0.138
Low-Tier
25th
> 1.672
25th
3
1.677 +/- 0.005
24th
3
1.683 +/- 0.002
19th
6
1.876 +/- 0.028
16th
3
1.976 +/- 0.001
15th
3
2.014 +/- 0.266
14th
4
2.060 +/- 0.153
14th
3
2.076 +/- 0.004
14th
9
2.078 +/- 0.109
13th
4
2.089 +/- 0.053
13th
3
2.118 +/- 0.003
9th
3
2.200 +/- 0.039
8th
4
2.438 +/- 0.007
7th
6
2.456 +/- 0.019
6th
3
2.489 +/- 0.016
5th
3
2.658 +/- 0.067
4th
3
2.681 +/- 0.016
3rd
3
2.755 +/- 0.011
1st
3
4.880 +/- 0.249
OpenBenchmarking.orgDistribution Of Public Results - Device: CPU - Backend: Numpy - Project Size: 4194304 - Benchmark: Equation of State540 Results Range From 0 To 11 Seconds0.9171.8342.7513.6684.5855.5026.4197.3368.2539.1710.08711.00470140210280350

Based on OpenBenchmarking.org data, the selected test / test configuration (PyHPC Benchmarks 3.0 - Device: CPU - Backend: Numpy - Project Size: 4194304 - Benchmark: Equation of State) has an average run-time of 3 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkDevice: CPU - Backend: Numpy - Project Size: 4194304 - Benchmark: Equation of StateRun-Time3691215Min: 1 / Avg: 2.42 / Max: 10

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.1%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsDevice: CPU - Backend: Numpy - Project Size: 4194304 - Benchmark: Equation of StateDeviation246810Min: 0 / Avg: 0.08 / Max: 2

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

IntelAMDOpenBenchmarking.orgRelative Core Scaling To BasePyHPC Benchmarks CPU Core ScalingDevice: CPU - Backend: Numpy - Project Size: 4194304 - Benchmark: Equation of State468121416641280.70421.40842.11262.81683.521

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture
Kernel Identifier
Verified On
Intel / AMD x86 64-bit
x86_64
(Many Processors)
ARMv8 64-bit
arm64
Apple M1
ARMv8 64-bit
aarch64
ARMv8 Cortex-A78E 12-Core, ARMv8 Neoverse-N1, ARMv8 Neoverse-V1, Ampere ARMv8 Neoverse-N1 128-Core, Ampere ARMv8 Neoverse-N1 256-Core, Ampere eMAG ARMv8 32-Core, Apple M1, Apple M2

Recent Test Results

OpenBenchmarking.org Results Compare

1 System - 10 Benchmark Results

Intel Xeon Gold 5416S - Supermicro X13SEW-TF v1.02 - Intel Device 1bce

Debian 12 - 6.1.0-18-amd64 - GCC 12.2.0

1 System - 40 Benchmark Results

Intel Xeon Gold 5416S - Supermicro X13SEW-TF v1.02 - Intel Device 1bce

Debian 12 - 6.1.0-18-amd64 - GCC 12.2.0

1 System - 10 Benchmark Results

Intel Xeon Gold 5416S - Supermicro X13SEW-TF v1.02 - Intel Device 1bce

Debian 12 - 6.1.0-18-amd64 - GCC 12.2.0

1 System - 10 Benchmark Results

AMD Ryzen 9 7950X 16-Core - Supermicro H13SAE-MF v1.00 - AMD Device 14d8

Debian 12 - 6.1.0-18-amd64 - GCC 12.2.0

1 System - 10 Benchmark Results

Intel Xeon Gold 5416S - Supermicro X13SEW-TF v1.02 - Intel Device 1bce

Debian 12 - 6.1.0-18-amd64 - GCC 12.2.0

1 System - 10 Benchmark Results

AMD Ryzen 9 7950X 16-Core - Supermicro H13SAE-MF v1.00 - AMD Device 14d8

Debian 12 - 6.1.0-18-amd64 - GCC 12.2.0

1 System - 126 Benchmark Results

AMD Ryzen 9 7950X 16-Core - Supermicro H13SAE-MF v1.00 - AMD Device 14d8

Debian 12 - 6.1.0-18-amd64 - GCC 12.2.0

1 System - 126 Benchmark Results

Intel Xeon Gold 5416S - Supermicro X13SEW-TF v1.02 - Intel Device 1bce

Debian 12 - 6.1.0-18-amd64 - GCC 12.2.0

1 System - 126 Benchmark Results

Intel Xeon Gold 5416S - Supermicro X13SEW-TF v1.02 - Intel Device 1bce

Debian 12 - 6.1.0-18-amd64 - GCC 12.2.0

1 System - 126 Benchmark Results

AMD Ryzen 9 7950X 16-Core - Supermicro H13SAE-MF v1.00 - AMD Device 14d8

Debian 12 - 6.1.0-18-amd64 - GCC 12.2.0

5 Systems - 587 Benchmark Results

Intel Core i9-14900K - ASUS PRIME Z790-P WIFI - Intel Raptor Lake-S PCH

Ubuntu 23.10 - 6.7.3-060703-generic - GNOME Shell 45.2

1 System - 1253 Benchmark Results

1 System - 60 Benchmark Results

ARMv8 Cortex-A78E - EDK II 2.1-32413640 - 62GB

Ubuntu 20.04 - 5.10.104-tegra - GNOME Shell 3.36.9

1 System - 862 Benchmark Results

1 System - 82 Benchmark Results

AMD Ryzen 7 7840U - Framework FRANMDCP07 - AMD Device 14e8

Ubuntu 23.10 - 6.7.0-060700rc5-generic - GNOME Shell 45.1

Most Popular Test Results

OpenBenchmarking.org Results Compare

13 Systems - 333 Benchmark Results

AMD Ryzen 7 5700G - ASUS ROG CROSSHAIR VIII HERO - AMD Renoir

Ubuntu 22.04 - 6.0.0-060000rc1daily20220820-generic - GNOME Shell 42.2

11 Systems - 119 Benchmark Results

Intel Core i5-12600K - ASUS PRIME Z690-P WIFI D4 - Intel Device 7aa7

Ubuntu 21.10 - 5.16.0-051600rc8-generic - GNOME Shell 40.5

15 Systems - 182 Benchmark Results

AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 21.10 - 5.16.0-051600rc8-generic - GNOME Shell 40.5

16 Systems - 333 Benchmark Results

Intel Core i5-12600K - ASUS ROG STRIX Z690-E GAMING WIFI - Intel Device 7aa7

Ubuntu 22.04 - 6.0.0-060000rc1daily20220820-generic - GNOME Shell 42.2

5 Systems - 396 Benchmark Results

AMD Ryzen 7 5800X3D 8-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 23.04 - 6.2.0-060200rc8daily20230213-generic - GNOME Shell 43.2

2 Systems - 161 Benchmark Results

Intel Core i3-7100 - Gigabyte B250M-DS3H-CF - Intel Xeon E3-1200 v6

Ubuntu 20.10 - 5.8.0-55-generic - GNOME Shell 3.38.1

2 Systems - 218 Benchmark Results

Intel Core i7-1280P - MSI MS-14C6 - Intel Alder Lake PCH

Arch Linux - 5.18.16-arch1-1 - KDE Plasma 5.25.4

6 Systems - 301 Benchmark Results

3 Systems - 268 Benchmark Results

Apple M1 - Apple Mac mini - 8GB

Arch Linux ARM - 5.17.0-rc7-asahi-next-20220310-5-1-ARCH - KDE Plasma 5.24.3

2 Systems - 219 Benchmark Results

Apple M1 - Apple Mac mini - 8GB

Arch Linux ARM - 5.19.0-rc7-asahi-2-1-ARCH - KDE Plasma 5.25.4

3 Systems - 190 Benchmark Results

AMD Ryzen 7 PRO 6850U - LENOVO 21CM0001US - AMD Device 14b5

Arch rolling - 5.18.16-arch1-1 - KDE Plasma 5.25.4

4 Systems - 98 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Ubuntu 20.10 - 5.11.0-rc6-phx - GNOME Shell 3.38.1

Find More Test Results