PyBench

This test profile reports the total time of the different average timed test results from PyBench. PyBench reports average test times for different functions such as BuiltinFunctionCalls and NestedForLoops, with this total result providing a rough estimate as to Python's average performance on a given system. This test profile runs PyBench each time for 20 rounds.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark pybench.

Project Site

svn.python.org

Test Created

6 December 2010

Last Updated

17 January 2019

Test Maintainer

Michael Larabel

Test Type

System

Average Install Time

1 Second

Average Run Time

4 Minutes, 10 Seconds

Accolades

200k+ Downloads + 5k+ Public Benchmark Results

Supported Platforms


Public Result UploadsTest Completions*Reported Installs*OpenBenchmarking.orgEventsPyBench Popularity Statisticspts/pybench2011.012011.052011.092012.012012.052012.092013.012013.052013.092014.012014.052014.092015.012015.052015.092016.012016.052016.092017.012017.052017.092018.012018.052018.092019.012019.052019.092020.012020.052020.092021.0115K30K45K60K75K
* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Sat, 23 Jan 2021 07:20:05 GMT.

Revision History

pts/pybench-1.1.3   [View Source]   Thu, 17 Jan 2019 10:20:52 GMT
Windows test profile update for latest Python.

pts/pybench-1.1.2   [View Source]   Wed, 07 Mar 2018 11:49:45 GMT
Explicitly use the default Python 3 path on Windows to avoid python2 being picked up which no longer works with this test code.

pts/pybench-1.1.1   [View Source]   Fri, 02 Mar 2018 15:28:39 GMT
Windows support was refreshingly easy...

pts/pybench-1.1.0   [View Source]   Sun, 18 Feb 2018 15:46:36 GMT
Update PyBench to a Python3 port

pts/pybench-1.0.1   [View Source]   Thu, 15 Feb 2018 15:07:12 GMT
Be explicit about python2, don't use generic python call as this test will break when python is python3.

pts/pybench-1.0.0   [View Source]   Mon, 06 Dec 2010 15:19:25 GMT
Initial import into OpenBenchmarking.org

Suites Using This Test

Server CPU Tests

Python

Single-Threaded

Programmer / Developer System Benchmarks


Performance Metrics

Analyze Test Configuration:

PyBench 2018-02-16

Total For Average Test Times

OpenBenchmarking.org metrics for this test profile configuration based on 6,052 public results since 18 February 2018 with the latest data as of 21 January 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Matching Public Results
Milliseconds (Average)
99th
21
776 +/- 103
97th
5
853 +/- 91
96th
38
860 +/- 148
96th
13
870 +/- 117
96th
52
872 +/- 89
95th
49
897 +/- 135
93rd
9
907 +/- 14
92nd
3
920 +/- 27
92nd
4
923 +/- 26
92nd
10
927 +/- 231
91st
18
944 +/- 33
90th
5
949 +/- 4
90th
15
950 +/- 194
89th
25
954 +/- 120
89th
24
959 +/- 132
86th
67
1001 +/- 127
86th
60
1003 +/- 102
85th
18
1007 +/- 60
85th
5
1014 +/- 199
84th
9
1021 +/- 33
84th
18
1023 +/- 4
84th
11
1024 +/- 34
84th
8
1025 +/- 34
84th
8
1029 +/- 32
83rd
10
1032 +/- 38
83rd
22
1035 +/- 20
83rd
133
1041 +/- 128
83rd
5
1046 +/- 87
83rd
3
1048 +/- 64
82nd
12
1055 +/- 168
81st
14
1070 +/- 12
81st
17
1071 +/- 215
79th
23
1090 +/- 183
79th
39
1092 +/- 265
79th
3
1094 +/- 40
79th
5
1099 +/- 26
78th
11
1110 +/- 30
78th
10
1111 +/- 152
77th
6
1120 +/- 107
77th
12
1122 +/- 24
76th
3
1132 +/- 32
76th
8
1135 +/- 28
Mid-Tier
75th
> 1136
75th
25
1140 +/- 1
73rd
5
1152 +/- 143
73rd
6
1154 +/- 23
73rd
6
1158 +/- 26
72nd
37
1164 +/- 89
70th
10
1176 +/- 25
70th
20
1179 +/- 204
70th
19
1181 +/- 12
69th
9
1184 +/- 30
69th
9
1189 +/- 40
69th
11
1189 +/- 33
69th
10
1189 +/- 35
68th
6
1194 +/- 53
68th
6
1200 +/- 16
68th
9
1201 +/- 24
68th
6
1204 +/- 20
67th
10
1205 +/- 196
67th
19
1206 +/- 2
66th
15
1211 +/- 28
66th
6
1212 +/- 23
66th
9
1212 +/- 148
65th
7
1217 +/- 42
65th
10
1222 +/- 31
65th
41
1222 +/- 103
65th
16
1223 +/- 14
65th
3
1223 +/- 2
64th
245
1227 +/- 283
63rd
7
1233 +/- 20
63rd
9
1235 +/- 239
63rd
17
1235 +/- 36
63rd
4
1237 +/- 173
63rd
43
1237 +/- 181
63rd
4
1238 +/- 23
62nd
4
1240 +/- 24
62nd
5
1241 +/- 141
62nd
3
1245 +/- 143
62nd
5
1251 +/- 128
61st
5
1256 +/- 30
61st
6
1257 +/- 16
60th
6
1263 +/- 226
60th
12
1266 +/- 47
60th
7
1276 +/- 64
60th
11
1276 +/- 124
59th
6
1280 +/- 207
59th
12
1291 +/- 2
58th
14
1297 +/- 223
58th
18
1297 +/- 163
58th
9
1306 +/- 197
57th
73
1308 +/- 271
57th
51
1311 +/- 312
57th
4
1322 +/- 33
57th
15
1323 +/- 131
56th
21
1330 +/- 7
56th
3
1333 +/- 198
56th
15
1336 +/- 37
55th
5
1341 +/- 210
55th
14
1344 +/- 64
55th
11
1345 +/- 193
55th
5
1347 +/- 51
55th
29
1348 +/- 33
54th
7
1350 +/- 263
54th
17
1350 +/- 246
54th
19
1351 +/- 197
53rd
29
1372 +/- 193
53rd
11
1385 +/- 269
52nd
16
1409 +/- 73
52nd
18
1411 +/- 32
52nd
10
1411 +/- 189
52nd
4
1415 +/- 232
Median
50th
1437
50th
10
1453 +/- 232
50th
15
1456 +/- 269
49th
17
1471 +/- 3
48th
9
1480 +/- 150
48th
11
1482 +/- 207
48th
5
1494 +/- 16
48th
7
1495 +/- 12
48th
17
1498 +/- 236
48th
4
1501 +/- 22
47th
30
1504 +/- 236
47th
8
1517 +/- 191
46th
31
1537 +/- 183
46th
3
1537 +/- 184
46th
20
1540 +/- 208
46th
5
1540 +/- 122
45th
30
1555 +/- 221
45th
3
1579 +/- 292
44th
8
1585 +/- 180
44th
19
1593 +/- 320
44th
6
1608 +/- 63
44th
39
1608 +/- 217
43rd
7
1615 +/- 214
43rd
22
1617 +/- 209
43rd
3
1618 +/- 353
43rd
13
1618 +/- 227
43rd
11
1621 +/- 325
43rd
38
1640 +/- 187
41st
4
1686 +/- 186
41st
3
1691 +/- 266
40th
7
1715 +/- 173
40th
4
1729 +/- 204
40th
14
1731 +/- 256
40th
5
1743 +/- 124
39th
3
1748 +/- 52
39th
9
1750 +/- 313
39th
15
1761 +/- 36
38th
3
1762 +/- 396
38th
49
1765 +/- 396
38th
10
1783 +/- 321
38th
5
1790 +/- 74
37th
5
1810 +/- 87
36th
4
1848 +/- 5
35th
4
1913 +/- 210
35th
4
1935 +/- 9
34th
3
1955 +/- 296
34th
3
1959 +/- 586
34th
32
1960 +/- 390
34th
6
1969 +/- 477
34th
3
2003 +/- 106
34th
21
2003 +/- 220
33rd
18
2029 +/- 256
33rd
3
2052 +/- 341
33rd
6
2063 +/- 348
32nd
3
2068 +/- 274
32nd
4
2076 +/- 272
32nd
3
2081 +/- 268
32nd
4
2108 +/- 101
32nd
4
2149 +/- 4
31st
17
2203 +/- 489
30th
12
2211 +/- 5
30th
5
2218 +/- 543
29th
8
2293 +/- 236
29th
3
2360 +/- 152
29th
4
2364 +/- 302
29th
4
2369 +/- 312
28th
5
2402 +/- 183
28th
11
2405 +/- 194
28th
4
2445 +/- 353
27th
49
2509 +/- 8
27th
4
2519 +/- 349
27th
13
2530 +/- 562
26th
49
2563 +/- 411
26th
21
2600 +/- 63
Low-Tier
25th
> 2608
25th
84
2620 +/- 5
24th
8
2653 +/- 556
23rd
4
2759 +/- 610
22nd
9
2809 +/- 267
22nd
10
2830 +/- 48
22nd
11
2849 +/- 552
19th
6
3113 +/- 129
19th
14
3228 +/- 673
18th
4
3515 +/- 231
18th
9
3534 +/- 11
17th
5
3606 +/- 371
17th
7
3779
17th
4
3789 +/- 369
16th
4
3936 +/- 877
16th
18
3940 +/- 431
16th
10
4100 +/- 166
14th
29
4634 +/- 148
13th
88
4791 +/- 1151
13th
65
4834 +/- 661
13th
18
4893 +/- 681
13th
4
4953 +/- 40
12th
17
5101 +/- 552
12th
35
5127 +/- 390
12th
6
5185 +/- 262
12th
14
5205 +/- 509
10th
3
5496 +/- 1224
10th
13
5511 +/- 25
10th
3
5622 +/- 498
10th
7
5861 +/- 1268
9th
3
6132 +/- 680
9th
6
6614 +/- 747
8th
29
6795 +/- 259
8th
3
6851 +/- 243
8th
4
6931 +/- 302
8th
10
7041 +/- 787
8th
45
7100 +/- 1570
7th
24
7327 +/- 4
7th
16
8010 +/- 1316
6th
30
9148 +/- 1348
5th
3
12021 +/- 570
4th
10
14005
3rd
9
16433 +/- 3208
2nd
57
20794 +/- 2565
1st
27
32715 +/- 6612
OpenBenchmarking.orgDistribution Of Public Results - Total For Average Test Times6052 Results Range From 688 To 1733771 Milliseconds6883535070012104674139336173998208660243322277984312646347308381970416632451294485956520618555280589942624604659266693928728590763252797914832576867238901900936562971224100588610405481075210110987211445341179196121385812485201283182131784413525061387168142183014564921491154152581615604781595140162980216644641699126173378813002600390052006500

Based on OpenBenchmarking.org data, the selected test / test configuration (PyBench 2018-02-16 - Total For Average Test Times) has an average run-time of 3 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkTotal For Average Test TimesRun-Time1224364860Min: 1 / Avg: 2.92 / Max: 60

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.1%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsTotal For Average Test TimesDeviation246810Min: 0 / Avg: 0.14 / Max: 3

Recent Test Results

OpenBenchmarking.org Results Compare

8 Systems - 28 Benchmark Results

ARMv7 - BCM2835 Raspberry Pi Zero W Rev 1.1 - 425MB

Arch Linux ARM - 5.4.83-3-ARCH - GCC 10.2.0

4 Systems - 14 Benchmark Results

Intel Core i5-7200U - Dell 0XT0D3 - Intel Xeon E3-1200 v6

Debian 10 - 4.19.0-13-amd64 - GNOME Shell 3.30.2

1 System - 14 Benchmark Results

Intel Core i7-4870HQ - Apple MacBook Pro - Apple SSD

macOS 10.15.7 - 19.6.0 - X Server 1.18.4

1 System - 1 Benchmark Result

Intel Celeron J3455E - American Megatrends N1502AHRTF7.A0L4HW8D.ROM.P007 - Intel Celeron N3350

Ubuntu 21.04 - 5.8.0-36-generic - KDE Plasma 5.20.5

1 System - 1 Benchmark Result

Intel Xeon E5-2689 0 - American Megatrends 4.6.5 - Intel Xeon E5

Ubuntu 20.10 - 5.8.0-28-generic - GNOME Shell 3.38.1

1 System - 23 Benchmark Results

AMD Ryzen 5 4600H - HUAWEI HLYL-WXX9-PCB - AMD Renoir Root Complex

Ubuntu 20.10 - 5.8.0-25-generic - Budgie

1 System - 1 Benchmark Result

AMD Ryzen 7 5800X 8-Core - ASUS ROG STRIX X470-F GAMING - AMD Starship

Ubuntu 20.04 - 5.10.0-051000-generic - GNOME Shell 3.36.4

1 System - 1 Benchmark Result

AMD Ryzen 7 1800X Eight-Core - ASUS ROG STRIX X470-F GAMING - AMD 17h

Ubuntu 20.04 - 5.8.0-38-generic - GNOME Shell 3.36.4

4 Systems - 42 Benchmark Results

ARMv8 Cortex-A72 - Helios64 - Fuzhou Rockchip RK3399

Debian 10 - 5.9.14-rockchip64 - GCC 8.3.0

1 System - 1 Benchmark Result

AMD Ryzen 9 5900X 12-Core - ASUS ROG STRIX X570-E GAMING - AMD Starship

Ubuntu 20.04 - 5.8.0-36-generic - GNOME Shell 3.36.4

7 Systems - 43 Benchmark Results

ARMv8 Cortex-A53 - Libre Board ALL-H3-CC H5 - 2048MB

Raspbian 9.6 - 4.18.0-rc3-gfc36def997cf-dirty - X Server 1.19.2

Most Popular Test Results

OpenBenchmarking.org Results Compare

16 Systems - 119 Benchmark Results

2 x Intel Xeon Silver 4216 - GIGABYTE MD61-SC2-00 v01000100 - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.04 - 5.4.0-18-generic - GNOME Shell 3.36.0

2 Systems - 535 Benchmark Results

Intel Core i7-1065G7 - Dell 06CDVY - Intel Device 34ef

Ubuntu 20.04 - 5.9.0-050900rc7daily20201003-generic - GNOME Shell 3.36.4

12 Systems - 593 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Ubuntu 20.04 - 5.8.0-050800daily20200622-generic - GNOME Shell 3.36.2

11 Systems - 217 Benchmark Results

Intel Core i5-10600K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4

4 Systems - 55 Benchmark Results

AMD Ryzen 3 3200U - MOTILE PF4PU1F - AMD Raven

Fedora 31 - 5.4.15-200.fc31.x86_64 - GNOME Shell 3.34.3

4 Systems - 99 Benchmark Results

Intel Core i7-1165G7 - Dell 0GG9PT - Intel Tiger Lake-LP

Ubuntu 20.10 - 5.9.2-050902-generic - GNOME Shell 3.38.1

12 Systems - 209 Benchmark Results

Intel Core i5-9400F - MSI B360M GAMING PLUS - Intel Cannon Lake PCH

Ubuntu 19.04 - 5.2.0-999-generic - GNOME Shell 3.32.1

8 Systems - 360 Benchmark Results

AMD Ryzen Threadripper 2970WX 24-Core - Gigabyte X399 AORUS Gaming 7 - AMD 17h

Ubuntu 19.10 - 5.4.0-999-generic - GNOME Shell 3.34.1

3 Systems - 174 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Fedora 32 - 5.8.11-200.fc32.x86_64 - GNOME Shell 3.36.6

1 System - 1004 Benchmark Results

SiFive RISC-V - FriendlyElec NanoPC-T4 - Rockchip RK3399

Ubuntu 18.04 - 4.4.138 - LXDE 0.9.3

13 Systems - 36 Benchmark Results

AMD EPYC 7571 - Amazon EC2 m5a.2xlarge - Intel 440FX 82441FX PMC

Ubuntu 18.04 - 4.15.0-1021-aws - GCC 7.3.0

5 Systems - 1840 Benchmark Results

Intel Core i5-6200U - HP 8079 - Intel Xeon E3-1200 v5

Ubuntu 18.04 - 4.18.0-21-generic - GNOME Shell 3.28.4

Find More Test Results

OpenBenchmarking.org Community User Comments

Post A Comment