Timed Gem5 Compilation

This test times how long it takes to compile Gem5. Gem5 is a simulator for computer system architecture research. Gem5 is widely used for computer architecture research within the industry, academia, and more.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark build-gem5.

Project Site

gem5.org

Source Repository

gem5.googlesource.com

Test Created

28 January 2022

Test Maintainer

Michael Larabel 

Test Type

Processor

Average Install Time

2 Seconds

Average Run Time

23 Minutes, 35 Seconds

Test Dependencies

C/C++ Compiler Toolchain + SCons + Python + Zlib + Protobuf + C++ Boost

Accolades

5k+ Downloads

Supported Platforms


Public Result Uploads *Reported Installs **Reported Test Completions **Test Profile Page ViewsOpenBenchmarking.orgEventsTimed Gem5 Compilation Popularity Statisticspts/build-gem52022.012022.022022.032022.042022.052022.062022.072022.082022.092022.102022.112022.122023.012023.022023.032023.042023.0512002400360048006000
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of 26 May 2023.

Revision History

pts/build-gem5-1.0.0   [View Source]   Fri, 28 Jan 2022 07:49:09 GMT
Initial commit of Gem5 compilation benchmark.

Suites Using This Test

Timed Code Compilation

Multi-Core

Programmer / Developer System Benchmarks


Performance Metrics

Analyze Test Configuration:

Timed Gem5 Compilation 21.2

Time To Compile

OpenBenchmarking.org metrics for this test profile configuration based on 992 public results since 28 January 2022 with the latest data as of 24 May 2023.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
Seconds (Average)
97th
8
144 +/- 3
96th
8
150 +/- 1
82nd
8
176 +/- 5
79th
19
181 +/- 16
77th
21
184 +/- 15
Mid-Tier
75th
> 186
74th
12
188 +/- 17
74th
13
188 +/- 14
70th
7
196 +/- 10
65th
3
204 +/- 16
65th
7
206 +/- 5
64th
8
209 +/- 13
60th
12
221 +/- 17
59th
3
228 +/- 4
52nd
28
244 +/- 17
Median
50th
250
50th
3
250 +/- 12
50th
6
251 +/- 16
43rd
5
288 +/- 5
41st
10
304 +/- 11
40th
3
307 +/- 21
38th
6
331 +/- 8
37th
3
339 +/- 1
36th
12
350 +/- 6
33rd
10
370 +/- 26
31st
4
386 +/- 1
31st
3
387 +/- 7
30th
12
389 +/- 23
26th
5
440 +/- 17
26th
4
448 +/- 3
Low-Tier
25th
> 448
23rd
6
497 +/- 9
22nd
7
511 +/- 47
21st
3
523 +/- 1
21st
3
527 +/- 1
20th
4
540 +/- 22
19th
7
562 +/- 37
19th
3
563 +/- 1
17th
9
580 +/- 11
16th
5
596 +/- 23
15th
6
631 +/- 54
15th
3
647 +/- 2
13th
5
708 +/- 24
12th
5
753 +/- 9
11th
5
789 +/- 3
11th
4
815 +/- 70
9th
3
915 +/- 1
8th
6
935 +/- 24
8th
5
944 +/- 17
7th
4
980 +/- 42
7th
3
1007 +/- 8
6th
3
1098 +/- 1
6th
3
1129 +/- 19
4th
5
1366 +/- 116
2nd
3
1673 +/- 1
2nd
3
2070 +/- 105
1st
4
2482 +/- 3
OpenBenchmarking.orgDistribution Of Public Results - Time To Compile988 Results Range From 134 To 4297 Seconds134218302386470554638722806890974105811421226131013941478156216461730181418981982206621502234231824022486257026542738282229062990307431583242332634103494357836623746383039143998408241664250433480160240320400

Based on OpenBenchmarking.org data, the selected test / test configuration (Timed Gem5 Compilation 21.2 - Time To Compile) has an average run-time of 19 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkTime To CompileRun-Time20406080100Min: 7 / Avg: 18.85 / Max: 93

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.3%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsTime To CompileDeviation246810Min: 0 / Avg: 0.33 / Max: 6

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

IntelAMDOpenBenchmarking.orgRelative Core Scaling To BaseTimed Gem5 Compilation CPU Core ScalingTime To Compile4681012162432641.783.565.347.128.9

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture
Kernel Identifier
Verified On
Intel / AMD x86 64-bit
x86_64
(Many Processors)
ARMv8 64-bit
aarch64
ARMv8 Cortex-A72, ARMv8 Cortex-X1C, ARMv8 Neoverse-N1, ARMv8 Neoverse-N1 32-Core, ARMv8 Neoverse-V1, Ampere ARMv8 Neoverse-N1 128-Core, Ampere ARMv8 Neoverse-N1 160-Core, Ampere ARMv8 Neoverse-N1 256-Core, Apple M1 Pro

Recent Test Results

OpenBenchmarking.org Results Compare

1 System - 21 Benchmark Results

2 x Intel Xeon E5-2698 v4 - Supermicro X10DRI-T - Intel Xeon E7 v4

Ubuntu 22.04 - 6.3.0-060300-generic - GNOME Shell 42.5

1 System - 21 Benchmark Results

2 x AMD Eng Sample - ASUS K14PP-D24 - AMD Device 14a4

Ubuntu 22.04 - 6.3.0-060300-generic - GNOME Shell 42.5

1 System - 21 Benchmark Results

2 x AMD EPYC 7T83 64-Core - Supermicro H12DSi-NT6 v1.02 - AMD Starship

Ubuntu 22.04 - 6.3.0-060300-generic - GNOME Shell 42.5

1 System - 21 Benchmark Results

2 x AMD EPYC 7763 64-Core - ASUS KMPG-D32 - AMD Starship

Ubuntu 22.04 - 6.2.0-060200-generic - GNOME Shell 42.5

1 System - 21 Benchmark Results

2 x AMD EPYC 7T83 64-Core - Supermicro H12DSi-NT6 v1.02 - AMD Starship

Ubuntu 22.04 - 6.3.0-060300-generic - GNOME Shell 42.5

1 System - 17 Benchmark Results

Intel Core i7-13700 - Gigabyte B660M DS3H DDR4 - Intel Device 7aa7

Linuxmint 21.1 - 6.3.3-060303-generic - Cinnamon 5.6.8

1 System - 17 Benchmark Results

Intel Core i7-13700 - Gigabyte B660M DS3H DDR4 - Intel Device 7aa7

Linuxmint 21.1 - 6.3.3-060303-generic - Cinnamon 5.6.8

1 System - 76 Benchmark Results

AMD Ryzen 7 7700X 8-Core - MSI MAG X670E TOMAHAWK WIFI - AMD Device 14d8

Arch rolling - 6.3.3-arch1-1 - KDE Plasma 5.27.5

53 Systems - 144 Benchmark Results

Apple M1 Pro - Apple Virtualization Generic v1 - Apple Device f020

Ubuntu 22.04 - 5.15.0-70-generic - GCC 11.3.0

1 System - 21 Benchmark Results

AMD Ryzen 9 5950X 16-Core - ASUS TUF GAMING X570-PLUS - AMD Starship

Gentoo 2.13 - 6.3.1-gentoo-x86_64 - KDE Plasma 5.27.5

52 Systems - 144 Benchmark Results

Apple M1 Pro - Apple Virtualization Generic v1 - Apple Device f020

Ubuntu 22.04 - 5.15.0-70-generic - X Server

6 Systems - 21 Benchmark Results

ARMv8 Neoverse-N1 - Amazon EC2 r6g.xlarge - Amazon Device 0200

Amazon 2 - 4.14.313-235.533.amzn2.aarch64 - GCC 7.3.1 20180712

5 Systems - 21 Benchmark Results

ARMv8 Neoverse-N1 - Amazon EC2 c6g.xlarge - Amazon Device 0200

Amazon 2 - 4.14.309-231.529.amzn2.aarch64 - GCC 7.3.1 20180712

5 Systems - 21 Benchmark Results

Intel Xeon Platinum 8375C - Amazon EC2 c6i.xlarge - 8GB

Amazon 2 - 4.14.311-233.529.amzn2.x86_64 - GCC 7.3.1 20180712

1 System - 21 Benchmark Results

AMD Ryzen 9 5900X 12-Core - ASUS TUF GAMING B550-PLUS WIFI II - AMD Starship

Ubuntu 23.04 - 6.2.0-20-generic - GNOME Shell 44.0

Most Popular Test Results

OpenBenchmarking.org Results Compare

5 Systems - 94 Benchmark Results

ARMv8 Neoverse-V1 - Amazon EC2 c7g.4xlarge - Amazon Device 0200

Ubuntu 22.04 - 5.15.0-1004-aws - GCC 11.2.0

13 Systems - 333 Benchmark Results

AMD Ryzen 5 5600X 6-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 22.04 - 6.0.0-060000rc1daily20220820-generic - GNOME Shell 42.2

7 Systems - 293 Benchmark Results

Intel Core i7-1185G7 - Dell 0DXP1F - Intel Tiger Lake-LP

Pop 22.04 - 5.17.5-76051705-generic - GNOME Shell 42.1

2 Systems - 26 Benchmark Results

AMD Ryzen 7 5700G - ASUS TUF GAMING B550M-PLUS - AMD Renoir

Ubuntu 21.10 - 5.16.0-051600rc8daily20220108-generic - GNOME Shell 40.5

2 Systems - 22 Benchmark Results

2 x Intel Xeon Platinum 8280 - GIGABYTE MD61-SC2-00 v01000100 - Intel Sky Lake-E DMI3 Registers

Ubuntu 21.04 - 5.11.0-40-generic - GNOME Shell 3.38.4

2 Systems - 358 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - Gigabyte TRX40 DESIGNARE - AMD Starship

Ubuntu 20.04 - 5.13.0-28-generic - X Server 1.20.11

6 Systems - 26 Benchmark Results

AMD Ryzen 7 5700G - ASUS TUF GAMING B550M-PLUS - AMD Renoir

Ubuntu 21.10 - 5.16.0-051600rc8daily20220108-generic - GNOME Shell 40.5

3 Systems - 93 Benchmark Results

Intel Core i7-8700K - ASUS TUF Z370-PLUS GAMING - Intel 8th Gen Core

Ubuntu 20.04 - 5.9.0-050900rc6daily20200923-generic - GNOME Shell 3.36.4

3 Systems - 51 Benchmark Results

Intel Core i5-12400 - ASRock B660M-HDV - Intel Device 7aa7

Ubuntu 22.04 - 5.15.0-18-generic - GNOME Shell 41.3

Find More Test Results