Timed LLVM Compilation

This test times how long it takes to build the LLVM compiler.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark build-llvm.

Project Site

llvm.org

Test Created

27 August 2017

Last Updated

16 April 2021

Test Maintainer

Michael Larabel 

Test Type

Processor

Average Install Time

1 Second

Average Run Time

22 Minutes, 35 Seconds

Test Dependencies

C/C++ Compiler Toolchain + CMake + Python

Accolades

100k+ Downloads + Recently Updated Test Profile

Supported Platforms


Public Result UploadsReported Installs*Test Completions*OpenBenchmarking.orgEventsTimed LLVM Compilation Popularity Statisticspts/build-llvm2017.082017.102017.122018.022018.042018.062018.082018.102018.122019.022019.042019.062019.082019.102019.122020.022020.042020.062020.082020.102020.122021.022021.046K12K18K24K30K
* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Thu, 06 May 2021 08:58:01 GMT.
Unix Makefiles49.7%Ninja50.3%Build System Option PopularityOpenBenchmarking.org

Revision History

pts/build-llvm-1.3.1   [View Source]   Fri, 16 Apr 2021 08:04:57 GMT
Fix possible shell script issue based on the interpreter.

pts/build-llvm-1.3.0   [View Source]   Fri, 16 Apr 2021 05:40:02 GMT
Update against LLVM 12.0 upstream, also add build system option for those wanting Ninja builds.

pts/build-llvm-1.2.1   [View Source]   Sat, 12 Sep 2020 16:11:15 GMT
Drop Windows support as it seems to have problems running now.

pts/build-llvm-1.2.0   [View Source]   Tue, 24 Mar 2020 14:28:14 GMT
Update against LLVM 10.0.

pts/build-llvm-1.1.0   [View Source]   Wed, 15 Aug 2018 08:56:02 GMT
Update against LLVM 6.0.1 upstream as LLVM 4.0 these days seems to be having build problems under newer compilers.

pts/build-llvm-1.0.1   [View Source]   Thu, 08 Mar 2018 19:17:13 GMT
Windows support.

pts/build-llvm-1.0.0   [View Source]   Sun, 27 Aug 2017 20:32:05 GMT
Initial commit of a timed LLVM compilation test profile.

Suites Using This Test

Timed Code Compilation

C/C++ Compiler Tests

Multi-Core

CPU Massive

Server CPU Tests

Programmer / Developer System Benchmarks


Performance Metrics

Analyze Test Configuration:

Timed LLVM Compilation 12.0

Build System: Ninja

OpenBenchmarking.org metrics for this test profile configuration based on 158 public results since 16 April 2021 with the latest data as of 5 May 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Matching Public Results
Seconds (Average)
Mid-Tier
75th
> 302
73rd
3
341 +/- 2
Median
50th
474
46th
3
497 +/- 1
34th
14
666 +/- 28
Low-Tier
25th
> 837
23rd
4
895 +/- 3
13th
3
1784 +/- 11
12th
3
1815 +/- 2
9th
3
2164 +/- 8
7th
3
2718 +/- 31
6th
3
2849 +/- 7
2nd
3
5072 +/- 26
OpenBenchmarking.orgDistribution Of Public Results - Build System: Ninja158 Results Range From 127 To 9549 Seconds12731650569488310721261145016391828201722062395258427732962315133403529371839074096428544744663485250415230541956085797598661756364655367426931712073097498768778768065825484438632882190109199938895771224364860

Based on OpenBenchmarking.org data, the selected test / test configuration (Timed LLVM Compilation 12.0 - Build System: Ninja) has an average run-time of 37 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkBuild System: NinjaRun-Time50100150200250Min: 2 / Avg: 36.28 / Max: 255

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.1%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsBuild System: NinjaDeviation246810Min: 0 / Avg: 0.05 / Max: 1

Recent Test Results

OpenBenchmarking.org Results Compare

3 Systems - 120 Benchmark Results

Ampere Altra ARMv8 Neoverse-N1 - WIWYNN Mt.Jade - Ampere Computing LLC Device e100

Ubuntu 20.04 - 5.11.0-051100-generic-64k - GNOME Shell 3.36.4

4 Systems - 132 Benchmark Results

2 x Intel Xeon Gold 5220R - TYAN S7106 - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.04 - 5.9.0-050900rc6-generic - GNOME Shell 3.36.4

1 System - 17 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Linuxmint 20.1 - 5.8.0-50-generic - Cinnamon 4.8.6

1 System - 30 Benchmark Results

AMD Ryzen 9 5950X 16-Core - ASRock X570 Pro4 - AMD Starship

Debian 10 - 4.19.0-16-amd64 - GNOME Shell 3.30.2

1 System - 30 Benchmark Results

AMD Ryzen 9 5950X 16-Core - ASRock X570 Pro4 - AMD Starship

Debian 10 - 4.19.0-16-amd64 - GNOME Shell 3.30.2

8 Systems - 188 Benchmark Results

2 x Intel Xeon Platinum 8380 - Intel M50CYP2SB2U - Intel Device 0998

Ubuntu 20.04 - 5.11.0-051100-generic - GNOME Shell 3.36.4

11 Systems - 18 Benchmark Results

AMD Ryzen 9 5950X 16-Core - Gigabyte X570 AORUS XTREME - AMD Starship

Arch rolling - 5.12.0 - Sway

1 System - 17 Benchmark Results

AMD FX-6100 Six-Core - MSI 760GMA-P34 - AMD RS780 + SB7x0

Fedora 33 - 5.11.16-200.fc33.x86_64 - GCC 10.3.1 20210422

1 System - 732 Benchmark Results

2 x Intel Xeon Platinum 8380 - Intel M50CYP2SB2U - Intel Device 0998

Ubuntu 20.04 - 5.11.6-051106-generic - GNOME Shell 3.36.4

1 System - 2 Benchmark Results

Intel Celeron G1610T - HP ProLiant MicroServer Gen8 - Intel Xeon E3-1200 v2

Ubuntu 20.04 - 5.8.0-43-generic - GNOME Shell 3.36.4

1 System - 2 Benchmark Results

Intel Core i5-7400 - ASRock H270M-ITX/ac - Intel Xeon E3-1200 v6

Fedora 34 - 5.11.15-300.fc34.x86_64 - GNOME Shell 40.0

4 Systems - 18 Benchmark Results

AMD Ryzen 9 5950X 16-Core - Gigabyte X570 AORUS XTREME - AMD Starship

Arch rolling - 5.12.0 - Sway

Most Popular Test Results

OpenBenchmarking.org Results Compare

7 Systems - 18 Benchmark Results

AMD Ryzen 9 5950X 16-Core - Gigabyte X570 AORUS XTREME - AMD Starship

Arch rolling - 5.11.16 - Sway

3 Systems - 2 Benchmark Results

AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.10 - 5.11.6-051106-generic - GNOME Shell 3.38.2

3 Systems - 5 Benchmark Results

Intel Core i7-8565U - Dell 0KTW76 - Intel Cannon Point-LP

Ubuntu 20.10 - 5.8.0-45-generic - GNOME Shell 3.38.2

3 Systems - 12 Benchmark Results

Intel Xeon E3-1235L v5 - ASRockRack C236M WS - Intel Xeon E3-1200 v5

Ubuntu 20.04 - 5.8.0-050800-generic - GNOME Shell 3.36.4

3 Systems - 50 Benchmark Results

AMD Ryzen 9 3900X 12-Core - ASUS TUF GAMING X570-PLUS - AMD Starship

Ubuntu 20.04 - 5.11.0-rc1-phx - GNOME Shell 3.36.4

3 Systems - 40 Benchmark Results

AMD Ryzen 7 3800XT 8-Core - MSI X370 XPOWER GAMING TITANIUM - AMD Starship

Debian 10 - 4.19.0-16-amd64 - X Server 1.20.4

3 Systems - 39 Benchmark Results

Intel Xeon Silver 4216 - TYAN S7100AG2NR - Intel Sky Lake-E DMI3 Registers

Debian 10 - 4.19.0-9-amd64 - GNOME Shell 3.30.2

3 Systems - 12 Benchmark Results

Intel Core i5-10600K - ASUS PRIME Z490M-PLUS - Intel Comet Lake PCH

Ubuntu 20.10 - 5.11.0-051100rc2daily20210106-generic - GNOME Shell 3.38.1

5 Systems - 16 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Ubuntu 20.04 - 5.9.0-050900daily20201012-generic - GNOME Shell 3.36.4

2 Systems - 34 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Ubuntu 20.10 - 5.11.0-rc6-phx - GNOME Shell 3.38.1

2 Systems - 701 Benchmark Results

Intel Core i9-11900K - ASUS ROG MAXIMUS XIII HERO - Intel Device 43ef

Ubuntu 20.10 - 5.12.0-051200rc8-generic - GNOME Shell 3.38.2

8 Systems - 18 Benchmark Results

AMD Ryzen 9 5950X 16-Core - Gigabyte X570 AORUS XTREME - AMD Starship

Arch rolling - 5.12.0 - Sway

Find More Test Results