CppPerformanceBenchmarks

CppPerformanceBenchmarks is a set of C++ compiler performance benchmarks.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark cpp-perf-bench.

Project Site

gitlab.com

Test Created

3 January 2019

Last Updated

3 January 2019

Test Maintainer

Michael Larabel 

Test Type

System

Average Install Time

1 Minute, 49 Seconds

Average Run Time

11 Minutes, 21 Seconds

Test Dependencies

C/C++ Compiler Toolchain

Accolades

20k+ Downloads

Supported Platforms


Public Result UploadsReported Installs*Test Completions*OpenBenchmarking.orgEventsCppPerformanceBenchmarks Popularity Statisticspts/cpp-perf-bench2019.012019.022019.032019.042019.052019.062019.072019.082019.092019.102019.112019.122020.012020.022020.032020.042020.052020.062020.072020.082020.092020.102020.112020.122021.012021.022021.0312002400360048006000
* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Mon, 08 Mar 2021 10:17:42 GMT.
Function Objects15.6%Ctype15.6%Stepanov Vector13.6%Random Numbers12.0%Math Library13.6%Atol13.9%Stepanov Abstraction15.7%Test Option PopularityOpenBenchmarking.org

Revision History

pts/cpp-perf-bench-1.0.0   [View Source]   Thu, 03 Jan 2019 07:56:07 GMT
Initial commit of CppPerformanceBenchmarks.

Suites Using This Test

C/C++ Compiler Tests

CPU Massive

Single-Threaded


Performance Metrics

Analyze Test Configuration:

CppPerformanceBenchmarks 9

Test: Stepanov Abstraction

OpenBenchmarking.org metrics for this test profile configuration based on 746 public results since 3 January 2019 with the latest data as of 3 March 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Matching Public Results
Seconds (Average)
90th
6
19.5 +/- 0.4
82nd
12
28.3 +/- 0.8
81st
9
28.3 +/- 2.0
78th
6
28.7 +/- 0.2
78th
6
28.7 +/- 0.2
76th
6
29.0 +/- 1.6
Mid-Tier
75th
> 29.0
75th
6
29.1 +/- 0.1
71st
4
30.6 +/- 0.7
61st
4
31.8 +/- 1.9
60th
4
32.1 +/- 1.8
60th
4
32.4 +/- 2.0
58th
25
32.5 +/- 1.1
56th
4
33.4 +/- 1.1
53rd
3
34.4 +/- 0.1
51st
14
35.0 +/- 1.6
Median
50th
35.5
48th
3
36.7 +/- 1.6
48th
4
36.8 +/- 0.5
47th
4
37.3 +/- 0.2
44th
3
39.3 +/- 0.4
31st
4
44.1 +/- 1.3
29th
4
45.4 +/- 1.4
29th
4
46.5 +/- 2.0
Low-Tier
25th
> 47.8
18th
7
48.2 +/- 2.9
15th
3
55.5 +/- 0.1
5th
69
55.6
5th
4
55.8 +/- 3.3
5th
4
56.2 +/- 2.1
OpenBenchmarking.orgDistribution Of Public Results - Test: Stepanov Abstraction746 Results Range From 18 To 223 Seconds18324660748810211613014415817218620021422870140210280350

Based on OpenBenchmarking.org data, the selected test / test configuration (CppPerformanceBenchmarks 9 - Test: Stepanov Abstraction) has an average run-time of 2 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkTest: Stepanov AbstractionRun-Time3691215Min: 1 / Avg: 2.09 / Max: 7

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.2%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsTest: Stepanov AbstractionDeviation246810Min: 0 / Avg: 0.23 / Max: 3

Recent Test Results

OpenBenchmarking.org Results Compare

1 System - 8 Benchmark Results

Intel Core i5-10210U - Intel NUC10i5FNB - Intel Device 02ef

Ubuntu 20.04 - 5.4.0-65-generic - Xfce 4.14

1 System - 4 Benchmark Results

Intel Core i5-10210U - Intel NUC10i5FNB - Intel Device 02ef

Ubuntu 20.04 - 5.4.0-65-generic - Xfce 4.14

3 Systems - 156 Benchmark Results

Intel Core i7-10700T - Insyde CometLake TBD by OEM - Intel

FreeBSD - 12.2-RELEASE - Clang 10.0.1

2 Systems - 156 Benchmark Results

Intel Xeon E-2278GEL - Logic Supply RXM-181 TBD by OEM - Intel

FreeBSD - 12.2-RELEASE - Clang 10.0.1

5 Systems - 159 Benchmark Results

Intel Xeon E-2278GEL - Logic Supply RXM-181 TBD by OEM - Intel

FreeBSD - 12.2-RELEASE - Clang 10.0.1

4 Systems - 198 Benchmark Results

Intel Xeon E-2278GEL - Logic Supply RXM-181 TBD by OEM - Intel

FreeBSD - 12.2-RELEASE - Clang 10.0.1

1 System - 7 Benchmark Results

Intel Core i7-10750H - 32GB - 954GB

Arch Linux - 4.4.0-19041-Microsoft - GCC 10.2.0

3 Systems - 125 Benchmark Results

AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.10 - 5.11.0-051100rc2daily20210108-generic - GNOME Shell 3.38.1

1 System - 7 Benchmark Results

AMD Ryzen 9 5900X 12-Core - 10GB - 275GB Virtual Disk

Ubuntu 20.04 - 5.10.2-microsoft-standard - GCC 9.3.0 + Clang 10.0.0-4ubuntu1

1 System - 1 Benchmark Result

AMD Ryzen 9 5900X 12-Core - 10GB - 275GB Virtual Disk

Ubuntu 20.04 - 5.10.2-microsoft-standard - GCC 9.3.0 + Clang 10.0.0-4ubuntu1

1 System - 1 Benchmark Result

AMD Ryzen 9 5900X 12-Core - 10GB - 275GB Virtual Disk

Ubuntu 20.04 - 5.10.2-microsoft-standard - GCC 9.3.0 + Clang 10.0.0-4ubuntu1

1 System - 1 Benchmark Result

AMD Ryzen 9 5900X 12-Core - 10GB - 275GB Virtual Disk

Ubuntu 20.04 - 5.10.2-microsoft-standard - GCC 9.3.0 + Clang 10.0.0-4ubuntu1

Most Popular Test Results

OpenBenchmarking.org Results Compare

3 Systems - 301 Benchmark Results

Intel Core i5-10600K - ASUS PRIME Z490M-PLUS - Intel Comet Lake PCH

Ubuntu 20.04 - 5.4.0-40-generic - GNOME Shell 3.36.3

2 Systems - 475 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Ubuntu 19.10 - 5.3.0-40-generic - GNOME Shell 3.34.1

2 Systems - 51 Benchmark Results

AMD Ryzen 7 1800X Eight-Core - MSI X370 XPOWER GAMING TITANIUM - AMD Family 17h

Ubuntu 19.04 - 4.20.0-999-generic - GNOME Shell 3.30.1

12 Systems - 383 Benchmark Results

AMD Ryzen 9 5900X 12-Core - Gigabyte B550I AORUS PRO AX - AMD Starship

Ubuntu 20.04 - 5.4.0-53-generic - GNOME Shell 3.36.4

48 Systems - 62 Benchmark Results

AMD FX-8370E Eight-Core - ASUS M5A99FX PRO R2.0 - AMD RD9x0

Ubuntu 18.10 - 4.18.0-13-generic - GNOME Shell 3.30.1

6 Systems - 119 Benchmark Results

2 x Intel Xeon Platinum 8280 - GIGABYTE MD61-SC2-00 v01000100 - Intel Sky Lake-E DMI3 Registers

openSUSE Leap 15.0 - 4.12.14-lp150.12.48-default - GCC 7.3.1 20180323 [gcc-7-branch revision 258812]

Find More Test Results