ASKAP

ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark askap.

Project Site

github.com

Test Created

10 November 2015

Last Updated

24 January 2021

Test Maintainer

Michael Larabel

Test Type

Graphics

Average Install Time

8 Seconds

Average Run Time

1 Minute, 40 Seconds

Test Dependencies

C/C++ Compiler Toolchain + OpenCL + OpenMPI

Accolades

90k+ Downloads + Recently Updated Test Profile

Supported Platforms


Public Result UploadsReported Installs*Test Completions*OpenBenchmarking.orgEventsASKAP tConvolveCuda Popularity Statisticspts/askap2015.112016.012016.032016.052016.072016.102016.122017.022017.042017.062017.082017.102017.122018.032018.072018.092018.112019.012019.042019.062019.082019.102019.122020.022020.042020.062020.082020.102020.1230060090012001500
* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Tue, 26 Jan 2021 02:49:02 GMT.
tConvolve OpenMP29.3%Hogbom Clean OpenMP13.5%tConvolve MT29.3%tConvolve MPI28.0%Test Option PopularityOpenBenchmarking.org

Revision History

pts/askap-2.1.0   [View Source]   Sun, 24 Jan 2021 16:58:25 GMT
Update against ASKAP 1.0 upstream.

pts/askap-2.0.1   [View Source]   Sat, 19 Oct 2019 20:43:41 GMT
Add --allow-run-as-root

pts/askap-2.0.0   [View Source]   Fri, 18 Oct 2019 19:38:09 GMT
Add MPI, OpenMP, OpenCL tests and other improvements.

pts/askap-1.0.0   [View Source]   Tue, 10 Nov 2015 12:58:45 GMT
Add ASKAP CUDA test.

Suites Using This Test

Multi-Core

MPI Benchmarks

HPC - High Performance Computing


Performance Metrics

Analyze Test Configuration:

ASKAP 1.0

Test: tConvolve OpenMP - Degridding

OpenBenchmarking.org metrics for this test profile configuration based on 99 public results since 24 January 2021 with the latest data as of 26 January 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Matching Public Results
Million Grid Points Per Second (Average)
96th
3
4717 +/- 22
86th
4
3633 +/- 10
Mid-Tier
75th
< 3469
69th
4
2252 +/- 5
65th
3
2155 +/- 9
62nd
5
2131 +/- 3
56th
3
2047 +/- 13
55th
4
2034 +/- 3
Median
50th
1929
43rd
5
1854 +/- 55
40th
6
1794 +/- 221
36th
3
1691 +/- 156
Low-Tier
25th
< 1572
25th
3
1572 +/- 2
22nd
4
1455 +/- 3
13th
3
1300 +/- 1
10th
3
1183 +/- 2
3rd
3
653 +/- 3
OpenBenchmarking.orgDistribution Of Public Results - Test: tConvolve OpenMP - Degridding99 Results Range From 649 To 4734 Million Grid Points Per Second64973181389597710591141122313051387146915511633171517971879196120432125220722892371245325352617269927812863294530273109319132733355343735193601368337653847392940114093417542574339442145034585466747493691215

Based on OpenBenchmarking.org data, the selected test / test configuration (ASKAP 1.0 - Test: tConvolve OpenMP - Degridding) has an average run-time of 2 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkTest: tConvolve OpenMP - DegriddingRun-Time246810Min: 1 / Avg: 1.42 / Max: 5

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.9%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsTest: tConvolve OpenMP - DegriddingDeviation3691215Min: 0 / Avg: 0.87 / Max: 11

Recent Test Results

OpenBenchmarking.org Results Compare

3 Systems - 82 Benchmark Results

AMD Ryzen 7 2700 Eight-Core - Gigabyte AB350N-Gaming WIFI-CF - AMD 17h

Ubuntu 19.10 - 5.9.0-050900rc7daily20201004-generic - GNOME Shell 3.34.1

4 Systems - 47 Benchmark Results

2 x Intel Xeon Gold 5220R - TYAN S7106 - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.04 - 5.9.0-050900rc6-generic - GNOME Shell 3.36.4

4 Systems - 54 Benchmark Results

AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship

Ubuntu 20.10 - 5.11.0-rc1-phx - GNOME Shell 3.38.1

3 Systems - 13 Benchmark Results

AMD Ryzen 7 3800XT 8-Core - MSI X370 XPOWER GAMING TITANIUM - AMD Starship

Debian 10 - 4.19.0-13-amd64 - X Server 1.20.4

3 Systems - 7 Benchmark Results

AMD Ryzen Threadripper 2990WX 32-Core - ASUS ROG ZENITH EXTREME - AMD 17h

Ubuntu 20.10 - 5.8.0-34-generic - GNOME Shell 3.38.1

3 Systems - 13 Benchmark Results

Intel Xeon Silver 4216 - TYAN S7100AG2NR - Intel Sky Lake-E DMI3 Registers

Debian 10 - 4.19.0-9-amd64 - GNOME Shell 3.30.2

3 Systems - 7 Benchmark Results

Intel Xeon E3-1235L v5 - ASRockRack C236M WS - Intel Xeon E3-1200 v5

Ubuntu 20.04 - 5.8.0-050800-generic - GNOME Shell 3.36.4

3 Systems - 7 Benchmark Results

AMD EPYC 7601 32-Core - TYAN B8026T70AE24HR - AMD 17h

Ubuntu 20.04 - 5.4.0-58-generic - GNOME Shell 3.36.4

4 Systems - 7 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Ubuntu 20.10 - 5.11.0-rc1-phx - GNOME Shell 3.38.1

3 Systems - 376 Benchmark Results

2 x AMD EPYC 7F72 24-Core - Supermicro H11DSi-NT v2.00 - AMD Starship

Ubuntu 20.10 - 5.11.0-rc4-max-boost-inv-patch - GNOME Shell 3.38.1

4 Systems - 13 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship

Pop 20.10 - 5.8.0-7630-generic - GNOME Shell 3.38.2

3 Systems - 99 Benchmark Results

AMD EPYC 7601 32-Core - TYAN B8026T70AE24HR - AMD 17h

Ubuntu 20.04 - 5.4.0-58-generic - GNOME Shell 3.36.4

Most Popular Test Results

Find More Test Results

OpenBenchmarking.org Community User Comments

Post A Comment