ASKAP

ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark askap.

Project Site

github.com

Test Created

10 November 2015

Last Updated

24 January 2021

Test Maintainer

Michael Larabel 

Test Type

Graphics

Average Install Time

9 Seconds

Average Run Time

1 Minute, 42 Seconds

Test Dependencies

C/C++ Compiler Toolchain + OpenCL + OpenMPI

Accolades

90k+ Downloads

Supported Platforms


Public Result UploadsReported Installs*Test Completions*OpenBenchmarking.orgEventsASKAP tConvolveCuda Popularity Statisticspts/askap2015.112016.012016.032016.052016.072016.102016.122017.022017.042017.062017.082017.102017.122018.032018.072018.092018.112019.012019.042019.062019.082019.102019.122020.022020.042020.062020.082020.102020.122021.025001000150020002500
* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Sun, 07 Mar 2021 14:36:26 GMT.
tConvolve OpenMP29.9%Hogbom Clean OpenMP14.2%tConvolve MT26.1%tConvolve MPI29.8%Test Option PopularityOpenBenchmarking.org

Revision History

pts/askap-2.1.0   [View Source]   Sun, 24 Jan 2021 16:58:25 GMT
Update against ASKAP 1.0 upstream.

pts/askap-2.0.1   [View Source]   Sat, 19 Oct 2019 20:43:41 GMT
Add --allow-run-as-root

pts/askap-2.0.0   [View Source]   Fri, 18 Oct 2019 19:38:09 GMT
Add MPI, OpenMP, OpenCL tests and other improvements.

pts/askap-1.0.0   [View Source]   Tue, 10 Nov 2015 12:58:45 GMT
Add ASKAP CUDA test.

Suites Using This Test

Multi-Core

MPI Benchmarks

HPC - High Performance Computing


Performance Metrics

Analyze Test Configuration:

ASKAP 1.0

Test: tConvolve OpenMP - Degridding

OpenBenchmarking.org metrics for this test profile configuration based on 393 public results since 24 January 2021 with the latest data as of 8 March 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Matching Public Results
Million Grid Points Per Second (Average)
97th
5
6187 +/- 878
97th
3
5874 +/- 43
92nd
3
4717 +/- 22
89th
4
3862 +/- 250
85th
4
3633 +/- 10
82nd
3
3425 +/- 22
80th
6
3333 +/- 27
Mid-Tier
75th
< 3195
75th
15
3178 +/- 90
71st
3
2699 +/- 30
70th
3
2425 +/- 9
69th
3
2293 +/- 4
68th
3
2256 +/- 6
67th
4
2248 +/- 49
67th
5
2245 +/- 16
64th
3
2155 +/- 9
62nd
9
2114 +/- 42
62nd
8
2107 +/- 103
62nd
6
2078 +/- 73
61st
3
2045 +/- 3
58th
3
2019 +/- 9
57th
3
1999 +/- 27
56th
5
1932 +/- 6
54th
3
1878 +/- 7
53rd
3
1845 +/- 4
51st
6
1794 +/- 221
51st
8
1792 +/- 121
Median
50th
1787
49th
3
1778 +/- 2
46th
3
1720 +/- 2
46th
36
1701 +/- 5
38th
3
1691 +/- 156
34th
3
1590 +/- 20
33rd
6
1574 +/- 3
30th
5
1461 +/- 14
29th
3
1450 +/- 3
27th
5
1417 +/- 143
Low-Tier
25th
< 1394
25th
3
1366 +/- 25
25th
3
1359 +/- 5
23rd
3
1349 +/- 2
23rd
3
1332 +/- 19
21st
3
1315 +/- 1
20th
3
1291 +/- 1
19th
4
1287 +/- 25
17th
4
1218 +/- 4
16th
3
1211 +/- 24
15th
4
1179 +/- 9
14th
3
1164 +/- 9
14th
4
1161 +/- 2
12th
3
1154 +/- 1
11th
3
1057 +/- 4
11th
3
1017 +/- 3
10th
3
983 +/- 1
9th
3
965 +/- 4
8th
3
905 +/- 1
7th
3
762 +/- 9
6th
3
746 +/- 2
5th
3
653 +/- 3
4th
3
611 +/- 12
3rd
3
435 +/- 3
OpenBenchmarking.orgDistribution Of Public Results - Test: tConvolve OpenMP - Degridding389 Results Range From 143 To 8322 Million Grid Points Per Second1433074716357999631127129114551619178319472111227524392603276729313095325934233587375139154079424344074571473548995063522753915555571958836047621163756539670368677031719573597523768778518015817983431224364860

Based on OpenBenchmarking.org data, the selected test / test configuration (ASKAP 1.0 - Test: tConvolve OpenMP - Degridding) has an average run-time of 2 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkTest: tConvolve OpenMP - DegriddingRun-Time246810Min: 1 / Avg: 1.28 / Max: 5

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.4%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsTest: tConvolve OpenMP - DegriddingDeviation3691215Min: 0 / Avg: 0.44 / Max: 10

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

AMDIntelOpenBenchmarking.orgRelative Core Scaling To BaseASKAP tConvolveCuda CPU Core ScalingTest: tConvolve OpenMP - Degridding468121632641.49172.98344.47515.96687.4585

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
MOVD MULSD DIVSD CVTTSD2SI ADDSD CVTSI2SD MOVAPD UCOMISD CVTSD2SS XORPD COMISD SUBSD CVTSS2SD ANDPD
Last automated analysis: 30 January 2021

This test profile binary relies on the shared libraries libOpenCL.so.1, libm.so.6, libc.so.6, libdl.so.2.

Recent Test Results

OpenBenchmarking.org Results Compare

3 Systems - 66 Benchmark Results

AMD Ryzen 7 5800X 8-Core - ASRock X570 Pro4 - AMD Starship

Ubuntu 20.10 - 5.11.0-051100rc3daily20210116-generic - GNOME Shell 3.38.1

3 Systems - 84 Benchmark Results

Intel Core i7-2700K - BIOSTAR B75MU3B v5.0 - Intel 2nd Generation Core DRAM

Ubuntu 20.04 - 5.9.1-050901-generic - GNOME Shell 3.34.1

1 System - 20 Benchmark Results

2 x Intel Xeon E5645 - ASUS Z8P - Intel 5520 I

Ubuntu 20.04 - 5.8.0-44-generic - KDE Frameworks 5.68.0

2 Systems - 243 Benchmark Results

Intel Core i9-10885H - HP 8736 - Intel Comet Lake PCH

Ubuntu 21.04 - 5.10.0-14-generic - GNOME Shell 3.38.3

1 System - 358 Benchmark Results

Ampere Altra ARMv8 Neoverse-N1 - WIWYNN Mt.Jade - Ampere Computing LLC Device e100

Ubuntu 20.04 - 5.11.0-051100-generic-64k - GNOME Shell 3.36.4

1 System - 238 Benchmark Results

Intel Core i9-10885H - HP 8736 - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-43-generic - GNOME Shell 3.38.2

1 System - 5 Benchmark Results

Intel Core i3-2120 - Dell 0HY9JP - Intel 2nd Generation Core Family DRAM

Debian GNU - 4.19.0-5-amd64 - GCC 8.3.0

3 Systems - 108 Benchmark Results

Intel Core i7-3770K - ECS Z77H2-A2X v1.0 - Intel Xeon E3-1200 v2

Ubuntu 20.04 - 5.4.0-58-generic - GNOME Shell 3.36.4

3 Systems - 108 Benchmark Results

Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-43-generic - GNOME Shell 3.38.2

1 System - 2393 Benchmark Results

AMD Ryzen 7 PRO 4750G - ASRock A520M-ITX/ac - AMD Renoir Root Complex

Gentoo - 5.10.16 - amd

5 Systems - 131 Benchmark Results

Intel Core i7-8086K - ASUS PRIME Z370-A - Intel 8th Gen Core

Ubuntu 20.04 - 5.9.0-050900rc8daily20201009-generic - GNOME Shell 3.36.4

Most Popular Test Results

Find More Test Results