SecureMark

SecureMark is an objective, standardized benchmarking framework for measuring the efficiency of cryptographic processing solutions developed by EEMBC. SecureMark-TLS is benchmarking Transport Layer Security performance with a focus on IoT/edge computing.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark securemark.

Project Site

github.com

Test Created

10 April 2021

Test Maintainer

Michael Larabel 

Test Type

Processor

Average Install Time

3 Seconds

Average Run Time

12 Minutes, 6 Seconds

Test Dependencies

C/C++ Compiler Toolchain + CMake

Supported Platforms


Public Result Uploads *Reported Installs **Reported Test Completions **Test Profile Page ViewsOpenBenchmarking.orgEventsSecureMark Popularity Statisticspts/securemark2021.042021.052021.062021.072004006008001000
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of 31 July 2021.

Revision History

pts/securemark-1.0.0   [View Source]   Sat, 10 Apr 2021 17:21:13 GMT
Initial commit of SecureMark-TLS.

Suites Using This Test

Cryptography


Performance Metrics

Analyze Test Configuration:

SecureMark 1.0.4

Benchmark: SecureMark-TLS

OpenBenchmarking.org metrics for this test profile configuration based on 310 public results since 10 April 2021 with the latest data as of 27 July 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
marks (Average)
99th
16
329961 +/- 18454
97th
10
323028 +/- 3893
95th
6
319072 +/- 4026
90th
3
316633 +/- 3616
90th
3
316445 +/- 1545
87th
5
311634 +/- 3112
86th
4
304053 +/- 3064
85th
3
290336 +/- 3144
84th
3
287000 +/- 135
82nd
3
286425 +/- 468
82nd
5
285637 +/- 6224
80th
3
282529 +/- 135
80th
4
282439 +/- 242
78th
3
279345 +/- 2478
Mid-Tier
75th
< 269472
75th
3
269310 +/- 186
74th
11
268788 +/- 7151
71st
12
259908 +/- 12672
70th
3
257924 +/- 48
68th
3
253382 +/- 149
65th
9
249044 +/- 11058
65th
5
247758 +/- 4740
59th
4
238879 +/- 594
59th
3
238845 +/- 1652
57th
4
237985 +/- 8236
57th
3
237823 +/- 4077
57th
3
237793 +/- 372
55th
4
237355 +/- 807
54th
3
234871 +/- 5475
Median
50th
232637
47th
3
230311 +/- 2342
46th
3
230269 +/- 1081
45th
3
229559 +/- 2112
42nd
13
227392 +/- 3346
41st
4
227009 +/- 281
41st
5
226778 +/- 5475
40th
4
226631 +/- 2295
34th
3
222166 +/- 1051
34th
4
222150 +/- 1446
34th
4
221916 +/- 379
32nd
3
219504 +/- 2569
31st
4
216384 +/- 1678
30th
3
215843 +/- 37
28th
3
214496 +/- 1001
27th
3
214112 +/- 814
27th
4
214041 +/- 1618
Low-Tier
25th
< 212149
25th
3
211996 +/- 254
24th
4
211300 +/- 58
22nd
6
210605 +/- 1084
21st
5
209321 +/- 1461
19th
4
206520 +/- 148
17th
3
205108 +/- 242
14th
3
203892 +/- 3711
12th
3
194997 +/- 240
11th
3
191139 +/- 28
9th
3
188073 +/- 1615
9th
4
188027 +/- 1419
8th
3
181501 +/- 407
7th
3
175689 +/- 620
6th
3
173198 +/- 1201
5th
3
170794 +/- 61
2nd
3
93211 +/- 862
OpenBenchmarking.orgDistribution Of Public Results - Benchmark: SecureMark-TLS310 Results Range From 92690 To 357451 marks9269097986103282108578113874119170124466129762135058140354145650150946156242161538166834172130177426182722188018193314198610203906209202214498219794225090230386235682240978246274251570256866262162267458272754278050283346288642293938299234304530309826315122320418325714331010336306341602346898352194357490714212835

Based on OpenBenchmarking.org data, the selected test / test configuration (SecureMark 1.0.4 - Benchmark: SecureMark-TLS) has an average run-time of 12 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkBenchmark: SecureMark-TLSRun-Time612182430Min: 5 / Avg: 11.3 / Max: 28

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.2%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsBenchmark: SecureMark-TLSDeviation246810Min: 0 / Avg: 0.23 / Max: 2

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

IntelAMDOpenBenchmarking.orgRelative Core Scaling To BaseSecureMark CPU Core ScalingBenchmark: SecureMark-TLS4681232640.46480.92961.39441.85922.324

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
CVTSS2SD MOVDQA MOVDQU PSHUFD MOVD PUNPCKLQDQ
Last automated analysis: 10 May 2021

This test profile binary relies on the shared libraries libc.so.6.

Recent Test Results

OpenBenchmarking.org Results Compare

1 System - 58 Benchmark Results

AMD Ryzen 5 3400G - LENOVO 3706 - AMD Raven

Ubuntu 20.04 - 5.4.0-80-generic - GNOME Shell 3.36.9

4 Systems - 78 Benchmark Results

AMD Ryzen 9 5900HX - ASUS G513QY v1.0 - AMD Renoir Root Complex

Ubuntu 21.04 - 5.13.2 - GNOME Shell 3.38.4

3 Systems - 78 Benchmark Results

AMD Ryzen 9 5900HX - ASUS G513QY v1.0 - AMD Renoir Root Complex

Ubuntu 21.04 - 5.13.2 - GNOME Shell 3.38.4

1 System - 3 Benchmark Results

Intel Core i5-8400 - ASRock B360M Pro4 - Intel Cannon Lake PCH

Arch rolling - 5.13.4-arch2-1 - Sway 1.6.1

2 Systems - 75 Benchmark Results

AMD Ryzen 9 5900HX - ASUS G513QY v1.0 - AMD Renoir Root Complex

Arch Linux - 5.13.4-arch1-1 - GNOME Shell 40.3

2 Systems - 81 Benchmark Results

AMD EPYC 7543 32-Core - TYAN S8036GM2NE-LE - AMD Starship

Ubuntu 21.04 - 5.11.0-25-generic - GNOME Shell 3.38.4

3 Systems - 240 Benchmark Results

AMD EPYC 7F32 8-Core - Supermicro H12SSL-i v1.01 - AMD Starship

Ubuntu 21.04 - 5.11.0-16-generic - GNOME Shell 3.38.4

3 Systems - 240 Benchmark Results

4 x Intel Xeon Gold 6254 - HPE ProLiant DL560 Gen10 - Intel Sky Lake-E DMI3 Registers

RedHatEnterpriseServer 7.9 - 3.10.0-1160.31.1.el7.x86_64 - GNOME Shell 3.28.3

3 Systems - 253 Benchmark Results

AMD Ryzen 7 4700U - LENOVO LNVNB161216 - AMD Renoir Root Complex

Ubuntu 20.04 - 5.9.0-050900rc7daily20201003-generic - GNOME Shell 3.36.9

6 Systems - 180 Benchmark Results

Intel Core i7-8565U - Dell 0KTW76 - Intel Cannon Point-LP

Ubuntu 21.04 - 5.13.0-051300-generic - GNOME Shell 3.38.4

5 Systems - 189 Benchmark Results

AMD Ryzen 5 4500U - LENOVO LNVNB161216 - AMD Renoir Root Complex

Ubuntu 21.04 - 5.13.0-051300-generic - GNOME Shell 3.38.4

1 System - 30 Benchmark Results

AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.04 - 5.13.0-051300daily20210703-generic - GNOME Shell 3.36.9

Most Popular Test Results

Find More Test Results