SecureMark

SecureMark is an objective, standardized benchmarking framework for measuring the efficiency of cryptographic processing solutions developed by EEMBC. SecureMark-TLS is benchmarking Transport Layer Security performance with a focus on IoT/edge computing.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark securemark.

Project Site

github.com

Test Created

10 April 2021

Test Maintainer

Michael Larabel 

Test Type

Processor

Average Install Time

3 Seconds

Average Run Time

14 Minutes, 18 Seconds

Test Dependencies

C/C++ Compiler Toolchain + CMake

Supported Platforms


Revision History

pts/securemark-1.0.0   [View Source]   Sat, 10 Apr 2021 17:21:13 GMT
Initial commit of SecureMark-TLS.

Suites Using This Test

Cryptography


Performance Metrics

Analyze Test Configuration:

SecureMark 1.0.4

Benchmark: SecureMark-TLS

OpenBenchmarking.org metrics for this test profile configuration based on 151 public results since 10 April 2021 with the latest data as of 5 May 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Matching Public Results
marks (Average)
98th
14
331674 +/- 19175
95th
7
323759 +/- 4420
92nd
6
319072 +/- 4026
82nd
3
316633 +/- 3616
82nd
3
316445 +/- 1545
78th
4
304053 +/- 3064
Mid-Tier
75th
< 282560
74th
3
282529 +/- 135
73rd
4
282439 +/- 242
72nd
3
281410 +/- 2364
70th
3
279345 +/- 2478
66th
6
274299 +/- 4233
64th
3
269310 +/- 186
59th
9
249044 +/- 11058
56th
3
244728 +/- 807
Median
50th
240848
47th
3
237823 +/- 4077
47th
4
237355 +/- 807
45th
3
234871 +/- 5475
37th
3
230269 +/- 1081
34th
3
229168 +/- 1169
29th
6
224962 +/- 1091
26th
3
222166 +/- 1051
Low-Tier
25th
< 222048
23rd
3
219504 +/- 2569
21st
3
215843 +/- 37
20th
3
214496 +/- 1001
17th
3
211996 +/- 254
15th
3
209779 +/- 696
7th
3
173198 +/- 1201
6th
3
170794 +/- 61
OpenBenchmarking.orgDistribution Of Public Results - Benchmark: SecureMark-TLS151 Results Range From 131782 To 357451 marks13178213629614081014532414983815435215886616338016789417240817692218143618595019046419497819949220400620852021303421754822206222657623109023560424011824463224914625366025817426268826720227171627623028074428525828977229428629880030331430782831234231685632137032588433039833491233942634394034845435296835748248121620

Based on OpenBenchmarking.org data, the selected test / test configuration (SecureMark 1.0.4 - Benchmark: SecureMark-TLS) has an average run-time of 14 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkBenchmark: SecureMark-TLSRun-Time612182430Min: 5 / Avg: 13.41 / Max: 28

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.4%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsBenchmark: SecureMark-TLSDeviation246810Min: 0 / Avg: 0.4 / Max: 3

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

IntelAMDOpenBenchmarking.orgRelative Core Scaling To BaseSecureMark CPU Core ScalingBenchmark: SecureMark-TLS468120.3750.751.1251.51.875

Recent Test Results

OpenBenchmarking.org Results Compare

3 Systems - 120 Benchmark Results

Ampere Altra ARMv8 Neoverse-N1 - WIWYNN Mt.Jade - Ampere Computing LLC Device e100

Ubuntu 20.04 - 5.11.0-051100-generic-64k - GNOME Shell 3.36.4

4 Systems - 132 Benchmark Results

2 x Intel Xeon Gold 5220R - TYAN S7106 - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.04 - 5.9.0-050900rc6-generic - GNOME Shell 3.36.4

1 System - 1 Benchmark Result

Intel Xeon - Virtuozzo KVM - Intel 440FX 82441FX PMC

Ubuntu 21.04 - 5.11.0-16-generic - GCC 10.3.0

4 Systems - 40 Benchmark Results

Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH

Ubuntu 21.04 - 5.11.0-16-generic - GNOME Shell 3.38.4

8 Systems - 188 Benchmark Results

2 x Intel Xeon Platinum 8380 - Intel M50CYP2SB2U - Intel Device 0998

Ubuntu 20.04 - 5.11.0-051100-generic - GNOME Shell 3.36.4

1 System - 732 Benchmark Results

2 x Intel Xeon Platinum 8380 - Intel M50CYP2SB2U - Intel Device 0998

Ubuntu 20.04 - 5.11.6-051106-generic - GNOME Shell 3.36.4

5 Systems - 16 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Ubuntu 20.04 - 5.9.0-050900daily20201012-generic - GNOME Shell 3.36.4

1 System - 115 Benchmark Results

AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.04 - 5.12.0-051200rc8daily20210425-generic - GNOME Shell 3.36.7

3 Systems - 14 Benchmark Results

Intel Core i7-8550U - Dell 0H0VG3 - Intel Xeon E3-1200 v6

Ubuntu 20.10 - 5.8.0-45-generic - GNOME Shell 3.38.2

Most Popular Test Results

Find More Test Results