SecureMark

SecureMark is an objective, standardized benchmarking framework for measuring the efficiency of cryptographic processing solutions developed by EEMBC. SecureMark-TLS is benchmarking Transport Layer Security performance with a focus on IoT/edge computing.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark securemark.

Project Site

github.com

Test Created

10 April 2021

Test Maintainer

Michael Larabel 

Test Type

Processor

Average Install Time

6 Seconds

Average Run Time

13 Minutes, 31 Seconds

Test Dependencies

C/C++ Compiler Toolchain + CMake

Accolades

5k+ Downloads

Supported Platforms


Public Result Uploads *Reported Installs **Reported Test Completions **Test Profile Page ViewsOpenBenchmarking.orgEventsSecureMark Popularity Statisticspts/securemark2021.042021.052021.062021.072021.082021.092021.102021.112021.122022.012022.022022.032022.042022.052022.062022.072022.082022.092022.102022.112022.127001400210028003500
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of 1 December 2022.

Revision History

pts/securemark-1.0.0   [View Source]   Sat, 10 Apr 2021 17:21:13 GMT
Initial commit of SecureMark-TLS.

Suites Using This Test

Cryptography


Performance Metrics

Analyze Test Configuration:

SecureMark 1.0.4

Benchmark: SecureMark-TLS

OpenBenchmarking.org metrics for this test profile configuration based on 922 public results since 10 April 2021 with the latest data as of 29 November 2022.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
marks (Average)
100th
12
436739 +/- 19837
100th
10
432282 +/- 4261
99th
8
426176 +/- 4534
98th
5
423633 +/- 1580
98th
6
418986 +/- 3695
96th
19
388579 +/- 3795
96th
8
386109 +/- 3378
94th
21
369060 +/- 4661
91st
7
352561 +/- 849
89th
22
337663 +/- 20256
88th
8
328957 +/- 621
86th
31
322903 +/- 4713
85th
6
322166 +/- 9880
84th
16
319397 +/- 6191
83rd
13
318412 +/- 6216
78th
11
312519 +/- 5594
77th
16
309715 +/- 26772
77th
13
308773 +/- 5725
Mid-Tier
75th
< 308073
75th
9
306637 +/- 6018
75th
6
305495 +/- 3259
75th
14
305272 +/- 5344
74th
5
301769 +/- 1889
71st
10
295758 +/- 3695
70th
6
293196 +/- 4142
69th
10
289094 +/- 12866
69th
3
287000 +/- 135
68th
3
286425 +/- 468
67th
9
283310 +/- 13939
67th
5
282821 +/- 3496
66th
5
281599 +/- 1282
62nd
8
271362 +/- 1893
62nd
9
271161 +/- 2105
62nd
4
271115 +/- 3149
62nd
7
270495 +/- 2566
62nd
7
270333 +/- 8550
61st
3
269310 +/- 186
60th
14
267231 +/- 7277
57th
15
258748 +/- 11728
57th
3
257924 +/- 48
56th
14
255059 +/- 1995
54th
7
252146 +/- 206
53rd
5
251548 +/- 2514
51st
3
248954 +/- 1589
51st
8
248550 +/- 3815
Median
50th
247363
50th
4
246188 +/- 3119
50th
4
245899 +/- 5073
49th
13
244680 +/- 11511
48th
3
243099 +/- 1076
48th
3
242075 +/- 4883
45th
8
238880 +/- 12262
45th
4
238879 +/- 594
45th
3
238845 +/- 1652
44th
4
237985 +/- 8236
44th
3
237793 +/- 372
43rd
4
237355 +/- 807
41st
4
236319 +/- 7363
41st
5
235252 +/- 3820
41st
3
234184 +/- 1034
40th
10
233866 +/- 7069
40th
5
233365 +/- 1250
40th
3
233132 +/- 1012
38th
4
231712 +/- 3392
37th
3
230269 +/- 1081
36th
3
229559 +/- 2112
34th
40
228261 +/- 4570
34th
7
227495 +/- 4916
33rd
4
227009 +/- 281
31st
6
224449 +/- 3818
29th
3
222166 +/- 1051
29th
4
221916 +/- 379
28th
7
221221 +/- 2090
28th
4
220323 +/- 2662
26th
5
216555 +/- 1503
26th
3
215843 +/- 37
Low-Tier
25th
< 215562
25th
3
214496 +/- 1001
25th
3
214112 +/- 814
25th
4
214041 +/- 1618
24th
3
211996 +/- 254
23rd
5
211198 +/- 233
23rd
11
211112 +/- 1881
22nd
7
210360 +/- 2138
20th
4
206096 +/- 1045
20th
5
205322 +/- 2680
19th
3
205108 +/- 242
18th
6
204044 +/- 622
18th
3
203892 +/- 3711
18th
3
202261 +/- 239
16th
3
194997 +/- 240
16th
7
191809 +/- 934
15th
3
191139 +/- 28
14th
3
188073 +/- 1615
14th
4
188027 +/- 1419
13th
4
179986 +/- 880
13th
6
179766 +/- 2005
13th
6
178700 +/- 314
12th
3
175689 +/- 620
11th
3
173198 +/- 1201
11th
3
170816 +/- 559
11th
3
170794 +/- 61
8th
5
143986 +/- 1189
6th
3
93211 +/- 862
6th
4
82471 +/- 197
5th
5
54238 +/- 7930
4th
7
45517 +/- 2692
OpenBenchmarking.orgDistribution Of Public Results - Benchmark: SecureMark-TLS920 Results Range From 13917 To 475941 marks1391723158323994164050881601226936378604878459708610632711556812480913405014329115253216177317101418025518949619873720797821721922646023570124494225418326342427266528190629114730038830962931887032811133735234659335583436507537431638355739279840203941128042052142976243900344824445748546672647596720406080100

Based on OpenBenchmarking.org data, the selected test / test configuration (SecureMark 1.0.4 - Benchmark: SecureMark-TLS) has an average run-time of 15 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkBenchmark: SecureMark-TLSRun-Time612182430Min: 14 / Avg: 14.26 / Max: 28

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.2%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsBenchmark: SecureMark-TLSDeviation246810Min: 0 / Avg: 0.23 / Max: 2

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

IntelAMDOpenBenchmarking.orgRelative Core Scaling To BaseSecureMark CPU Core ScalingBenchmark: SecureMark-TLS246812162432641280.41880.83761.25641.67522.094

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
CVTSS2SD MOVDQA MOVDQU PSRLDQ MOVD PSHUFD
Last automated analysis: 18 January 2022

This test profile binary relies on the shared libraries libc.so.6.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture
Kernel Identifier
Verified On
Intel / AMD x86 64-bit
x86_64
(Many Processors)
IBM Z
s390x
(Many Processors)
RISC-V 64-bit
riscv64
SiFive RISC-V, SiFive U740, rv64imafdc, rv64imafdcsu
ARMv7 32-bit
armv7l
ARMv7 Cortex-A53 4-Core, ARMv7 Cortex-A72 4-Core
ARMv8 64-bit
aarch64
ARMv8 Cortex-A57 4-Core, ARMv8 Cortex-A72, ARMv8 Cortex-A72 16-Core, ARMv8 Cortex-A72 4-Core, ARMv8 Neoverse-N1, ARMv8 Neoverse-V1, Ampere ARMv8 Neoverse-N1 128-Core, Ampere ARMv8 Neoverse-N1 160-Core, Ampere ARMv8 Neoverse-N1 256-Core, Ampere Altra ARMv8 Neoverse-N1 160-Core, Ampere eMAG ARMv8 32-Core, Apple M1, Apple M2

Recent Test Results

OpenBenchmarking.org Results Compare

1 System - 49 Benchmark Results

2 x AMD Opteron 4386 - Supermicro H8DCL - AMD RD890 + SB7x0

Debian 11 - 5.10.0-18-amd64 - 1.0.2

5 Systems - 144 Benchmark Results

ARMv8 Cortex-A72 - BCM2835 Raspberry Pi 4 Model B Rev 1.2 - Broadcom BCM2711

Manjaro-ARM 22.10 - 5.15.74-2-MANJARO-ARM-RPI - Xfce 4.16

3 Systems - 140 Benchmark Results

ARMv8 Cortex-A72 - BCM2835 Raspberry Pi 4 Model B Rev 1.2 - Broadcom BCM2711

Manjaro-ARM 22.10 - 5.15.74-2-MANJARO-ARM-RPI - Xfce 4.16

4 Systems - 68 Benchmark Results

SiFive RISC-V - SiFive HiFive Unmatched A00 - SiFive FU740-C000 RISC-V SoC

Ubuntu 21.10 - 5.13.0-1002-generic - GNOME Shell 40.2

2 Systems - 99 Benchmark Results

ARMv8 Cortex-A72 - BCM2835 Raspberry Pi 4 Model B Rev 1.2 - Broadcom BCM2711

Manjaro-ARM 22.10 - 5.15.74-2-MANJARO-ARM-RPI - Xfce 4.16

5 Systems - 239 Benchmark Results

AMD Ryzen 5 5600H - AZW SER - AMD Renoir

ManjaroLinux 22.0.0 - 5.15.74-3-MANJARO - KDE Plasma 5.25.5

4 Systems - 231 Benchmark Results

AMD Ryzen 5 5600H - AZW SER - AMD Renoir

ManjaroLinux 22.0.0 - 5.15.74-3-MANJARO - KDE Plasma 5.25.5

3 Systems - 188 Benchmark Results

AMD Ryzen 5 5600H - AZW SER - AMD Renoir

ManjaroLinux 22.0.0 - 5.15.74-3-MANJARO - KDE Plasma 5.25.5

1 System - 79 Benchmark Results

AMD Ryzen 5 5600H - AZW SER - AMD Renoir

ManjaroLinux 22.0.0 - 5.15.74-3-MANJARO - KDE Plasma 5.25.5

1 System - 1 Benchmark Result

Intel Xeon D-1736NT - Supermicro X12SDV-8C-SP6F v1.02 - Intel Device 0998

Fedora Linux 36 - 5.17.5-300.fc36.x86_64 - GCC 12.2.1 20220819

1 System - 209 Benchmark Results

AMD Ryzen 7 5700X 8-Core - MSI PRO B550M-VC WIFI - AMD Starship

Ubuntu 22.04 - 5.15.0-52-generic - KDE Plasma 5.24.6

1 System - 78 Benchmark Results

Intel Core i5-6600 - MSI Z170A GAMING PRO - Intel Xeon E3-1200 v5

ManjaroLinux 22.0.0 - 6.0.0-1-MANJARO - Xfce 4.16

1 System - 78 Benchmark Results

AMD Ryzen 5 3550H - BESSTAR TECH LIMITED UM350 - AMD Raven

Pop 22.04 - 5.19.0-76051900-generic - GNOME Shell 42.3.1

1 System - 100 Benchmark Results

AMD Ryzen 5 7600X 6-Core - ASUS ROG CROSSHAIR X670E HERO - AMD Device 14d8

Ubuntu 22.04 - 6.0.0-060000rc1daily20220820-generic - GNOME Shell 42.2

Most Popular Test Results

Find More Test Results