SecureMark

SecureMark is an objective, standardized benchmarking framework for measuring the efficiency of cryptographic processing solutions developed by EEMBC. SecureMark-TLS is benchmarking Transport Layer Security performance with a focus on IoT/edge computing.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark securemark.

Project Site

github.com

Test Created

10 April 2021

Test Maintainer

Michael Larabel 

Test Type

Processor

Average Install Time

4 Seconds

Average Run Time

14 Minutes, 49 Seconds

Test Dependencies

C/C++ Compiler Toolchain + CMake

Accolades

5k+ Downloads

Supported Platforms


Public Result Uploads *Reported Installs **Reported Test Completions **Test Profile Page ViewsOpenBenchmarking.orgEventsSecureMark Popularity Statisticspts/securemark2021.042021.052021.062021.072021.082021.092021.102021.112021.122022.012022.022022.032022.042022.052022.062022.072022.082022.092022.102022.112022.122023.012023.022023.032023.042023.052023.062023.072023.082023.092023.102023.112023.122024.012024.022024.032024.042024.052024.062024.0714002800420056007000
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data updated weekly as of 9 July 2024.

Revision History

pts/securemark-1.0.0   [View Source]   Sat, 10 Apr 2021 17:21:13 GMT
Initial commit of SecureMark-TLS.

Suites Using This Test

Cryptography


Performance Metrics

Analyze Test Configuration:

SecureMark 1.0.4

Benchmark: SecureMark-TLS

OpenBenchmarking.org metrics for this test profile configuration based on 1,379 public results since 10 April 2021 with the latest data as of 5 July 2024.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
marks (Average)
100th
10
467848 +/- 8099
99th
17
434691 +/- 17737
98th
15
432673 +/- 5111
97th
19
428912 +/- 8755
97th
7
427869 +/- 15720
97th
20
427171 +/- 10737
96th
10
424676 +/- 7819
95th
16
424120 +/- 11757
94th
3
420197 +/- 6708
93rd
4
417555 +/- 8171
91st
4
410791 +/- 9044
91st
6
408919 +/- 3879
89th
4
394470 +/- 4648
88th
6
393088 +/- 1753
88th
11
392493 +/- 7762
87th
20
388828 +/- 3844
87th
10
388191 +/- 14710
86th
9
386056 +/- 3164
85th
10
382696 +/- 27108
85th
9
378096 +/- 11330
84th
4
370416 +/- 5078
83rd
22
369146 +/- 4567
82nd
5
364321 +/- 34692
81st
7
357304 +/- 20573
80th
4
347149 +/- 101
80th
17
345938 +/- 5736
78th
22
337663 +/- 20256
78th
3
334704 +/- 2818
77th
9
329326 +/- 1250
Mid-Tier
75th
< 324764
74th
6
322166 +/- 9880
74th
42
321346 +/- 5826
74th
5
321185 +/- 489
73rd
18
319524 +/- 6344
71st
15
317683 +/- 6338
70th
3
316272 +/- 13261
70th
3
316076 +/- 13058
68th
11
312519 +/- 5594
68th
20
312476 +/- 24514
67th
3
308853 +/- 12974
67th
13
308773 +/- 5725
67th
3
308771 +/- 13340
65th
17
307571 +/- 1970
64th
7
306007 +/- 8660
64th
7
305579 +/- 8184
64th
6
305495 +/- 3259
63rd
19
304763 +/- 5282
63rd
8
301809 +/- 2437
60th
5
296662 +/- 5045
60th
10
296579 +/- 6585
60th
3
295910 +/- 1409
59th
14
295409 +/- 3128
58th
3
293398 +/- 12830
57th
4
289979 +/- 12316
57th
10
289094 +/- 12866
56th
3
287000 +/- 135
56th
3
286425 +/- 468
56th
12
285520 +/- 12542
55th
6
283624 +/- 3693
54th
5
281599 +/- 1282
53rd
3
278277 +/- 11600
52nd
4
277121 +/- 161
51st
5
275765 +/- 3604
Median
50th
273273
49th
8
271362 +/- 1893
49th
9
271161 +/- 2105
49th
4
271115 +/- 3149
49th
3
270542 +/- 12730
49th
7
270495 +/- 2566
49th
7
270333 +/- 8550
49th
7
270202 +/- 9642
49th
9
269588 +/- 9633
48th
12
269344 +/- 8220
48th
3
269310 +/- 186
48th
6
269027 +/- 9447
47th
14
267231 +/- 7277
45th
15
258748 +/- 11728
45th
3
257924 +/- 48
43rd
14
255059 +/- 1995
43rd
8
254169 +/- 5725
42nd
5
251548 +/- 2514
39th
3
248954 +/- 1589
39th
8
248550 +/- 3815
39th
7
248042 +/- 3172
38th
4
246188 +/- 3119
38th
4
245899 +/- 5073
37th
21
243231 +/- 9166
37th
3
243099 +/- 1076
37th
3
242075 +/- 4883
34th
4
238879 +/- 594
34th
3
238845 +/- 1652
34th
4
237985 +/- 8236
34th
3
237793 +/- 372
33rd
4
237355 +/- 807
33rd
9
237012 +/- 12765
32nd
4
236319 +/- 7363
32nd
5
235252 +/- 3820
31st
3
234184 +/- 1034
31st
12
233437 +/- 9689
31st
5
233365 +/- 1250
31st
3
233132 +/- 1012
31st
11
233045 +/- 7238
30th
4
231712 +/- 3392
28th
3
230269 +/- 1081
28th
3
229559 +/- 2112
27th
43
228275 +/- 4445
27th
7
227495 +/- 4916
26th
4
227009 +/- 281
26th
3
226995 +/- 3796
Low-Tier
25th
< 225598
24th
6
224449 +/- 3818
23rd
3
222166 +/- 1051
23rd
4
221916 +/- 379
22nd
7
221221 +/- 2090
22nd
4
220323 +/- 2662
21st
5
216555 +/- 1503
21st
3
215843 +/- 37
20th
3
214496 +/- 1001
20th
3
214112 +/- 814
20th
4
214041 +/- 1618
19th
3
211996 +/- 254
19th
5
211198 +/- 233
19th
11
211112 +/- 1881
18th
7
210360 +/- 2138
17th
4
206096 +/- 1045
16th
5
205322 +/- 2680
16th
3
205108 +/- 242
16th
6
204044 +/- 622
16th
3
203892 +/- 3711
15th
3
202261 +/- 239
14th
3
194997 +/- 240
14th
7
191809 +/- 934
13th
3
191139 +/- 28
13th
3
188073 +/- 1615
13th
4
188027 +/- 1419
12th
4
179986 +/- 880
12th
6
179766 +/- 2005
11th
6
178700 +/- 314
11th
3
175689 +/- 620
10th
3
173198 +/- 1201
10th
3
170816 +/- 559
10th
3
170794 +/- 61
8th
5
143986 +/- 1189
5th
3
93211 +/- 862
5th
4
82471 +/- 197
4th
8
51972 +/- 6763
3rd
7
45517 +/- 2692
2nd
3
14964 +/- 2105
OpenBenchmarking.orgDistribution Of Public Results - Benchmark: SecureMark-TLS1379 Results Range From 13588 To 476330 marks1358822843320984135350608598636911878373876289688310613811539312464813390314315815241316166817092318017818943319868820794321719822645323570824496325421826347327272828198329123830049330974831900332825833751334676835602336527837453338378839304340229841155342080843006343931844857345782846708347633820406080100

Based on OpenBenchmarking.org data, the selected test / test configuration (SecureMark 1.0.4 - Benchmark: SecureMark-TLS) has an average run-time of 15 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkBenchmark: SecureMark-TLSRun-Time612182430Min: 14 / Avg: 14.2 / Max: 28

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.2%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsBenchmark: SecureMark-TLSDeviation246810Min: 0 / Avg: 0.23 / Max: 3

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

IntelAMDOpenBenchmarking.orgRelative Core Scaling To BaseSecureMark CPU Core ScalingBenchmark: SecureMark-TLS246810121416243248641280.41250.8251.23751.652.0625

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
CVTSS2SD MOVDQA MOVDQU PSRLDQ MOVD PSHUFD
Last automated analysis: 18 January 2022

This test profile binary relies on the shared libraries libc.so.6.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture
Kernel Identifier
Verified On
Intel / AMD x86 64-bit
x86_64
(Many Processors)
IBM Z
s390x
(Many Processors)
RISC-V 64-bit
riscv64
SiFive RISC-V, SiFive U740, rv64imafdc, rv64imafdcsu
Loongson LoongArch 64-bit
loongarch64
Loongson-3A6000
ARMv7 32-bit
armv7l
ARMv7 Cortex-A53 4-Core, ARMv7 Cortex-A72 4-Core
ARMv8 64-bit
aarch64
ARMv8 Cortex-A53 4-Core, ARMv8 Cortex-A57 4-Core, ARMv8 Cortex-A72, ARMv8 Cortex-A72 16-Core, ARMv8 Cortex-A72 4-Core, ARMv8 Neoverse-N1, ARMv8 Neoverse-V1, ARMv8 Neoverse-V2 72-Core, Ampere ARMv8 Neoverse-N1 128-Core, Ampere ARMv8 Neoverse-N1 160-Core, Ampere ARMv8 Neoverse-N1 256-Core, Ampere Altra ARMv8 Neoverse-N1 160-Core, Ampere eMAG ARMv8 32-Core, Apple M1, Apple M2, HiSilicon, Rockchip ARMv8 Cortex-A76 4-Core, Rockchip ARMv8 Cortex-A76 8-Core

Recent Test Results

OpenBenchmarking.org Results Compare

2 Systems - 1012 Benchmark Results

1 System - 1012 Benchmark Results

22 Systems - 263 Benchmark Results

2 x AMD EPYC 9684X 96-Core - AMD Titanite_4G - AMD Device 14a4

Ubuntu 24.04 - 6.9.0-060900rc3-generic - GCC 13.2.0

1 System - 33 Benchmark Results

HiSilicon - Kunlun HisiPangu TU140HCR110 - 1 x 16384 MB LPDDR4-3726MT

Kylin v10 - 5.4.18-hw15-pangu - X Server

1 System - 250 Benchmark Results

AMD Ryzen Threadripper PRO 7965WX 24-Cores - ASUS Pro WS WRX90E-SAGE SE - AMD Device 14a4

Arch Linux - 6.8.1-arch1-1 - GCC 13.2.1 20230801 + Clang 17.0.6

1 System - 250 Benchmark Results

AMD Ryzen Threadripper PRO 7965WX 24-Cores - ASUS Pro WS WRX90E-SAGE SE - AMD Device 14a4

Arch Linux - 6.8.1-arch1-1 - GCC 13.2.1 20230801 + Clang 17.0.6

1 System - 250 Benchmark Results

AMD Ryzen Threadripper PRO 7965WX 24-Cores - ASUS Pro WS WRX90E-SAGE SE - AMD Device 14a4

Arch Linux - 6.8.1-arch1-1 - GCC 13.2.1 20230801 + Clang 17.0.6

1 System - 250 Benchmark Results

AMD Ryzen Threadripper PRO 7965WX 24-Cores - ASUS Pro WS WRX90E-SAGE SE - AMD Device 14a4

Arch Linux - 6.8.1-arch1-1 - GCC 13.2.1 20230801 + Clang 17.0.6

1 System - 250 Benchmark Results

AMD Ryzen Threadripper PRO 7965WX 24-Cores - ASUS Pro WS WRX90E-SAGE SE - AMD Device 14a4

Arch Linux - 6.8.1-arch1-1 - GCC 13.2.1 20230801 + Clang 17.0.6

27 Systems - 162 Benchmark Results

Intel Core i9-14900K - ASUS PRIME Z790-P - Intel Raptor Lake-S PCH

Arch Linux - 6.8.2-arch2-1 - GCC 13.2.1 20230801

1 System - 3 Benchmark Results

Intel Core i9-14900K - ASUS PRIME Z790-P - Intel Raptor Lake-S PCH

Arch Linux - 6.8.2-arch2-1 - GCC 13.2.1 20230801

1 System - 89 Benchmark Results

AMD Ryzen Threadripper PRO 7965WX 24-Cores - ASUS Pro WS WRX90E-SAGE SE - AMD Device 14a4

Arch Linux - 6.8.1-arch1-1 - GCC 13.2.1 20230801 + Clang 17.0.6

1 System - 187 Benchmark Results

AMD Ryzen Threadripper PRO 7965WX 24-Cores - ASUS Pro WS WRX90E-SAGE SE - AMD Device 14a4

Debian 12 - 6.1.0-18-amd64 - X Server 1.21.1.7

5 Systems - 587 Benchmark Results

Intel Core i5-14600K - ASUS PRIME Z790-P WIFI - Intel Raptor Lake-S PCH

Ubuntu 23.10 - 6.7.3-060703-generic - GNOME Shell 45.2

1 System - 76 Benchmark Results

8 x Intel Xeon E5-2620 v4 - Xen HVM domU v4.13 - Intel 440FX 82441FX PMC

Debian 11 - 5.10.0-28-amd64 - GNOME Shell 3.38.6

Most Popular Test Results

Find More Test Results