Memcached

Memcached is a high performance, distributed memory object caching system. This Memcached test profiles makes use of memtier_benchmark for excuting this CPU/memory-focused server benchmark.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark memcached.

Project Site

memcached.org

Source Repository

github.com

Test Created

19 August 2022

Last Updated

25 March 2023

Test Maintainer

Michael Larabel 

Test Type

System

Average Install Time

38 Seconds

Average Run Time

4 Minutes, 27 Seconds

Test Dependencies

C/C++ Compiler Toolchain + Libevent + Perl Compatible Regular Expressions + Zlib + OpenSSL + Libtool

Accolades

20k+ Downloads

Supported Platforms


Public Result Uploads *Reported Installs **Reported Test Completions **Test Profile Page ViewsOpenBenchmarking.orgEventsMemcached Popularity Statisticspts/memcached2022.082022.092022.102022.112022.122023.012023.022023.032023.042023.052023.062023.072023.082023.092023.102023.1116003200480064008000
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data updated weekly as of 21 November 2023.
1:1035.8%1:10040.6%1:523.6%Set To Get Ratio Option PopularityOpenBenchmarking.org

Revision History

pts/memcached-1.2.0   [View Source]   Sat, 25 Mar 2023 11:45:35 GMT
Update against memcached 1.6.19 for GCC 13 build fix.

pts/memcached-1.1.0   [View Source]   Wed, 01 Feb 2023 15:16:10 GMT
Pull in fixes from https://github.com/phoronix-test-suite/test-profiles/pull/266 Closes: https://github.com/phoronix-test-suite/test-profiles/pull/266

pts/memcached-1.0.0   [View Source]   Fri, 19 Aug 2022 14:43:00 GMT
Add memcached benchmark using memtier_benchmark.

Suites Using This Test

Database Test Suite

Server


Performance Metrics

Analyze Test Configuration:

Memcached 1.6.19

Set To Get Ratio: 1:100

OpenBenchmarking.org metrics for this test profile configuration based on 563 public results since 25 March 2023 with the latest data as of 27 November 2023.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
Ops/sec (Average)
94th
9
7750435 +/- 205434
90th
9
7444859 +/- 203422
87th
7
5829460 +/- 372535
87th
4
5790665 +/- 643069
85th
13
5194914 +/- 68370
81st
8
4418070 +/- 86539
77th
6
4118249 +/- 46389
Mid-Tier
75th
< 3937266
75th
5
3847689 +/- 53853
72nd
3
3686165 +/- 117954
72nd
5
3675715 +/- 235282
70th
3
3576914 +/- 14716
69th
18
3457428 +/- 125813
59th
15
3184819 +/- 299745
55th
4
3037917 +/- 24782
54th
4
2990660 +/- 28926
54th
14
2982844 +/- 228856
Median
50th
2828885
50th
8
2827617 +/- 419238
49th
4
2777089 +/- 125506
43rd
4
2577950 +/- 265911
34th
7
2205326 +/- 10378
33rd
3
2194369 +/- 3312
32nd
3
2098107 +/- 91622
31st
9
2031008 +/- 216498
28th
7
1811958 +/- 203633
26th
3
1624580 +/- 50856
Low-Tier
25th
< 1598152
25th
4
1594146 +/- 4626
24th
5
1553303 +/- 10896
22nd
6
1476404 +/- 144673
22nd
3
1463265 +/- 5908
21st
3
1387902 +/- 6553
20th
4
1326875 +/- 44628
18th
4
1212938 +/- 133
17th
3
1110161 +/- 2766
16th
3
1048826 +/- 8308
15th
3
1013278 +/- 26207
15th
3
973209 +/- 134406
14th
3
929855 +/- 6646
11th
3
763349 +/- 48030
11th
22
738777 +/- 40788
9th
3
711994 +/- 2504
8th
3
696557 +/- 2298
6th
3
641807 +/- 17117
4th
4
491116 +/- 5997
OpenBenchmarking.orgDistribution Of Public Results - Set To Get Ratio: 1:100559 Results Range From 149527 To 9189256 Ops/sec14952733032251111769191287270710535021234297141509215958871776682195747721382722319067249986226806572861452304224732230423403837358463237654273946222412701743078124488607466940248501975030992521178753925825573377575417259349676115762629655764773526658147683894270197377200532738132775621227742917792371281045078285302846609786468928827687900848291892771020304050

Based on OpenBenchmarking.org data, the selected test / test configuration (Memcached 1.6.19 - Set To Get Ratio: 1:100) has an average run-time of 5 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkSet To Get Ratio: 1:100Run-Time48121620Min: 3 / Avg: 4.63 / Max: 17

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.3%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsSet To Get Ratio: 1:100Deviation246810Min: 0 / Avg: 0.3 / Max: 4

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
CVTSI2SD COMISD UCOMISD MOVAPD DIVSD MULSD CVTTSD2SI ADDSD CVTSS2SD SUBSD MOVDQU MOVDQA MAXSD MINSD CVTSD2SS SQRTSD ANDPD ANDNPD CMPNLESD ORPD
Requires passing a supported compiler/build flag (verified with targets: sandybridge, skylake, tigerlake, cascadelake, sapphirerapids, alderlake, znver2, znver3).
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

 
VINSERTF128 VEXTRACTF128 VZEROUPPER
Requires passing a supported compiler/build flag (verified with targets: skylake, tigerlake, cascadelake, sapphirerapids, alderlake, znver2, znver3).
Found on Intel processors since Haswell (2013).
Found on AMD processors since Excavator (2016).

 
VEXTRACTI128 VINSERTI128
FMA (FMA)
Requires passing a supported compiler/build flag (verified with targets: skylake, tigerlake, cascadelake, sapphirerapids, alderlake, znver2, znver3).
Found on Intel processors since Haswell (2013).
Found on AMD processors since Bulldozer (2011).

 
VFMADD213SD VFMADD231SD
Advanced Vector Extensions 512 (AVX512)
Requires passing a supported compiler/build flag (verified with targets: cascadelake, sapphirerapids).
 
(ZMM REGISTER USE)
The test / benchmark does honor compiler flag changes.
Last automated analysis: 30 March 2023

This test profile binary relies on the shared libraries libevent-2.1.so.7, libcrypto.so.3, libssl.so.3, libz.so.1, libm.so.6, libc.so.6.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture
Kernel Identifier
Verified On
Intel / AMD x86 64-bit
x86_64
(Many Processors)
ARMv8 64-bit
aarch64
ARMv8 Neoverse-N1, ARMv8 Neoverse-N1 128-Core, ARMv8 rev 0, Apple M2, Rockchip ARMv8 Cortex-A76 4-Core

Recent Test Results

OpenBenchmarking.org Results Compare

4 Systems - 415 Benchmark Results

AMD Ryzen 9 7950X 16-Core - ASUS ROG STRIX X670E-E GAMING WIFI - AMD Device 14d8

Ubuntu 23.10 - 6.5.0-9-generic - GNOME Shell 45.0

1 System - 167 Benchmark Results

ARMv8 rev 0 - jetson-xavier - 32GB

Ubuntu 18.04 - 4.9.140-tegra-pmx+ - GCC 7.5.0 + Clang 14.0.6 + CUDA 10.0

1 System - 155 Benchmark Results

ARMv8 rev 0 - EDK II 3.1-32827747 - 16GB

Ubuntu 20.04 - 5.10.104-pmx+ - GCC 9.4.0 + Clang 14.0.6 + CUDA 11.4

1 System - 1 Benchmark Result

AMD EPYC 9454P 48-Core - Dell PowerEdge R6615 [067N9T] - AMD Device 14a4

Debian 12 - 6.1.0-13-amd64 - GCC 12.2.0

4 Systems - 19 Benchmark Results

Intel Core i9-14900K - ASUS PRIME Z790-P WIFI - Intel Device 7a27

Ubuntu 23.10 - 6.5.0-9-generic - GNOME Shell 45.0

2 Systems - 358 Benchmark Results

AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship

Ubuntu 22.04 - 6.2.0-35-generic - GNOME Shell 42.2

1 System - 650 Benchmark Results

2 Systems - 246 Benchmark Results

Intel Core i5-12600K - ASUS PRIME Z690-P WIFI D4 - Intel Device 7aa7

Ubuntu 22.04 - 5.19.0-051900rc6daily20220716-generic - GNOME Shell 42.1

6 Systems - 159 Benchmark Results

2 x Intel Xeon E312xx - OpenStack Foundation Nova v25.1.0 - Intel 440FX 82441FX PMC

Ubuntu 22.04 - 5.15.0-30-generic - 1.3.238

6 Systems - 152 Benchmark Results

2 x Intel Xeon E312xx - OpenStack Foundation Nova v25.1.0 - Intel 440FX 82441FX PMC

Ubuntu 22.04 - 5.15.0-30-generic - 1.3.238

6 Systems - 147 Benchmark Results

2 x Intel Xeon E312xx - OpenStack Foundation Nova v25.1.0 - Intel 440FX 82441FX PMC

Ubuntu 22.04 - 5.15.0-30-generic - 1.3.238

4 Systems - 129 Benchmark Results

2 x Intel Xeon Max 9480 - Supermicro X13DEM v1.10 - Intel Device 1bce

CentOS Stream 9 - 5.14.0-373.el9.x86_64 - GNOME Shell 40.10

3 Systems - 129 Benchmark Results

2 x Intel Xeon Max 9480 - Supermicro X13DEM v1.10 - Intel Device 1bce

Ubuntu 23.10 - 6.5.0-9-generic - GNOME Shell 45.0

Most Popular Test Results

OpenBenchmarking.org Results Compare

3 Systems - 131 Benchmark Results

AMD Ryzen 7 5800X3D 8-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 22.04 - 5.17.0-1019-oem - GNOME Shell 42.2

2 Systems - 93 Benchmark Results

AMD Ryzen 7 7800X3D 8-Core - ASUS ROG CROSSHAIR X670E HERO - AMD Device 14d8

Ubuntu 23.04 - 6.2.8-060208-generic - GNOME Shell 44.0

2 Systems - 40 Benchmark Results

AMD Ryzen 7 PRO 5850U - HP 8A78 - AMD Renoir

Pop 22.04 - 5.19.0-76051900-generic - GNOME Shell 42.3.1

4 Systems - 215 Benchmark Results

AMD EPYC 7343 16-Core - Supermicro H12SSL-i v1.02 - 8 x 64 GB DDR4-3200MT

AlmaLinux 9.1 - 5.14.0-162.12.1.el9_1.x86_64 - GCC 11.3.1 20220421

3 Systems - 231 Benchmark Results

2 x Intel Xeon Platinum 8380 - Intel M50CYP2SB2U - Intel Ice Lake IEH

Ubuntu 22.10 - 6.2.0-rc5-phx-dodt - GNOME Shell 43.0

4 Systems - 132 Benchmark Results

2 x AMD EPYC 7773X 64-Core - AMD DAYTONA_X - AMD Starship

Ubuntu 22.04 - 6.2.0-phx - GNOME Shell 42.5

3 Systems - 237 Benchmark Results

AMD Ryzen 7 4800U - ASRock 4X4-4000 - AMD Renoir

Ubuntu 22.04 - 5.19.0-rc6-phx-retbleed - GNOME Shell 42.2

5 Systems - 203 Benchmark Results

2 x AMD EPYC 9654 96-Core - AMD Titanite_4G - AMD Device 14a4

Ubuntu 23.04 - 5.19.0-21-generic - GNOME Shell 43.1

2 Systems - 84 Benchmark Results

Intel Core i9-13900K - ASUS PRIME Z790-P WIFI - Intel Device 7a27

Ubuntu 23.04 - 6.2.0-20-generic - GNOME Shell 44.0

3 Systems - 46 Benchmark Results

AMD Ryzen 7 4700U - LENOVO LNVNB161216 - AMD Renoir

Ubuntu 22.04 - 5.19.0-35-generic - GNOME Shell 42.2

Find More Test Results