Redis

Redis is an open-source in-memory data structure store, used as a database, cache, and message broker.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark redis.

Project Site

redis.io

Test Created

3 June 2015

Last Updated

21 January 2021

Test Maintainer

Michael Larabel 

Test Type

System

Average Install Time

47 Seconds

Average Run Time

1 Minute, 15 Seconds

Test Dependencies

C/C++ Compiler Toolchain

Accolades

100k+ Downloads + 5k+ Public Benchmark Results

Supported Platforms


Public Result UploadsReported Installs*Test Completions*OpenBenchmarking.orgEventsRedis Popularity Statisticspts/redis2015.062015.082015.102015.122016.022016.042016.062016.082016.102016.122017.022017.042017.062017.082017.102017.122018.022018.042018.062018.082018.102018.122019.022019.042019.062019.082019.102019.122020.022020.042020.062020.082020.102020.122021.0220K40K60K80K100K
* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Mon, 01 Mar 2021 05:56:51 GMT.
SADD16.9%SET36.6%LPUSH14.0%GET19.0%LPOP13.5%Test Option PopularityOpenBenchmarking.org

Revision History

pts/redis-1.3.1   [View Source]   Thu, 21 Jan 2021 16:21:35 GMT
Increase default iteration count from 1 million to 10 million to lower variation between runs.

pts/redis-1.3.0   [View Source]   Mon, 09 Nov 2020 16:40:33 GMT
Update against Redis 6.0.9 upstream.

pts/redis-1.2.0   [View Source]   Mon, 23 Sep 2019 16:42:34 GMT
Update against upstream Redis 5.0.5

pts/redis-1.1.0   [View Source]   Thu, 01 Mar 2018 15:42:46 GMT
Update against Redis 4.0.8 upstream.

pts/redis-1.0.1   [View Source]   Tue, 08 Aug 2017 09:33:19 GMT
Use the glibc malloc instead of a built-in jemalloc replacement

pts/redis-1.0.0   [View Source]   Wed, 03 Jun 2015 18:51:29 GMT
Initial commit of a redis benchmark!

Suites Using This Test

Database Test Suite

Server

CPU Massive

Server CPU Tests

Single-Threaded


Performance Metrics

Analyze Test Configuration:

Redis 6.0.9

Test: SET

OpenBenchmarking.org metrics for this test profile configuration based on 1,578 public results since 9 November 2020 with the latest data as of 1 March 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Matching Public Results
Requests Per Second (Average)
100th
9
2794541 +/- 63601
100th
5
2741795 +/- 79382
99th
8
2569228 +/- 56523
99th
17
2563609 +/- 173779
99th
8
2553695 +/- 36571
99th
6
2514639 +/- 65874
94th
6
2471500 +/- 49474
94th
6
2467952 +/- 35130
94th
6
2442645 +/- 22312
93rd
3
2407667 +/- 29334
93rd
6
2368618 +/- 34351
93rd
7
2346328 +/- 32631
92nd
6
2194160 +/- 25944
91st
11
2180257 +/- 85614
91st
3
2168842 +/- 16719
91st
3
2150576 +/- 11103
90th
6
2082816 +/- 16940
90th
7
2058610 +/- 37385
90th
3
2043669 +/- 15948
89th
3
2001528 +/- 46558
89th
4
1983042 +/- 4111
89th
6
1969488 +/- 60315
88th
6
1915344 +/- 16851
87th
6
1899773 +/- 49195
86th
8
1885256 +/- 28557
86th
6
1881600 +/- 20323
86th
11
1881398 +/- 51578
86th
8
1879290 +/- 51955
85th
7
1866959 +/- 30613
85th
6
1859653 +/- 10660
85th
6
1857857 +/- 12933
84th
6
1847833 +/- 29381
84th
4
1846565 +/- 9428
83rd
14
1815364 +/- 144338
83rd
6
1791009 +/- 91857
82nd
7
1765733 +/- 30081
82nd
7
1759024 +/- 13581
81st
18
1745975 +/- 16139
80th
6
1725353 +/- 26651
79th
6
1717034 +/- 17949
79th
6
1713956 +/- 8168
79th
6
1707268 +/- 41269
78th
6
1690369 +/- 26701
77th
6
1664055 +/- 14395
77th
6
1661161 +/- 12857
76th
6
1652965 +/- 9546
Mid-Tier
75th
< 1638351
75th
6
1635123 +/- 31868
75th
10
1631085 +/- 39269
75th
7
1626688 +/- 53746
74th
6
1602780 +/- 105413
74th
5
1598929 +/- 16685
74th
6
1577618 +/- 70760
73rd
3
1539423 +/- 21477
72nd
3
1533722 +/- 14759
72nd
9
1527911 +/- 69973
72nd
6
1526774 +/- 66960
71st
3
1482974 +/- 9209
71st
6
1471260 +/- 56635
70th
10
1451060 +/- 86440
70th
4
1442229 +/- 97534
69th
17
1421387 +/- 73685
69th
6
1421193 +/- 14002
69th
3
1420135 +/- 14921
69th
6
1416265 +/- 36186
68th
9
1398784 +/- 45903
68th
3
1394062 +/- 29092
67th
4
1356767 +/- 20564
66th
7
1339091 +/- 26047
65th
14
1320980 +/- 20126
64th
7
1307309 +/- 15845
64th
6
1297839 +/- 30084
64th
3
1296422 +/- 14089
63rd
11
1282775 +/- 44286
63rd
8
1281094 +/- 47267
61st
9
1246870 +/- 150270
59th
3
1216359 +/- 33925
58th
3
1193800 +/- 8339
58th
6
1183373 +/- 44990
55th
7
1090220 +/- 12439
55th
6
1088415 +/- 49544
Median
50th
1041780
50th
4
1039077 +/- 62132
49th
6
1014633 +/- 24173
42nd
3
896914 +/- 7237
41st
6
754258 +/- 5431
28th
3
573559 +/- 1466
28th
8
565032 +/- 22877
Low-Tier
25th
< 550219
7th
6
405741 +/- 6068
6th
6
375613 +/- 3827
5th
7
336157 +/- 2913
5th
3
320691 +/- 5459
2nd
3
225334 +/- 1855
OpenBenchmarking.orgDistribution Of Public Results - Test: SET1578 Results Range From 223333 To 2911860 Requests Per Second2233332771043308753846464384174921885459595997306535017072727610438148148685859223569761271029898108366911374401191211124498212987531352524140629514600661513837156760816213791675150172892117826921836463189023419440051997776205154721053182159089221286022666312320402237417324279442481715253548625892572643028269679927505702804341285811229118834080120160200

Based on OpenBenchmarking.org data, the selected test / test configuration (Redis 6.0.9 - Test: SET) has an average run-time of 3 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkTest: SETRun-Time3691215Min: 1 / Avg: 2.49 / Max: 9

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 1.9%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsTest: SETDeviation3691215Min: 0 / Avg: 1.87 / Max: 7

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

AMDIntelOpenBenchmarking.orgRelative Core Scaling To BaseRedis CPU Core ScalingTest: SET4681216243248640.7581.5162.2743.0323.79

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
CVTSS2SD CVTSI2SD MOVAPD DIVSD MOVDQU MOVD PUNPCKLQDQ PSHUFD MOVDQA UCOMISD
Requires passing a supported compiler/build flag (verified with targets: sandybridge, skylake, tigerlake, cascadelake, sapphirerapids, alderlake, znver2, znver3).
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

 
VEXTRACTF128 VZEROUPPER
Requires passing a supported compiler/build flag (verified with targets: skylake, tigerlake, cascadelake, sapphirerapids, alderlake, znver2, znver3).
Found on Intel processors since Haswell (2013).
Found on AMD processors since Excavator (2016).

 
VPERM2I128 VPBROADCASTQ
The test / benchmark does honor compiler flag changes.
Last automated analysis: 31 January 2021

This test profile binary relies on the shared libraries libm.so.6, libdl.so.2, librt.so.1, libpthread.so.0, libc.so.6.

Recent Test Results

OpenBenchmarking.org Results Compare

1 System - 14 Benchmark Results

Intel Xeon Silver 4214 - 1024MB - 20GB

Ubuntu 20.04 - 5.4.0 - GCC 9.3.0

1 System - 14 Benchmark Results

Intel Xeon E3-12xx v2 - RDO OpenStack Compute - Intel 440FX 82441FX PMC

Ubuntu 20.04 - 5.4.0-65-generic - GCC 9.3.0

1 System - 14 Benchmark Results

AMD EPYC 7702P 64-Core - netcup KVM Server - Intel 440FX 82441FX PMC

Debian 10 - 4.19.0-14-amd64 - GCC 8.3.0

1 System - 14 Benchmark Results

Intel Xeon - Hetzner vServer v20171111 - Intel 440FX 82441FX PMC

Ubuntu 20.04 - 5.4.0-54-generic - GCC 9.3.0

1 System - 14 Benchmark Results

2 x Intel Core - OpenStack Foundation Nova v14.1.1 - Intel 440FX 82441FX PMC

Ubuntu 20.10 - 5.8.0-41-generic - GCC 10.2.0

1 System - 4 Benchmark Results

Intel Core i5-10210U - Intel NUC10i5FNB - Intel Device 02ef

Ubuntu 20.04 - 5.4.0-65-generic - Xfce 4.14

1 System - 14 Benchmark Results

Intel Xeon E5-2650 v4 - DigitalOcean Droplet v20171212 - Intel 440FX 82441FX PMC

Ubuntu 20.04 - 5.4.0-60-generic - GCC 9.3.0

1 System - 13 Benchmark Results

Intel Xeon E5-2680 v2 - Red Hat KVM - Intel 440FX 82441FX PMC

Ubuntu 18.04 - 4.15.0-20-generic - GCC 7.5.0

1 System - 14 Benchmark Results

Intel Xeon Silver 4214 - 1024MB - 20GB

Ubuntu 20.04 - 5.4.0 - GCC 9.3.0

1 System - 14 Benchmark Results

Intel Xeon E5-2690 0 - 4096MB - 59GB

Ubuntu 20.04 - 3.10.0-1127.8.2.vz7.151.14 - GCC 9.3.0

1 System - 14 Benchmark Results

Intel Xeon E3-12xx v2 - RDO OpenStack Compute - Intel 440FX 82441FX PMC

Ubuntu 20.04 - 5.4.0-65-generic - GCC 9.3.0

1 System - 14 Benchmark Results

Intel Xeon Gold 6140 - DigitalOcean Droplet v20171212 - Intel 440FX 82441FX PMC

Ubuntu 20.10 - 5.8.0-25-generic - GCC 10.2.0

Most Popular Test Results

OpenBenchmarking.org Results Compare

3 Systems - 5 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship

Pop 20.10 - 5.8.0-7625-generic - GNOME Shell 3.38.1

5 Systems - 89 Benchmark Results

Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.10 - 5.8.0-36-generic - GNOME Shell 3.38.1

4 Systems - 30 Benchmark Results

Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-38-generic - GNOME Shell 3.38.1

2 Systems - 58 Benchmark Results

AMD Ryzen Threadripper 3960X 24-Core - ASUS PRIME TRX40-PRO - AMD Starship

Arch rolling - 5.10.13-xanmod1-1 - Sway

3 Systems - 108 Benchmark Results

Intel Core i7-3770K - ECS Z77H2-A2X v1.0 - Intel Xeon E3-1200 v2

Ubuntu 20.04 - 5.4.0-58-generic - GNOME Shell 3.36.4

4 Systems - 62 Benchmark Results

AMD Ryzen 5 3600XT 6-Core - MSI X470 GAMING M7 AC - AMD Starship

Ubuntu 20.10 - 5.8.0-33-generic - GNOME Shell 3.38.1

4 Systems - 48 Benchmark Results

AMD Ryzen 5 5600X 6-Core - ASUS TUF GAMING B550M-PLUS - AMD Starship

Ubuntu 20.10 - 5.10.4-051004-generic - GNOME Shell 3.38.1

3 Systems - 85 Benchmark Results

Intel Core i9-9900K - ASRock Z390M Pro4 - Intel Cannon Lake PCH

Ubuntu 20.04 - 5.9.0-050900rc1daily20200819-generic - GNOME Shell 3.36.4

3 Systems - 84 Benchmark Results

Intel Core i9-9900KS - ASUS PRIME Z390-A - Intel Cannon Lake PCH

Ubuntu 20.04 - 5.9.0-050900rc8daily20201005-generic - GNOME Shell 3.36.2

3 Systems - 58 Benchmark Results

Intel Xeon Gold 6226R - Supermicro X11SPL-F v1.02 - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.04 - 5.9.0-050900rc6daily20200921-generic - GNOME Shell 3.36.4

2 Systems - 58 Benchmark Results

AMD Ryzen Threadripper 3960X 24-Core - ASUS PRIME TRX40-PRO - AMD Starship

Arch rolling - 5.10.13-xanmod1-1 - Sway

3 Systems - 75 Benchmark Results

AMD Ryzen Threadripper 3960X 24-Core - MSI Creator TRX40 - AMD Starship

Ubuntu 20.04 - 5.9.0-rc5-14sep-patch - GNOME Shell 3.36.4

Find More Test Results

OpenBenchmarking.org Community User Comments

Post A Comment