Redis

Redis is an open-source in-memory data structure store, used as a database, cache, and message broker.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark redis.

Project Site

redis.io

Test Created

3 June 2015

Last Updated

21 January 2021

Test Maintainer

Michael Larabel 

Test Type

System

Average Install Time

48 Seconds

Average Run Time

1 Minute, 15 Seconds

Test Dependencies

C/C++ Compiler Toolchain

Accolades

100k+ Downloads + 5k+ Public Benchmark Results

Supported Platforms


Public Result UploadsReported Installs*Test Completions*OpenBenchmarking.orgEventsRedis Popularity Statisticspts/redis2015.062015.082015.102015.122016.022016.042016.062016.082016.102016.122017.022017.042017.062017.082017.102017.122018.022018.042018.062018.082018.102018.122019.022019.042019.062019.082019.102019.122020.022020.042020.062020.082020.102020.122021.022021.0420K40K60K80K100K
* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Sat, 10 Apr 2021 00:42:43 GMT.
SET94.1%GET5.9%Test Option PopularityOpenBenchmarking.org

Revision History

pts/redis-1.3.1   [View Source]   Thu, 21 Jan 2021 16:21:35 GMT
Increase default iteration count from 1 million to 10 million to lower variation between runs.

pts/redis-1.3.0   [View Source]   Mon, 09 Nov 2020 16:40:33 GMT
Update against Redis 6.0.9 upstream.

pts/redis-1.2.0   [View Source]   Mon, 23 Sep 2019 16:42:34 GMT
Update against upstream Redis 5.0.5

pts/redis-1.1.0   [View Source]   Thu, 01 Mar 2018 15:42:46 GMT
Update against Redis 4.0.8 upstream.

pts/redis-1.0.1   [View Source]   Tue, 08 Aug 2017 09:33:19 GMT
Use the glibc malloc instead of a built-in jemalloc replacement

pts/redis-1.0.0   [View Source]   Wed, 03 Jun 2015 18:51:29 GMT
Initial commit of a redis benchmark!

Suites Using This Test

Database Test Suite

Server

CPU Massive

Server CPU Tests

Single-Threaded


Performance Metrics

Analyze Test Configuration:

Redis 6.0.9

Test: SET

OpenBenchmarking.org metrics for this test profile configuration based on 18,970 public results since 9 November 2020 with the latest data as of 10 April 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Matching Public Results
Requests Per Second (Average)
100th
10
2796376 +/- 60244
100th
5
2741795 +/- 79382
100th
21
2584608 +/- 162325
100th
8
2569228 +/- 56523
100th
11
2565104 +/- 143564
100th
8
2553695 +/- 36571
100th
6
2467952 +/- 35130
100th
6
2442645 +/- 22312
100th
3
2407667 +/- 29334
100th
6
2368618 +/- 34351
100th
7
2346328 +/- 32631
100th
6
2194160 +/- 25944
100th
11
2180257 +/- 85614
100th
3
2168842 +/- 16719
100th
3
2150576 +/- 11103
100th
6
2082816 +/- 16940
100th
7
2058610 +/- 37385
100th
3
2043669 +/- 15948
100th
4
1996684 +/- 39230
100th
4
1983042 +/- 4111
100th
6
1969488 +/- 60315
100th
6
1915344 +/- 16851
100th
3
1909830 +/- 51403
100th
6
1899773 +/- 49195
100th
29
1894204 +/- 15132
100th
8
1885256 +/- 28557
100th
11
1881398 +/- 51578
100th
3
1879872 +/- 65907
100th
8
1879290 +/- 51955
100th
7
1866959 +/- 30613
100th
6
1859653 +/- 10660
100th
6
1857857 +/- 12933
100th
6
1847833 +/- 29381
100th
4
1846565 +/- 9428
99th
3
1833884 +/- 6349
99th
17
1822476 +/- 131092
99th
3
1806588 +/- 7278
99th
3
1798329 +/- 11356
99th
6
1791009 +/- 91857
99th
9
1783373 +/- 44041
99th
7
1759024 +/- 13581
99th
18
1745975 +/- 16139
99th
6
1728298 +/- 116234
99th
6
1725353 +/- 26651
99th
6
1717034 +/- 17949
99th
6
1713956 +/- 8168
99th
6
1707268 +/- 41269
99th
6
1690369 +/- 26701
99th
6
1661161 +/- 12857
99th
6
1652965 +/- 9546
99th
7
1640272 +/- 64281
98th
6
1635123 +/- 31868
98th
10
1631085 +/- 39269
98th
7
1626688 +/- 53746
98th
6
1602780 +/- 105413
98th
5
1598929 +/- 16685
98th
47
1584340 +/- 143642
98th
6
1577618 +/- 70760
98th
3
1539423 +/- 21477
98th
3
1533722 +/- 14759
98th
9
1527911 +/- 69973
98th
6
1526774 +/- 66960
98th
3
1482974 +/- 9209
98th
6
1471260 +/- 56635
98th
10
1451060 +/- 86440
98th
4
1442229 +/- 97534
98th
3
1436005 +/- 33865
98th
6
1421193 +/- 14002
98th
3
1420135 +/- 14921
98th
6
1416265 +/- 36186
98th
19
1407993 +/- 80316
98th
9
1398784 +/- 45903
98th
3
1394062 +/- 29092
98th
4
1356767 +/- 20564
98th
9
1336139 +/- 23826
97th
3
1322422 +/- 15918
97th
15
1321423 +/- 19470
97th
7
1307309 +/- 15845
97th
6
1297839 +/- 30084
97th
3
1296422 +/- 14089
97th
11
1282775 +/- 44286
97th
10
1272492 +/- 45668
96th
3
1216359 +/- 33925
96th
12
1215781 +/- 140027
96th
5
1204142 +/- 8083
96th
3
1193800 +/- 8339
96th
4
1191057 +/- 3573
96th
5
1189529 +/- 6383
96th
5
1188299 +/- 3248
96th
5
1186328 +/- 5838
96th
8
1181656 +/- 38188
96th
5
1174953 +/- 9466
95th
5
1159025 +/- 6224
95th
5
1149978 +/- 5650
95th
5
1146577 +/- 6669
95th
5
1128279 +/- 3026
95th
7
1090220 +/- 12439
95th
7
1089419 +/- 45305
95th
4
1039077 +/- 62132
94th
6
1014633 +/- 24173
92nd
3
896914 +/- 7237
91st
6
754258 +/- 5431
Mid-Tier
75th
< 682962
53rd
3
573559 +/- 1466
53rd
8
565032 +/- 22877
Median
50th
550826
3rd
6
405741 +/- 6068
Low-Tier
25th
< 528344
3rd
6
375613 +/- 3827
3rd
7
336157 +/- 2913
3rd
3
320691 +/- 5459
2nd
3
225334 +/- 1855
OpenBenchmarking.orgDistribution Of Public Results - Test: SET18507 Results Range From 148668 To 2911860 Requests Per Second1486682039322591963144603697244249884802525355165907806460447013087565728118368671009223649776281032892108815611434201198684125394813092121364476141974014750041530268158553216407961696060175132418065881861852191711619723802027644208290821381722193436224870023039642359228241449224697562525020258028426355482690812274607628013402856604291186812002400360048006000

Based on OpenBenchmarking.org data, the selected test / test configuration (Redis 6.0.9 - Test: SET) has an average run-time of 4 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkTest: SETRun-Time3691215Min: 1 / Avg: 3.49 / Max: 11

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 2%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsTest: SETDeviation246810Min: 0 / Avg: 1.98 / Max: 5

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

AMDIntelOpenBenchmarking.orgRelative Core Scaling To BaseRedis CPU Core ScalingTest: SET4681216243248641280.71251.4252.13752.853.5625

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
CVTSS2SD CVTSI2SD MOVAPD DIVSD MOVDQU MOVD PUNPCKLQDQ PSHUFD MOVDQA UCOMISD
Requires passing a supported compiler/build flag (verified with targets: sandybridge, skylake, tigerlake, cascadelake, sapphirerapids, alderlake, znver2, znver3).
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

 
VEXTRACTF128 VZEROUPPER
Requires passing a supported compiler/build flag (verified with targets: skylake, tigerlake, cascadelake, sapphirerapids, alderlake, znver2, znver3).
Found on Intel processors since Haswell (2013).
Found on AMD processors since Excavator (2016).

 
VPERM2I128 VPBROADCASTQ
The test / benchmark does honor compiler flag changes.
Last automated analysis: 31 January 2021

This test profile binary relies on the shared libraries libm.so.6, libdl.so.2, librt.so.1, libpthread.so.0, libc.so.6.

Recent Test Results

OpenBenchmarking.org Results Compare

1 System - 14 Benchmark Results

Intel Xeon Silver 4214 - 1024MB - 20GB

Ubuntu 20.04 - 5.4.0 - GCC 9.3.0

1 System - 13 Benchmark Results

Intel Xeon E5-2680 v2 - Red Hat KVM - Intel 440FX 82441FX PMC

Ubuntu 18.04 - 4.15.0-136-generic - GCC 7.5.0

1 System - 14 Benchmark Results

AMD EPYC 7702P 64-Core - netcup KVM Server - Intel 440FX 82441FX PMC

Debian 10 - 4.19.0-14-amd64 - GCC 8.3.0

1 System - 14 Benchmark Results

Intel Xeon Silver 4214 - 1024MB - 20GB

Ubuntu 20.04 - 5.4.0 - GCC 9.3.0

1 System - 13 Benchmark Results

Intel Xeon E5-2680 v2 - Red Hat KVM - Intel 440FX 82441FX PMC

Ubuntu 18.04 - 4.15.0-136-generic - GCC 7.5.0

1 System - 14 Benchmark Results

AMD EPYC 7702P 64-Core - netcup KVM Server - Intel 440FX 82441FX PMC

Debian 10 - 4.19.0-14-amd64 - GCC 8.3.0

1 System - 14 Benchmark Results

Intel Xeon Silver 4214 - 1024MB - 20GB

Ubuntu 20.04 - 5.4.0 - GCC 9.3.0

1 System - 13 Benchmark Results

Intel Xeon E5-2680 v2 - Red Hat KVM - Intel 440FX 82441FX PMC

Ubuntu 18.04 - 4.15.0-136-generic - GCC 7.5.0

1 System - 14 Benchmark Results

AMD EPYC 7702P 64-Core - netcup KVM Server - Intel 440FX 82441FX PMC

Debian 10 - 4.19.0-14-amd64 - GCC 8.3.0

3 Systems - 5 Benchmark Results

Intel Core i7-1165G7 - Dell 08607K - Intel Device a0ef

Ubuntu 20.04 - 5.6.0-1042-oem - GNOME Shell 3.36.4

1 System - 5 Benchmark Results

Intel Core i7-1165G7 - Dell 08607K - Intel Device a0ef

Ubuntu 20.04 - 5.6.0-1042-oem - GNOME Shell 3.36.4

1 System - 13 Benchmark Results

Intel Xeon E5-2680 v2 - Red Hat KVM - Intel 440FX 82441FX PMC

Ubuntu 18.04 - 4.15.0-136-generic - GCC 7.5.0

Most Popular Test Results

OpenBenchmarking.org Results Compare

3 Systems - 5 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship

Pop 20.10 - 5.8.0-7625-generic - GNOME Shell 3.38.1

5 Systems - 89 Benchmark Results

Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.10 - 5.8.0-36-generic - GNOME Shell 3.38.1

4 Systems - 30 Benchmark Results

Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-38-generic - GNOME Shell 3.38.1

3 Systems - 108 Benchmark Results

Intel Core i7-3770K - ECS Z77H2-A2X v1.0 - Intel Xeon E3-1200 v2

Ubuntu 20.04 - 5.4.0-58-generic - GNOME Shell 3.36.4

2 Systems - 58 Benchmark Results

AMD Ryzen Threadripper 3960X 24-Core - ASUS PRIME TRX40-PRO - AMD Starship

Arch rolling - 5.10.13-xanmod1-1 - Sway

4 Systems - 62 Benchmark Results

AMD Ryzen 5 3600XT 6-Core - MSI X470 GAMING M7 AC - AMD Starship

Ubuntu 20.10 - 5.8.0-33-generic - GNOME Shell 3.38.1

4 Systems - 13 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship

Pop 20.10 - 5.8.0-7630-generic - GNOME Shell 3.38.2

4 Systems - 48 Benchmark Results

AMD Ryzen 5 5600X 6-Core - ASUS TUF GAMING B550M-PLUS - AMD Starship

Ubuntu 20.10 - 5.10.4-051004-generic - GNOME Shell 3.38.1

3 Systems - 85 Benchmark Results

Intel Core i9-9900K - ASRock Z390M Pro4 - Intel Cannon Lake PCH

Ubuntu 20.04 - 5.9.0-050900rc1daily20200819-generic - GNOME Shell 3.36.4

5 Systems - 75 Benchmark Results

AMD Ryzen 5 PRO 4650G - ASUS TUF X470-PLUS GAMING - AMD Renoir Root Complex

Clear Linux OS 34420 - 5.10.19-1032.native - GCC 10.2.1 20210318 releases

3 Systems - 84 Benchmark Results

Intel Core i9-9900KS - ASUS PRIME Z390-A - Intel Cannon Lake PCH

Ubuntu 20.04 - 5.9.0-050900rc8daily20201005-generic - GNOME Shell 3.36.2

3 Systems - 58 Benchmark Results

Intel Xeon Gold 6226R - Supermicro X11SPL-F v1.02 - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.04 - 5.9.0-050900rc6daily20200921-generic - GNOME Shell 3.36.4

Find More Test Results