Redis

Redis is an open-source in-memory data structure store, used as a database, cache, and message broker.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark redis.

Project Site

redis.io

Test Created

3 June 2015

Last Updated

21 January 2021

Test Maintainer

Michael Larabel 

Test Type

System

Average Install Time

49 Seconds

Average Run Time

1 Minute, 16 Seconds

Test Dependencies

C/C++ Compiler Toolchain

Accolades

100k+ Downloads + 5k+ Public Benchmark Results

Supported Platforms


Public Result Uploads *Reported Installs **Reported Test Completions **Test Profile Page Views ***OpenBenchmarking.orgEventsRedis Popularity Statisticspts/redis2015.062015.092015.122016.032016.062016.092016.122017.032017.062017.092017.122018.032018.062018.092018.122019.032019.062019.092019.122020.032020.062020.092020.122021.032021.0650K100K150K200K250K
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data current as of 2 August 2021.

Revision History

pts/redis-1.3.1   [View Source]   Thu, 21 Jan 2021 16:21:35 GMT
Increase default iteration count from 1 million to 10 million to lower variation between runs.

pts/redis-1.3.0   [View Source]   Mon, 09 Nov 2020 16:40:33 GMT
Update against Redis 6.0.9 upstream.

pts/redis-1.2.0   [View Source]   Mon, 23 Sep 2019 16:42:34 GMT
Update against upstream Redis 5.0.5

pts/redis-1.1.0   [View Source]   Thu, 01 Mar 2018 15:42:46 GMT
Update against Redis 4.0.8 upstream.

pts/redis-1.0.1   [View Source]   Tue, 08 Aug 2017 09:33:19 GMT
Use the glibc malloc instead of a built-in jemalloc replacement

pts/redis-1.0.0   [View Source]   Wed, 03 Jun 2015 18:51:29 GMT
Initial commit of a redis benchmark!

Suites Using This Test

Database Test Suite

Server

CPU Massive

Server CPU Tests

Single-Threaded


Performance Metrics

Analyze Test Configuration:

Redis 6.0.9

Test: SET

OpenBenchmarking.org metrics for this test profile configuration based on 24,102 public results since 9 November 2020 with the latest data as of 2 August 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
Requests Per Second (Average)
100th
7
2969973 +/- 19032
100th
10
2796376 +/- 60244
100th
5
2741795 +/- 79382
100th
22
2576924 +/- 162461
100th
12
2572850 +/- 139488
100th
8
2569228 +/- 56523
100th
8
2553695 +/- 36571
100th
7
2511546 +/- 119716
100th
6
2442645 +/- 22312
100th
3
2407667 +/- 29334
100th
6
2368618 +/- 34351
100th
7
2346328 +/- 32631
100th
6
2194160 +/- 25944
100th
11
2180257 +/- 85614
100th
3
2168842 +/- 16719
100th
3
2150576 +/- 11103
100th
6
2082816 +/- 16940
100th
7
2058610 +/- 37385
100th
3
2043669 +/- 15948
100th
4
2029881 +/- 100944
100th
4
1996684 +/- 39230
100th
4
1983042 +/- 4111
100th
6
1969488 +/- 60315
100th
6
1915344 +/- 16851
100th
6
1899773 +/- 49195
100th
29
1894204 +/- 15132
100th
8
1885256 +/- 28557
100th
11
1882951 +/- 62021
100th
11
1881398 +/- 51578
100th
8
1879290 +/- 51955
100th
7
1874304 +/- 65415
100th
4
1870272 +/- 21594
100th
7
1866959 +/- 30613
100th
6
1859653 +/- 10660
100th
6
1859020 +/- 60656
100th
6
1857857 +/- 12933
100th
4
1851390 +/- 33044
100th
6
1847833 +/- 29381
100th
4
1846565 +/- 9428
100th
4
1837660 +/- 119100
100th
3
1833884 +/- 6349
100th
17
1822476 +/- 131092
100th
6
1791009 +/- 91857
100th
6
1779965 +/- 141629
100th
3
1776111 +/- 63204
100th
4
1767702 +/- 22816
100th
7
1759024 +/- 13581
100th
9
1746623 +/- 126201
100th
18
1745975 +/- 16139
100th
6
1725353 +/- 26651
100th
6
1717034 +/- 17949
100th
6
1713956 +/- 8168
100th
6
1707268 +/- 41269
100th
8
1700061 +/- 29305
100th
8
1692487 +/- 47042
99th
6
1661161 +/- 12857
99th
6
1652965 +/- 9546
99th
7
1640272 +/- 64281
99th
6
1635123 +/- 31868
99th
10
1631085 +/- 39269
99th
7
1626688 +/- 53746
99th
6
1602780 +/- 105413
99th
5
1598929 +/- 16685
99th
6
1577618 +/- 70760
99th
39
1573458 +/- 155765
99th
3
1539423 +/- 21477
99th
3
1533722 +/- 14759
99th
9
1527911 +/- 69973
99th
6
1526774 +/- 66960
99th
6
1482313 +/- 15474
99th
6
1471260 +/- 56635
99th
10
1451060 +/- 86440
99th
4
1442229 +/- 97534
99th
4
1436477 +/- 27667
98th
7
1424465 +/- 39520
98th
6
1421193 +/- 14002
98th
3
1420135 +/- 14921
98th
7
1413263 +/- 29520
98th
19
1407993 +/- 80316
98th
9
1398784 +/- 45903
98th
4
1356767 +/- 20564
98th
9
1336139 +/- 23826
98th
3
1322422 +/- 15918
98th
15
1321423 +/- 19470
98th
7
1307309 +/- 15845
98th
6
1297839 +/- 30084
98th
3
1296422 +/- 14089
98th
11
1282775 +/- 44286
98th
10
1272492 +/- 45668
96th
3
1216359 +/- 33925
96th
12
1215781 +/- 140027
96th
5
1204142 +/- 8083
96th
3
1193800 +/- 8339
95th
4
1191057 +/- 3573
95th
5
1189529 +/- 6383
95th
5
1188299 +/- 3248
95th
5
1186328 +/- 5838
95th
8
1181656 +/- 38188
95th
5
1174953 +/- 9466
95th
5
1159025 +/- 6224
95th
11
1147741 +/- 19590
95th
5
1146577 +/- 6669
95th
5
1128279 +/- 3026
95th
7
1090220 +/- 12439
95th
7
1089419 +/- 45305
95th
4
1039077 +/- 62132
95th
6
1014633 +/- 24173
93rd
3
896914 +/- 7237
92nd
3
825947 +/- 44051
92nd
6
754258 +/- 5431
Mid-Tier
75th
< 669010
67th
3
573559 +/- 1466
65th
8
565032 +/- 22877
Median
50th
547608
3rd
7
393381 +/- 33165
Low-Tier
25th
< 531845
3rd
6
375613 +/- 3827
3rd
3
348458 +/- 2879
3rd
7
336157 +/- 2913
3rd
3
320691 +/- 5459
2nd
3
228529 +/- 1561
2nd
3
225334 +/- 1855
OpenBenchmarking.orgDistribution Of Public Results - Test: SET22845 Results Range From 148668 To 2990165 Requests Per Second1486682054982623283191583759884328184896485464786033086601387169687737988306288874589442881001118105794811147781171608122843812852681342098139892814557581512588156941816262481683078173990817967381853568191039819672282024058208088821377182194548225137823082082365038242186824786982535528259235826491882706018276284828196782876508293333829901682K4K6K8K10K

Based on OpenBenchmarking.org data, the selected test / test configuration (Redis 6.0.9 - Test: SET) has an average run-time of 4 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkTest: SETRun-Time3691215Min: 1 / Avg: 3.34 / Max: 11

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 1.9%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsTest: SETDeviation246810Min: 0 / Avg: 1.88 / Max: 5

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

AMDIntelOpenBenchmarking.orgRelative Core Scaling To BaseRedis CPU Core ScalingTest: SET4681216243248640.72431.44862.17292.89723.6215

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
CVTSS2SD CVTSI2SD MOVAPD DIVSD MOVDQU MOVD PUNPCKLQDQ PSHUFD UCOMISD MOVDQA
Requires passing a supported compiler/build flag (verified with targets: sandybridge, skylake, tigerlake, cascadelake, znver2, znver3).
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

 
VEXTRACTF128 VZEROUPPER
Requires passing a supported compiler/build flag (verified with targets: skylake, tigerlake, cascadelake, znver2, znver3).
Found on Intel processors since Haswell (2013).
Found on AMD processors since Excavator (2016).

 
VPERM2I128 VPBROADCASTD VPBROADCASTQ
The test / benchmark does honor compiler flag changes.
Last automated analysis: 10 May 2021

This test profile binary relies on the shared libraries libm.so.6, libpthread.so.0, libc.so.6.

Recent Test Results

OpenBenchmarking.org Results Compare

1 System - 5 Benchmark Results

Intel Core i3-8100T - LENOVO 313D - Intel Cannon Lake PCH

Ubuntu 20.04 - 5.8.0-63-generic - GNOME Shell 3.36.9

1 System - 5 Benchmark Results

ARMv8 Cortex-A72 - BCM2835 Raspberry Pi 4 Model B Rev 1.4 - 2048MB

Debian 10 - 5.10.17-v8+ - GCC 8.3.0

1 System - 5 Benchmark Results

Intel Core i5-2410M - ASUS U30Sd v1.0 - Intel 2nd Generation Core DRAM

Debian 10 - 4.19.0-17-amd64 - GCC 8.3.0

1 System - 288 Benchmark Results

AMD EPYC 7543 32-Core - TYAN S8036GM2NE-LE - AMD Starship

Ubuntu 21.04 - 5.11.0-25-generic - GNOME Shell 3.38.4

1 System - 17 Benchmark Results

Unknown - BCM2835 Raspberry Pi 4 Model B Rev 1.1 - 4096MB

Debian 10 - 5.10.11-v8+ - GCC 8.3.0

1 System - 133 Benchmark Results

Intel Celeron J3455 - PMB v1.0 - Intel Celeron N3350

Ubuntu 20.04 - 5.8.0-59-generic - GNOME Shell 3.36.9

1 System - 206 Benchmark Results

AMD EPYC 7352 24-Core - Dell 07PXPY - AMD Starship

Debian 10 - 4.19.0-17-amd64 - GCC 8.3.0

1 System - 5 Benchmark Results

4 x Intel Xeon - Red Hat KVM - Intel 440FX 82441FX PMC

Ubuntu 20.04 - 5.4.0-48-generic - GCC 9.3.0

3 Systems - 173 Benchmark Results

2 x Intel Xeon E5-2690 0 - HP ProLiant DL380p Gen8 - Intel Xeon E5

Ubuntu 18.04 - 5.4.0-65-generic - X Server 1.20.8

2 Systems - 173 Benchmark Results

2 x Intel Xeon E5-2690 0 - HP ProLiant DL380p Gen8 - Intel Xeon E5

Ubuntu 18.04 - 5.4.0-65-generic - X Server 1.20.8

1 System - 173 Benchmark Results

2 x Intel Xeon E5-2690 0 - HP ProLiant DL380p Gen8 - Intel Xeon E5

Ubuntu 18.04 - 5.4.0-65-generic - X Server 1.20.8

1 System - 87 Benchmark Results

2 x Intel Xeon E5-2690 0 - HP ProLiant DL380p Gen8 - Intel Xeon E5

Ubuntu 18.04 - 5.4.0-65-generic - X Server 1.20.8

Most Popular Test Results

OpenBenchmarking.org Results Compare

4 Systems - 13 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship

Pop 20.10 - 5.8.0-7630-generic - GNOME Shell 3.38.2

3 Systems - 5 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship

Pop 20.10 - 5.8.0-7625-generic - GNOME Shell 3.38.1

3 Systems - 13 Benchmark Results

AMD Ryzen 7 3800XT 8-Core - MSI X370 XPOWER GAMING TITANIUM - AMD Starship

Debian 10 - 4.19.0-13-amd64 - X Server 1.20.4

3 Systems - 13 Benchmark Results

Intel Xeon Silver 4216 - TYAN S7100AG2NR - Intel Sky Lake-E DMI3 Registers

Debian 10 - 4.19.0-9-amd64 - GNOME Shell 3.30.2

4 Systems - 34 Benchmark Results

Intel Xeon E3-1235L v5 - ASRockRack C236M WS - Intel Xeon E3-1200 v5

Ubuntu 20.04 - 5.8.0-050800-generic - GNOME Shell 3.36.4

5 Systems - 89 Benchmark Results

Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.10 - 5.8.0-36-generic - GNOME Shell 3.38.1

4 Systems - 30 Benchmark Results

Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-38-generic - GNOME Shell 3.38.1

3 Systems - 108 Benchmark Results

Intel Core i7-3770K - ECS Z77H2-A2X v1.0 - Intel Xeon E3-1200 v2

Ubuntu 20.04 - 5.4.0-58-generic - GNOME Shell 3.36.4

3 Systems - 85 Benchmark Results

Intel Core i9-9900K - ASRock Z390M Pro4 - Intel Cannon Lake PCH

Ubuntu 20.04 - 5.9.0-050900rc1daily20200819-generic - GNOME Shell 3.36.4

4 Systems - 62 Benchmark Results

AMD Ryzen 5 3600XT 6-Core - MSI X470 GAMING M7 AC - AMD Starship

Ubuntu 20.10 - 5.8.0-33-generic - GNOME Shell 3.38.1

5 Systems - 75 Benchmark Results

AMD Ryzen 5 PRO 4650G - ASUS TUF X470-PLUS GAMING - AMD Renoir Root Complex

Clear Linux OS 34420 - 5.10.19-1032.native - GCC 10.2.1 20210318 releases

2 Systems - 58 Benchmark Results

AMD Ryzen Threadripper 3960X 24-Core - ASUS PRIME TRX40-PRO - AMD Starship

Arch rolling - 5.10.13-xanmod1-1 - Sway

Find More Test Results