Redis Memtier / Redis Benchmark

Redis is an open-source in-memory data structure store, used as a database, cache, and message broker. This test profile is for testing any system-installed Redis copy. The redis-server and redis-benchmark software must be present in PATH. To use a static / locally built version of Redis, run the pts/redis test profile instead.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark system/redis.

Project Site

redis.io

Source Repository

github.com

Test Created

28 April 2016

Last Updated

4 November 2021

Test Maintainer

 

Test Type

Average Install Time

9 Seconds

Average Run Time

3 Minutes, 50 Seconds

Test Dependencies

C/C++ Compiler Toolchain + Zlib + Libevent

Accolades

20k+ Downloads

Reported Installs **Reported Test Completions **Public Result Uploads *Test Profile Page Views ***OpenBenchmarking.orgEventsRedis Memtier / Redis Benchmark Popularity Statisticssystem/redis2016.042016.062016.082016.102016.122017.022017.042017.062017.082017.102017.122018.022018.042018.062018.082018.102018.122019.022019.042019.062019.082019.102019.122020.022020.042020.062020.082020.102020.122021.022021.042021.062021.082021.104K8K12K16K20K
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data current as of 30 November 2021.
MIX34.3%SET31.0%GET34.7%Test Option PopularityOpenBenchmarking.org

Revision History

system/redis-1.1.1   [View Source]   Thu, 04 Nov 2021 14:24:04 GMT
Set --distinct-client-seed Closes: https://github.com/phoronix-test-suite/test-profiles/pull/210

system/redis-1.1.0   [View Source]   Sat, 16 Oct 2021 06:44:17 GMT
Cleaned up version of system redis test @ https://github.com/phoronix-test-suite/test-profiles/pull/208

system/redis-1.0.0   [View Source]   Thu, 28 Apr 2016 15:57:51 GMT
Initial commit of redis using system binary.


Performance Metrics

Analyze Test Configuration:

Redis Memtier / Redis Benchmark

Test: LPUSH and LPOP: lpush

OpenBenchmarking.org metrics for this test profile configuration based on 196 public results since 16 October 2021 with the latest data as of 27 November 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
Requests Per Second (Average)
100th
3
2569225 +/- 14729
99th
4
2225008 +/- 12471
97th
3
2009108 +/- 9085
95th
4
1863364 +/- 1885
93rd
3
1826807 +/- 5028
92nd
4
1770143 +/- 48279
86th
3
1665667 +/- 6647
85th
3
1650865 +/- 37256
84th
4
1628864 +/- 5993
83rd
5
1621510 +/- 57880
80th
3
1580531 +/- 2840
79th
5
1546404 +/- 118835
78th
3
1505528 +/- 7193
Mid-Tier
75th
< 1449465
72nd
7
1316952 +/- 7807
71st
3
1305663 +/- 41301
65th
4
1279588 +/- 11678
59th
3
1250051 +/- 9154
58th
3
1242509 +/- 10857
54th
4
1235013 +/- 6494
54th
3
1234073 +/- 2893
Median
50th
1231088
49th
6
1228234 +/- 16824
49th
3
1227135 +/- 5961
49th
4
1216376 +/- 66116
48th
4
1207345 +/- 109359
40th
8
1174210 +/- 38730
33rd
3
1064980 +/- 9421
30th
7
1043307 +/- 23745
28th
3
1021918 +/- 4777
Low-Tier
25th
< 1003930
24th
5
952800 +/- 47479
20th
7
931859 +/- 15929
18th
3
916009 +/- 9265
13th
6
852143 +/- 8500
10th
3
791768 +/- 5769
8th
3
585868 +/- 10434
6th
3
292377 +/- 747
3rd
3
243089 +/- 962
OpenBenchmarking.orgDistribution Of Public Results - Test: LPUSH and LPOP: lpush196 Results Range From 231258 To 2586224 Requests Per Second2312582783583254583725584196584667585138585609586080586551587022587493587964588435588906589377589848581031958107905811261581173258122035812674581314558136165814087581455858150295815500581597158164425816913581738458178555818326581879758192685819739582021058206815821152582162358220945822565582303658235075823978582444958249205825391582586258612182430

Based on OpenBenchmarking.org data, the selected test / test configuration (Redis Memtier / Redis Benchmark - Test: LPUSH and LPOP: lpush) has an average run-time of 3 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkTest: LPUSH and LPOP: lpushRun-Time48121620Min: 1 / Avg: 2.59 / Max: 17

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.2%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsTest: LPUSH and LPOP: lpushDeviation246810Min: 0 / Avg: 0.25 / Max: 2

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

IntelAMDOpenBenchmarking.orgRelative Core Scaling To BaseRedis Memtier / Redis Benchmark CPU Core ScalingTest: LPUSH and LPOP: lpush468160.46250.9251.38751.852.3125

Recent Test Results

OpenBenchmarking.org Results Compare

6 Systems - 103 Benchmark Results

Ampere ARMv8 Neoverse-N1 - WIWYNN Mt.Jade - Ampere Computing LLC Altra PCI Root Complex A

Ubuntu 21.10 - 5.13.0-20-generic - GCC 11.2.0

4 Systems - 75 Benchmark Results

AMD Ryzen Threadripper 2970WX 24-Core - Gigabyte X399 AORUS Gaming 7 - AMD 17h

Ubuntu 20.04 - 5.9.0-050900rc6daily20200926-generic - GNOME Shell 3.36.4

2 Systems - 30 Benchmark Results

AMD Ryzen 7 5700G - ASUS TUF GAMING B550M-PLUS - AMD Renoir Root Complex

Ubuntu 21.10 - 5.14.0-rc7-amd-pstate-phx - GNOME Shell 40.2

4 Systems - 151 Benchmark Results

AMD Ryzen Threadripper 3960X 24-Core - MSI Creator TRX40 - AMD Starship

Ubuntu 20.04 - 5.12.0-051200rc2daily20210307-generic - GNOME Shell 3.36.4

3 Systems - 203 Benchmark Results

Intel Core i7-8086K - ASUS PRIME Z370-A - Intel 8th Gen Core

Ubuntu 20.04 - 5.9.0-050900rc8daily20201009-generic - GNOME Shell 3.36.4

4 Systems - 98 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Ubuntu 20.10 - 5.11.0-rc6-phx - GNOME Shell 3.38.1

3 Systems - 77 Benchmark Results

2 x AMD EPYC 7601 32-Core - Dell 02MJ3T - AMD 17h

Ubuntu 19.10 - 5.9.0-050900rc6daily20200922-generic - GNOME Shell 3.34.1

4 Systems - 113 Benchmark Results

Intel Xeon Gold 6226R - Supermicro X11SPL-F v1.02 - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.10 - 5.11.0-rc4-max-boost-inv-patch - GNOME Shell 3.38.1

4 Systems - 202 Benchmark Results

2 x Intel Xeon Platinum 8280 - GIGABYTE MD61-SC2-00 v01000100 - Intel Sky Lake-E DMI3 Registers

Ubuntu 21.04 - 5.11.0-34-generic - GNOME Shell 3.38.4

5 Systems - 200 Benchmark Results

2 x Intel Xeon Gold 5220R - TYAN S7106 - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.04 - 5.9.0-050900rc6-generic - GNOME Shell 3.36.4

5 Systems - 94 Benchmark Results

2 x AMD EPYC 7742 64-Core - Supermicro H11DSi-NT v2.00 - AMD Starship

Ubuntu 21.10 - 5.15.0-rc4-cluster-sched - GNOME Shell 40.5

3 Systems - 104 Benchmark Results

AMD EPYC 72F3 8-Core - Supermicro H12SSL-i v1.01 - AMD Starship

Ubuntu 21.04 - 5.14.0-rc7-amd-pstate-phx - GNOME Shell 3.38.4

Most Popular Test Results

OpenBenchmarking.org Results Compare

2 Systems - 160 Benchmark Results

Intel Core i9-10980XE - ASRock X299 Steel Legend - Intel Sky Lake-E DMI3 Registers

Clear Linux OS 35150 - 5.14.13-1083.native - GNOME Shell 41.0

3 Systems - 141 Benchmark Results

2 x AMD EPYC 75F3 32-Core - ASRockRack ROME2D16-2T - AMD Starship

Clear Linux OS 35150 - 5.14.13-1083.native - GNOME Shell 41.0

3 Systems - 12 Benchmark Results

AMD Ryzen 5 4500U - LENOVO LNVNB161216 - AMD Renoir Root Complex

Ubuntu 21.04 - 5.13.0-051300-generic - GNOME Shell 3.38.4

3 Systems - 25 Benchmark Results

ARMv8 Cortex-A72 - BCM2835 Raspberry Pi 400 Rev 1.0 - 4096MB

Debian 10 - 5.4.51-v8+ - LXDE 0.10.0

4 Systems - 52 Benchmark Results

Intel Core i9-11900K - ASUS ROG MAXIMUS XIII HERO - Intel Tiger Lake-H

Ubuntu 21.10 - 5.13.0-19-generic - GNOME Shell 40.5

3 Systems - 51 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Ubuntu 20.10 - 5.11.0-rc6-phx - GNOME Shell 3.38.1

2 Systems - 140 Benchmark Results

2 x AMD EPYC 75F3 32-Core - ASRockRack ROME2D16-2T - AMD Starship

Clear Linux OS 35150 - 5.14.13-1083.native - GNOME Shell 41.0

3 Systems - 13 Benchmark Results

Intel Core i7-1165G7 - Dell 0GG9PT - Intel Tiger Lake-LP

Clear Linux OS 35130 - 5.14.12-1082.native - GNOME Shell 41.0

3 Systems - 13 Benchmark Results

Intel Core i7-1065G7 - Dell 06CDVY - Intel Ice Lake-LP DRAM

Ubuntu 21.04 - 5.13.0-051300-generic - GNOME Shell 3.38.4

4 Systems - 52 Benchmark Results

Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH

Ubuntu 21.04 - 5.11.0-37-generic - GNOME Shell 3.38.4

4 Systems - 141 Benchmark Results

2 x AMD EPYC 75F3 32-Core - ASRockRack ROME2D16-2T - AMD Starship

Ubuntu 21.10 - 5.13.0-20-generic - GNOME Shell 40.5

3 Systems - 13 Benchmark Results

AMD EPYC 75F3 32-Core - ASRockRack ROME2D16-2T - AMD Starship

Ubuntu 21.10 - 5.13.0-19-generic - GNOME Shell 40.5

3 Systems - 11 Benchmark Results

AMD Ryzen 3 3200U - MOTILE PF4PU1F - AMD Raven

Ubuntu 20.04 - 5.11.0-37-generic - GNOME Shell 3.36.4

3 Systems - 11 Benchmark Results

AMD Ryzen 7 4700U - LENOVO LNVNB161216 - AMD Renoir Root Complex

Ubuntu 21.04 - 5.13.0-051300-generic - GNOME Shell 3.38.4

3 Systems - 60 Benchmark Results

Intel Core i9-10980XE - ASRock X299 Steel Legend - Intel Sky Lake-E DMI3 Registers

Ubuntu 21.04 - 5.11.0-31-generic - GNOME Shell 3.38.4

Find More Test Results