KeyDB

A benchmark of KeyDB as a multi-threaded fork of the Redis server. The KeyDB benchmark is conducted using memtier-benchmark.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark keydb.

Project Site

keydb.dev

Test Created

7 October 2019

Last Updated

28 September 2020

Test Maintainer

Michael Larabel 

Test Type

System

Average Install Time

1 Minute, 7 Seconds

Average Run Time

7 Minutes, 35 Seconds

Test Dependencies

C/C++ Compiler Toolchain + Libevent + Perl Compatible Regular Expressions + OpenSSL + Libtool + Curl + UUID

Accolades

10k+ Downloads

Supported Platforms


Public Result UploadsReported Installs*Test Completions*OpenBenchmarking.orgEventsKeyDB Popularity Statisticspts/keydb2019.102019.122020.012020.022020.032020.042020.052020.062020.072020.082020.092020.102020.112020.122021.012021.022021.0330060090012001500
* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Mon, 08 Mar 2021 00:25:54 GMT.

Revision History

pts/keydb-1.2.0   [View Source]   Mon, 28 Sep 2020 17:34:54 GMT
Update against KeyDB 6.0.16 upstream.

pts/keydb-1.1.0   [View Source]   Thu, 27 Feb 2020 10:46:34 GMT
Pull in https://github.com/phoronix-test-suite/test-profiles/pull/130 plus update KeyDB from v5.0 to v5.3.1 upstream.

pts/keydb-1.0.1   [View Source]   Mon, 07 Oct 2019 20:05:52 GMT
Limit server thread to 4 per recommendation, add uuid as external dependency.

pts/keydb-1.0.0   [View Source]   Mon, 07 Oct 2019 19:43:48 GMT
Initial commit of KeyDB test profile.

Suites Using This Test

C/C++ Compiler Tests

Database Test Suite

Server


Performance Metrics

Analyze Test Configuration:

KeyDB 6.0.16

OpenBenchmarking.org metrics for this test profile configuration based on 510 public results since 28 September 2020 with the latest data as of 5 March 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Matching Public Results
Ops/sec (Average)
100th
4
897159 +/- 17977
100th
11
860672 +/- 12576
96th
3
817693 +/- 12805
96th
5
813733 +/- 63059
96th
17
813585 +/- 29852
93rd
10
760654 +/- 30119
90th
4
734071 +/- 73779
90th
7
700395 +/- 46745
89th
8
651743 +/- 51005
89th
3
650372 +/- 2870
88th
5
639233 +/- 19473
88th
5
633406 +/- 84068
88th
3
632519 +/- 3653
86th
3
627531 +/- 3637
83rd
5
614898 +/- 11113
81st
7
608259 +/- 4832
79th
3
595357 +/- 507
78th
6
579582 +/- 34749
78th
3
571893 +/- 3858
77th
3
565853 +/- 8863
77th
7
552306 +/- 42032
Mid-Tier
75th
< 534104
75th
4
528475 +/- 6500
74th
3
521183 +/- 12873
71st
10
505037 +/- 18505
70th
3
496744 +/- 7550
67th
3
474080 +/- 3066
66th
3
460870 +/- 5392
66th
3
459859 +/- 6135
66th
4
458850 +/- 652
63rd
3
452996 +/- 1554
62nd
4
451268 +/- 761
61st
3
449901 +/- 2753
61st
5
449619 +/- 5074
59th
3
433948 +/- 1435
58th
3
431212 +/- 2627
56th
3
428283 +/- 8769
56th
11
426856 +/- 3962
55th
3
424821 +/- 4427
55th
13
424688 +/- 4878
52nd
11
421360 +/- 6897
51st
3
419514 +/- 2630
Median
50th
419091
49th
5
414642 +/- 4641
46th
5
410939 +/- 6519
45th
7
409181 +/- 2851
42nd
7
405583 +/- 6832
41st
3
405240 +/- 2121
41st
7
403236 +/- 11674
41st
15
403124 +/- 27452
40th
6
398372 +/- 44332
40th
9
396520 +/- 5842
39th
7
395805 +/- 5812
38th
7
394672 +/- 3032
33rd
3
390694 +/- 2257
33rd
7
390150 +/- 3067
28th
3
384147 +/- 8388
28th
3
383676 +/- 1923
28th
7
383141 +/- 2516
Low-Tier
25th
< 378118
25th
7
377582 +/- 916
23rd
9
373792 +/- 2501
23rd
5
371786 +/- 48414
21st
3
345235 +/- 669
18th
3
297317 +/- 4899
18th
17
296583 +/- 10548
17th
3
294715 +/- 1034
16th
3
291161 +/- 704
14th
3
278622 +/- 8079
13th
3
275950 +/- 2356
13th
7
275100 +/- 8342
13th
3
271423 +/- 2024
11th
3
264921 +/- 159
10th
3
256138 +/- 1530
9th
3
250249 +/- 4649
8th
3
242934 +/- 1898
8th
3
236852 +/- 5845
7th
3
224352 +/- 23678
7th
3
198265 +/- 1248
6th
3
176995 +/- 2082
5th
3
175475 +/- 554
5th
3
146475 +/- 984
4th
3
139736 +/- 299
3rd
3
122278 +/- 521
2nd
3
100805 +/- 424
2nd
3
99284 +/- 1947
OpenBenchmarking.orgDistribution Of Public Results510 Results Range From 89290 To 912728 Ops/sec892901057591222281386971551661716351881042045732210422375112539802704492869183033873198563363253527943692633857324022014186704351394516084680774845465010155174845339535504225668915833605998296162986327676492366657056821746986437151127315817480507645197809887974578139268303958468648633338798028962719127401530456075

Based on OpenBenchmarking.org data, the selected test / test configuration (KeyDB 6.0.16) has an average run-time of 4 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkRun-Time48121620Min: 4 / Avg: 4.28 / Max: 14

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.6%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsDeviation246810Min: 0 / Avg: 0.58 / Max: 3

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

AMDIntelOpenBenchmarking.orgRelative Core Scaling To BaseKeyDB CPU Core Scaling4681216243248640.751.52.2533.75

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
CVTSI2SD COMISD UCOMISD MOVAPD DIVSD MULSD CVTTSD2SI ADDSD CVTSS2SD SUBSD MOVDQU MOVDQA MOVD CVTSD2SS SQRTSD
Last automated analysis: 30 January 2021

This test profile binary relies on the shared libraries libevent-2.1.so.7, libcrypto.so.1.1, libssl.so.1.1, libpthread.so.0, libz.so.1, libpcre.so.3, libm.so.6, libc.so.6, libdl.so.2.

Recent Test Results

OpenBenchmarking.org Results Compare

2 Systems - 86 Benchmark Results

Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-43-generic - GNOME Shell 3.38.2

3 Systems - 330 Benchmark Results

Intel Xeon E-2278GEL - Logic Supply RXM-181 - Intel Cannon Lake PCH

Ubuntu 20.10 - 5.8.0-41-generic - GNOME Shell 3.38.2

2 Systems - 330 Benchmark Results

Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-41-generic - GNOME Shell 3.38.2

1 System - 330 Benchmark Results

Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-41-generic - GNOME Shell 3.38.2

3 Systems - 376 Benchmark Results

2 x AMD EPYC 7F72 24-Core - Supermicro H11DSi-NT v2.00 - AMD Starship

Ubuntu 20.10 - 5.11.0-rc4-max-boost-inv-patch - GNOME Shell 3.38.1

3 Systems - 376 Benchmark Results

2 x AMD EPYC 7F72 24-Core - Supermicro H11DSi-NT v2.00 - AMD Starship

Ubuntu 20.10 - 5.10.9-051009-generic - GNOME Shell 3.38.1

1 System - 466 Benchmark Results

2 x AMD EPYC 7F72 24-Core - Supermicro H11DSi-NT v2.00 - AMD Starship

Ubuntu 20.10 - 5.10.9-051009-generic - GNOME Shell 3.38.1

3 Systems - 191 Benchmark Results

AMD Ryzen 3 2200G - ASUS PRIME B350M-E - AMD Raven

Ubuntu 20.10 - 5.8.0-38-generic - GNOME Shell 3.38.1

3 Systems - 125 Benchmark Results

AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.10 - 5.11.0-051100rc2daily20210108-generic - GNOME Shell 3.38.1

Most Popular Test Results

OpenBenchmarking.org Results Compare

3 Systems - 268 Benchmark Results

Intel Core i5-2520M - HP 161C - Intel 2nd Generation Core DRAM

Ubuntu 18.04 - 4.18.0-20-generic - GNOME Shell 3.28.3

4 Systems - 7 Benchmark Results

AMD Ryzen Threadripper 3960X 24-Core - MSI Creator TRX40 - AMD Starship

Ubuntu 20.04 - 5.9.0-rc5-14sep-patch - GNOME Shell 3.36.4

3 Systems - 40 Benchmark Results

2 x Intel Xeon Gold 5220R - TYAN S7106 - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.04 - 5.9.0-050900rc6-generic - GNOME Shell 3.36.4

2 Systems - 403 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-22-generic - GNOME Shell 3.38.0

3 Systems - 406 Benchmark Results

AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship

Ubuntu 20.10 - 5.8.0-20-generic - GNOME Shell 3.38.0

3 Systems - 31 Benchmark Results

AMD Ryzen 5 3600XT 6-Core - MSI X470 GAMING M7 AC - AMD Starship

Ubuntu 20.04 - 5.8.0-050800-generic - GNOME Shell 3.36.4

3 Systems - 202 Benchmark Results

Intel Core i7-7700K - MSI Z270-A PRO - Intel Xeon E3-1200 v6

Ubuntu 20.04 - 5.4.0-28-generic - GNOME Shell 3.36.1

3 Systems - 32 Benchmark Results

AMD Ryzen 9 3900X 12-Core - ASUS TUF GAMING X570-PLUS - AMD Starship

Ubuntu 20.04 - 5.9.0-050900rc6daily20200922-generic - GNOME Shell 3.36.4

3 Systems - 100 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship

Ubuntu 20.04 - 5.4.0-47-generic - GNOME Shell 3.36.4

3 Systems - 191 Benchmark Results

AMD Ryzen 3 2200G - ASUS PRIME B350M-E - AMD Raven

Ubuntu 20.10 - 5.8.0-38-generic - GNOME Shell 3.38.1

3 Systems - 23 Benchmark Results

AMD Ryzen Threadripper 2970WX 24-Core - Gigabyte X399 AORUS Gaming 7 - AMD 17h

Ubuntu 20.04 - 5.9.0-050900rc6daily20200926-generic - GNOME Shell 3.36.4

Find More Test Results