KeyDB

A benchmark of KeyDB as a multi-threaded fork of the Redis server. The KeyDB benchmark is conducted using memtier-benchmark.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark keydb.

Project Site

keydb.dev

Test Created

7 October 2019

Last Updated

28 September 2020

Test Maintainer

Michael Larabel 

Test Type

System

Average Install Time

1 Minute, 8 Seconds

Average Run Time

7 Minutes, 35 Seconds

Test Dependencies

C/C++ Compiler Toolchain + Libevent + Perl Compatible Regular Expressions + OpenSSL + Libtool + Curl + UUID

Accolades

10k+ Downloads

Supported Platforms


Public Result UploadsReported Installs*Test Completions*OpenBenchmarking.orgEventsKeyDB Popularity Statisticspts/keydb2019.102019.122020.012020.022020.032020.042020.052020.062020.072020.082020.092020.102020.112020.122021.012021.022021.032021.0430060090012001500
* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Sat, 10 Apr 2021 05:59:23 GMT.

Revision History

pts/keydb-1.2.0   [View Source]   Mon, 28 Sep 2020 17:34:54 GMT
Update against KeyDB 6.0.16 upstream.

pts/keydb-1.1.0   [View Source]   Thu, 27 Feb 2020 10:46:34 GMT
Pull in https://github.com/phoronix-test-suite/test-profiles/pull/130 plus update KeyDB from v5.0 to v5.3.1 upstream.

pts/keydb-1.0.1   [View Source]   Mon, 07 Oct 2019 20:05:52 GMT
Limit server thread to 4 per recommendation, add uuid as external dependency.

pts/keydb-1.0.0   [View Source]   Mon, 07 Oct 2019 19:43:48 GMT
Initial commit of KeyDB test profile.

Suites Using This Test

C/C++ Compiler Tests

Database Test Suite

Server


Performance Metrics

Analyze Test Configuration:

KeyDB 6.0.16

OpenBenchmarking.org metrics for this test profile configuration based on 518 public results since 28 September 2020 with the latest data as of 30 March 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Matching Public Results
Ops/sec (Average)
100th
4
1005756 +/- 5377
100th
4
897159 +/- 17977
99th
11
860672 +/- 12576
95th
3
817693 +/- 12805
95th
5
813733 +/- 63059
95th
17
813585 +/- 29852
92nd
10
760654 +/- 30119
90th
4
734071 +/- 73779
89th
7
700395 +/- 46745
88th
8
651743 +/- 51005
88th
3
650372 +/- 2870
87th
5
639233 +/- 19473
87th
5
633406 +/- 84068
87th
3
632519 +/- 3653
86th
3
627531 +/- 3637
83rd
5
614898 +/- 11113
81st
7
608259 +/- 4832
79th
3
595357 +/- 507
78th
6
579582 +/- 34749
78th
3
571893 +/- 3858
77th
3
565853 +/- 8863
76th
7
552306 +/- 42032
Mid-Tier
75th
< 535529
75th
4
528475 +/- 6500
74th
3
521183 +/- 12873
70th
10
505037 +/- 18505
69th
3
496744 +/- 7550
67th
3
474080 +/- 3066
66th
3
460870 +/- 5392
66th
3
459859 +/- 6135
65th
4
458850 +/- 652
62nd
3
452996 +/- 1554
61st
4
451268 +/- 761
60th
3
449901 +/- 2753
60th
5
449619 +/- 5074
58th
3
433948 +/- 1435
57th
3
431212 +/- 2627
55th
3
428283 +/- 8769
55th
11
426856 +/- 3962
54th
3
424821 +/- 4427
54th
13
424688 +/- 4878
51st
11
421360 +/- 6897
Median
50th
420325
50th
3
419514 +/- 2630
48th
5
414642 +/- 4641
46th
5
410939 +/- 6519
45th
7
409181 +/- 2851
42nd
7
405583 +/- 6832
41st
3
405240 +/- 2121
40th
7
403236 +/- 11674
40th
15
403124 +/- 27452
39th
6
398372 +/- 44332
39th
9
396520 +/- 5842
38th
7
395805 +/- 5812
37th
7
394672 +/- 3032
33rd
3
390694 +/- 2257
33rd
7
390150 +/- 3067
28th
3
384147 +/- 8388
28th
3
383676 +/- 1923
28th
7
383141 +/- 2516
Low-Tier
25th
< 378118
25th
7
377582 +/- 916
23rd
9
373792 +/- 2501
22nd
5
371786 +/- 48414
20th
3
345235 +/- 669
18th
3
297317 +/- 4899
17th
17
296583 +/- 10548
17th
3
294715 +/- 1034
16th
3
291161 +/- 704
14th
3
278622 +/- 8079
13th
3
275950 +/- 2356
13th
7
275100 +/- 8342
13th
3
271423 +/- 2024
10th
3
264921 +/- 159
10th
3
256138 +/- 1530
9th
3
250249 +/- 4649
8th
3
242934 +/- 1898
8th
3
236852 +/- 5845
7th
3
224352 +/- 23678
7th
3
198265 +/- 1248
6th
3
176995 +/- 2082
5th
3
175475 +/- 554
5th
3
146475 +/- 984
4th
3
139736 +/- 299
3rd
3
122278 +/- 521
2nd
3
100805 +/- 424
2nd
3
99284 +/- 1947
OpenBenchmarking.orgDistribution Of Public Results518 Results Range From 89290 To 1010414 Ops/sec8929010771312613614455916298218140519982821825123667425509727352029194331036632878934721236563538405840248142090443932745775047617349459651301953144254986556828858671160513462355764198066040367882669724971567273409575251877094178936480778782621084463386305688147989990291832593674895517197359499201710104401530456075

Based on OpenBenchmarking.org data, the selected test / test configuration (KeyDB 6.0.16) has an average run-time of 4 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkRun-Time3691215Min: 4 / Avg: 4.18 / Max: 12

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.6%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsDeviation246810Min: 0 / Avg: 0.56 / Max: 3

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

AMDIntelOpenBenchmarking.orgRelative Core Scaling To BaseKeyDB CPU Core Scaling4681216243248640.73961.47922.21882.95843.698

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
CVTSI2SD COMISD UCOMISD MOVAPD DIVSD MULSD CVTTSD2SI ADDSD CVTSS2SD SUBSD MOVDQU MOVDQA MOVD CVTSD2SS SQRTSD
Last automated analysis: 30 January 2021

This test profile binary relies on the shared libraries libevent-2.1.so.7, libcrypto.so.1.1, libssl.so.1.1, libpthread.so.0, libz.so.1, libpcre.so.3, libm.so.6, libc.so.6, libdl.so.2.

Recent Test Results

OpenBenchmarking.org Results Compare

1 System - 171 Benchmark Results

2 x Intel Xeon Gold 5218R - Supermicro X11DPX-T - Intel Device 2020

Ubuntu 16.04 - 4.15.0-139-generic - Unity 7.4.0

2 Systems - 96 Benchmark Results

Intel Core i9-11900K - ASUS ROG MAXIMUS XIII HERO - Intel Tiger Lake-H

Ubuntu 21.04 - 5.12.0-051200rc3daily20210315-generic - GNOME Shell 3.38.3

2 Systems - 86 Benchmark Results

Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-43-generic - GNOME Shell 3.38.2

3 Systems - 330 Benchmark Results

Intel Xeon E-2288G - Compulab SBC-ATCFL v1.2 - Intel Cannon Lake PCH

Ubuntu 20.10 - 5.8.0-41-generic - GNOME Shell 3.38.2

2 Systems - 330 Benchmark Results

Intel Xeon E-2278GEL - Logic Supply RXM-181 - Intel Cannon Lake PCH

Ubuntu 20.10 - 5.8.0-41-generic - GNOME Shell 3.38.2

1 System - 330 Benchmark Results

Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-41-generic - GNOME Shell 3.38.2

3 Systems - 376 Benchmark Results

2 x AMD EPYC 7F72 24-Core - Supermicro H11DSi-NT v2.00 - AMD Starship

Ubuntu 20.10 - 5.11.0-rc4-max-boost-inv-patch - GNOME Shell 3.38.1

3 Systems - 376 Benchmark Results

2 x AMD EPYC 7F72 24-Core - Supermicro H11DSi-NT v2.00 - AMD Starship

Ubuntu 20.10 - 5.10.9-051009-generic - GNOME Shell 3.38.1

1 System - 466 Benchmark Results

2 x AMD EPYC 7F72 24-Core - Supermicro H11DSi-NT v2.00 - AMD Starship

Ubuntu 20.10 - 5.10.9-051009-generic - GNOME Shell 3.38.1

Most Popular Test Results

OpenBenchmarking.org Results Compare

3 Systems - 268 Benchmark Results

Intel Core i5-2520M - HP 161C - Intel 2nd Generation Core DRAM

Ubuntu 18.04 - 4.18.0-20-generic - GNOME Shell 3.28.3

4 Systems - 7 Benchmark Results

AMD Ryzen Threadripper 3960X 24-Core - MSI Creator TRX40 - AMD Starship

Ubuntu 20.04 - 5.9.0-rc5-14sep-patch - GNOME Shell 3.36.4

3 Systems - 40 Benchmark Results

2 x Intel Xeon Gold 5220R - TYAN S7106 - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.04 - 5.9.0-050900rc6-generic - GNOME Shell 3.36.4

2 Systems - 403 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-22-generic - GNOME Shell 3.38.0

3 Systems - 406 Benchmark Results

AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship

Ubuntu 20.10 - 5.8.0-20-generic - GNOME Shell 3.38.0

3 Systems - 31 Benchmark Results

AMD Ryzen 5 3600XT 6-Core - MSI X470 GAMING M7 AC - AMD Starship

Ubuntu 20.04 - 5.8.0-050800-generic - GNOME Shell 3.36.4

3 Systems - 202 Benchmark Results

Intel Core i7-7700K - MSI Z270-A PRO - Intel Xeon E3-1200 v6

Ubuntu 20.04 - 5.4.0-28-generic - GNOME Shell 3.36.1

3 Systems - 191 Benchmark Results

AMD Ryzen 3 2200G - ASUS PRIME B350M-E - AMD Raven

Ubuntu 20.10 - 5.8.0-38-generic - GNOME Shell 3.38.1

3 Systems - 32 Benchmark Results

AMD Ryzen 9 3900X 12-Core - ASUS TUF GAMING X570-PLUS - AMD Starship

Ubuntu 20.04 - 5.9.0-050900rc6daily20200922-generic - GNOME Shell 3.36.4

22 Systems - 46 Benchmark Results

Intel Core i9-9900K - ASRock Z390M Pro4 - Intel Cannon Lake PCH

Ubuntu 20.10 - 5.10.4-051004-generic - GNOME Shell 3.38.1

3 Systems - 100 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship

Ubuntu 20.04 - 5.4.0-47-generic - GNOME Shell 3.36.4

Find More Test Results