Memtier_benchmark

Memtier_benchmark is a NoSQL Redis/Memcache traffic generation plus benchmarking tool. This current test profile currently just stresses the Redis protocol and basic options exposed wotj a 1:1 Set/Get ratio, 30 pipeline, 100 clients per thread, and thread count equal to the number of CPU cores/threads present. Patches to extend the test are welcome as always.

Learn more about this test at the upstream project site: https://github.com/RedisLabs/memtier_benchmark.

This benchmark test profile is maintained by Michael Larabel. This OpenBenchmarking.org test profile was created on 23 September 2019 and last updated on 24 September 2019. To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark memtier-benchmark.

This test has an average install time of 57 seconds and an average run-time of 2 minutes, 20 seconds.

5k+ Downloads

Installation StatsTest Completion StatsPublic Result UploadsOpenBenchmarking.orgEventsMemtier_benchmark Popularitypts/memtier-benchmark2019.092019.102019.112019.122020.012020.022020.032020.042020.052020.062020.072020.082020.092020.102020.11400800120016002000

* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting.

Revision History

pts/memtier-benchmark-1.0.1   [View Source]   24 Sep 2019 15:20 EDT
Add libtool as possible external dependency.

pts/memtier-benchmark-1.0.0   [View Source]   23 Sep 2019 17:41 EDT
Initial commit of Redis/memcached memtier_benchmark program.

Suites Using This Test

Database Test Suite

Server

Performance Metrics

Analyze Test Configuration:

Memtier_benchmark 1.2.17

Protocol: Redis

OpenBenchmarking.org metrics for this test profile configuration based on 227 public samples since 23 September 2019 with the latest data as of 26 November 2020.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
Ops/sec (Average)
Mid-Tier
75th
< 2725095
Median
50th
2355460
Low-Tier
25th
< 1868593
OpenBenchmarking.orgDistribution Of Public Results - Protocol: Redis227 Results Range From 176928 To 4800891 Ops/sec176928269408361888454368546848639328731808824288916768100924811017281194208128668813791681471648156412816566081749088184156819340482026528211900822114882303968239644824889282581408267388827663682858848295132830438083136288322876833212483413728350620835986883691168378364838761283968608406108841535684246048433852844310084523488461596847084484800928510152025

Based on OpenBenchmarking.org data, the selected test / test configuration (Memtier_benchmark 1.2.17 - Protocol: Redis) has an average run-time of 11 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkProtocol: RedisRun-Time816243240Min: 4 / Avg: 10.23 / Max: 39

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 2.4%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsProtocol: RedisDeviation3691215Min: 0 / Avg: 2.4 / Max: 11

Recent Test Results

Compare

1 System - 47 Benchmark Results

12 x Intel Xeon E5-2650 v4 - Intel 440BX - Intel 440BX

CentOS Linux 8 - 5.9.11-1.el8.elrepo.x86_64 - GCC 8.3.1 20191121

1 System - 59 Benchmark Results

16 x AMD EPYC 7702P 64-Core - Intel 440BX - Intel 440BX

CentOS Linux 8 - 5.9.11-1.el8.elrepo.x86_64 - GCC 8.3.1 20191121

1 System - 59 Benchmark Results

16 x AMD EPYC 7302P 16-Core - Intel 440BX - Intel 440BX

CentOS Linux 8 - 5.9.11-1.el8.elrepo.x86_64 - GCC 8.3.1 20191121

1 System - 59 Benchmark Results

16 x AMD EPYC 7402 24-Core - Intel 440BX - Intel 440BX

CentOS Linux 8 - 5.9.11-1.el8.elrepo.x86_64 - GCC 8.3.1 20191121

1 System - 59 Benchmark Results

16 x Intel Xeon Gold 6230 - Intel 440BX - Intel 440BX

CentOS Linux 8 - 5.9.11-1.el8.elrepo.x86_64 - GCC 8.3.1 20191121

2 Systems - 20 Benchmark Results

2 x Intel Xeon E5620 - Supermicro X8DT3 v2.0 - Intel 5520 I

Ubuntu 18.04 - 4.15.0-124-generic - GCC 7.5.0

1 System - 25 Benchmark Results

AMD EPYC 7302P 16-Core - ASRockRack ROMED8QM-2T - AMD Starship

Ubuntu 20.04 - 5.4.0-53-generic - GCC 9.3.0

1 System - 1 Benchmark Result

AMD Ryzen 3 1200 - MSI B350M PRO-VD PLUS - AMD 17h

Ubuntu 20.04 - 5.4.0-52-generic - GNOME Shell 3.36.4

2 Systems - 403 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Ubuntu 20.04 - 5.4.0-48-generic - GNOME Shell 3.36.4

3 Systems - 406 Benchmark Results

AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship

Ubuntu 20.04 - 5.4.0-48-generic - GNOME Shell 3.36.4

1 System - 113 Benchmark Results

AMD EPYC 7302P 16-Core - Supermicro H11SSL-i v2.00 - AMD Starship

CentOS 7.8.2003 - 3.10.0-1127.19.1.el7.x86_64 - GCC 4.8.5 20150623

2 Systems - 406 Benchmark Results

AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship

Ubuntu 20.04 - 5.4.0-48-generic - GNOME Shell 3.36.4

Most Popular Test Results

Compare

2 Systems - 403 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-22-generic - GNOME Shell 3.38.0

3 Systems - 406 Benchmark Results

AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship

Ubuntu 20.04 - 5.4.0-48-generic - GNOME Shell 3.36.4

2 Systems - 475 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Ubuntu 19.10 - 5.3.0-18-generic - GNOME Shell 3.34.1

2 Systems - 345 Benchmark Results

AMD Ryzen Threadripper 3960X 24-Core - MSI Creator TRX40 - AMD Starship

Ubuntu 19.10 - 5.3.0-23-generic - GNOME Shell 3.34.1

1 System - 376 Benchmark Results

AMD Ryzen 9 3900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 19.10 - 5.3.0-10-generic - GNOME Shell 3.34.0

3 Systems - 335 Benchmark Results

Intel Core i9-10980XE - Gigabyte X299X DESIGNARE 10G - Intel Sky Lake-E DMI3 Registers

Ubuntu 19.10 - 5.3.0-23-generic - GNOME Shell 3.34.1

1 System - 10 Benchmark Results

AMD Ryzen 9 3900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 19.10 - 5.3.0-10-generic - GNOME Shell 3.34.0

1 System - 17 Benchmark Results

Intel Core i5-8400 - MSI Z370M MORTAR - Intel 8th Gen Core

Ubuntu 19.04 - 5.0.0-29-generic - GNOME Shell 3.32.1

1 System - 114 Benchmark Results

Intel Core i9-10980XE - Gigabyte X299X DESIGNARE 10G - Intel Sky Lake-E DMI3 Registers

Ubuntu 19.10 - 5.3.0-24-generic - GNOME Shell 3.34.1

1 System - 5 Benchmark Results

AMD Ryzen Threadripper 2990WX 32-Core - ASUS ROG ZENITH EXTREME - AMD 17h

Ubuntu 19.04 - 5.1.0-bcachefs - GNOME Shell 3.32.0

Find More Test Results


User Comments

Post A Comment