Memtier_benchmark Benchmark - OpenBenchmarking.org

Memtier_benchmark is a NoSQL Redis/Memcache traffic generation plus benchmarking tool. This current test profile currently just stresses the Redis protocol and basic options exposed wotj a 1:1 Set/Get ratio, 30 pipeline, 100 clients per thread, and thread count equal to the number of CPU cores/threads present. Patches to extend the test are welcome as always.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark memtier-benchmark.

* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Thu, 04 Mar 2021 14:20:40 GMT.

Revision History

pts/memtier-benchmark-1.0.1 [View Source] Tue, 24 Sep 2019 15:20:16 GMT
Add libtool as possible external dependency.

pts/memtier-benchmark-1.0.0 [View Source] Mon, 23 Sep 2019 17:41:24 GMT
Initial commit of Redis/memcached memtier_benchmark program.

Performance Metrics

Memtier_benchmark 1.2.17

Protocol: Redis

OpenBenchmarking.org metrics for this test profile configuration based on 242 public results since 23 September 2019 with the latest data as of 24 February 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component

Percentile Rank

# Matching Public Results

Ops/sec (Average)

2 x Intel Xeon Platinum 8280

98th

4145403 ^{+/- 338761}

AMD EPYC 7742 64-Core

93rd

3715581 ^{+/- 187539}

2 x Intel Xeon Gold 6138

86th

2890309 ^{+/- 377632}

Intel Core i9-9900K

85th

2885454 ^{+/- 69442}

Intel Core i9-7980XE

82nd

2792857 ^{+/- 102621}

Intel Core i9-10980XE

82nd

2784259 ^{+/- 113870}

2 x Intel Xeon Gold 5220R

78th

2743850 ^{+/- 113220}

Mid-Tier

75th

< 2679836

AMD Ryzen 9 3900X 12-Core

73rd

2653786 ^{+/- 121145}

Intel Core i9-7960X

67th

2562052 ^{+/- 136376}

AMD Ryzen 5 3600X 6-Core

54th

2361418 ^{+/- 38584}

Median

50th

2306793

Intel Xeon Gold 6136

48th

2285680 ^{+/- 42825}

Intel Xeon E3-1280 v5

39th

2044125 ^{+/- 49334}

AMD EPYC 7601 32-Core

37th

1997000 ^{+/- 71726}

AMD EPYC 7702P 64-Core

34th

1950393 ^{+/- 29150}

AMD Ryzen 5 3400G

28th

1874687 ^{+/- 6438}

AMD EPYC 7302P 16-Core

27th

1866427 ^{+/- 106880}

Low-Tier

25th

< 1806239

Intel Xeon Silver 4108

21st

1596694 ^{+/- 15939}

Intel Core i7-6500U

11th

1212755 ^{+/- 76940}

2 x Intel Xeon E5-2680 0

7th

1129840 ^{+/- 15236}

Based on OpenBenchmarking.org data, the selected test / test configuration (Memtier_benchmark 1.2.17 - Protocol: Redis) has an average run-time of 10 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 2.3%.

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set

Support

Instructions Detected

SSE2 (SSE2)

Used by default on supported hardware.

CVTSI2SD COMISD UCOMISD MOVAPD DIVSD MULSD CVTTSD2SI ADDSD CVTSS2SD SUBSD MOVDQU MOVDQA MOVD CVTSD2SS SQRTSD

Last automated analysis: 30 January 2021

This test profile binary relies on the shared libraries libevent-2.1.so.7, libpthread.so.0, libz.so.1, libpcre.so.3, libm.so.6, libc.so.6.

ol79-fw4-try2 1 System - 140 Benchmark Results	2 x Intel Xeon E5-2680 v3 - Cisco UCSB-B200-M4 - Intel Xeon E7 v3 OracleServer 8.3 - 5.4.17-2011.7.4.el8uek.x86_64 - matrox
centos79-fw4-try3 1 System - 117 Benchmark Results	2 x Intel Xeon E5-2680 0 - Cisco UCSC-C220-M3S - Intel Xeon E5 CentOS 7.9.2009 - 3.10.0-1160.11.1.el7.x86_64 - X Server
centos74-fw3-server 1 System - 91 Benchmark Results	2 x Intel Xeon E5-2680 0 - Cisco UCSC-C220-M3S - Intel Xeon E5 CentOS 7.4.1708 - 3.10.0-693.2.2.el7.x86_64 - X Server
cent74-fw4 1 System - 117 Benchmark Results	2 x Intel Xeon E5-2680 0 - Cisco UCSC-C220-M3S - Intel Xeon E5 CentOS 7.4.1708 - 3.10.0-693.2.2.el7.x86_64 - X Server
al2 1 System - 94 Benchmark Results	2 x Intel Xeon Gold 6240 - Intel 440BX - Intel 440BX Amazon Linux 2 - 4.14.214-160.339.amzn2.x86_64 - vmware
ol74-fw4-try2 1 System - 117 Benchmark Results	2 x Intel Xeon E5-2680 v3 - Cisco UCSB-B200-M4 - Intel Xeon E7 v3 OracleServer 7.4 - 4.1.12-103.7.3.el7uek.x86_64 - matrox
ol79-fw4-try2 1 System - 140 Benchmark Results	2 x Intel Xeon E5-2680 v3 - Cisco UCSB-B200-M4 - Intel Xeon E7 v3 OracleServer 8.3 - 5.4.17-2011.7.4.el8uek.x86_64 - matrox
centos79-fw4-try3 1 System - 117 Benchmark Results	2 x Intel Xeon E5-2680 0 - Cisco UCSC-C220-M3S - Intel Xeon E5 CentOS 7.9.2009 - 3.10.0-1160.11.1.el7.x86_64 - X Server
intel-ionos 3 Systems - 25 Benchmark Results	2 x Intel Core - QEMU Standard PC - Intel 440FX 82441FX PMC Ubuntu 20.04 - 5.4.0-52-generic - GCC 9.3.0
amd-ionos 2 Systems - 35 Benchmark Results	4 x AMD Opteron 62xx class - QEMU Standard PC - Intel 440FX 82441FX PMC Ubuntu 20.04 - 5.4.0-52-generic - GCC 9.3.0
AMD-Ionos 1 System - 19 Benchmark Results	4 x AMD Opteron 62xx class - QEMU Standard PC - Intel 440FX 82441FX PMC Ubuntu 20.04 - 5.4.0-52-generic - GCC 9.3.0
intel-ionos 2 Systems - 17 Benchmark Results	2 x Intel Core - QEMU Standard PC - Intel 440FX 82441FX PMC Ubuntu 20.04 - 5.4.0-52-generic - GCC 9.3.0

AMD Threadripper 3960X vs. Intel Core i9 10980XE Featured Processor Comparison	AMD Ryzen Threadripper 3960X 24-Core - MSI Creator TRX40 - AMD Starship Ubuntu 19.10 - 5.3.0-23-generic - GNOME Shell 3.34.1
Core i9 10900K - Ubuntu 20.04 LTS vs. Ubuntu 20.10 2 Systems - 403 Benchmark Results	Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH Ubuntu 20.04 - 5.4.0-48-generic - GNOME Shell 3.36.4
Ryzen 9 3900XT Ubuntu 20.04 LTS vs. Ubuntu 20.10 3 Systems - 406 Benchmark Results	AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship Ubuntu 20.04 - 5.4.0-48-generic - GNOME Shell 3.36.4
Big Threadripper 2 Systems - 475 Benchmark Results	AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship Ubuntu 19.10 - 5.3.0-40-generic - GNOME Shell 3.34.1
threadripper-3960x-reference 2 Systems - 345 Benchmark Results	AMD Ryzen Threadripper 3960X 24-Core - MSI Creator TRX40 - AMD Starship Ubuntu 19.10 - 5.3.0-23-generic - GNOME Shell 3.34.1
Early Linux 5.5 Cascade Lake Xeon Scalable Featured Kernel Comparison	2 x Intel Xeon Platinum 8280 - GIGABYTE MD61-SC2-00 v01000100 - Intel Sky Lake-E DMI3 Registers Ubuntu 19.10 - 5.4.0-999-generic - GNOME Shell 3.34.1
Ubuntu 19.10 AMD Ryzen 9 3900X Benchmarks 1 System - 376 Benchmark Results	AMD Ryzen 9 3900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 19.10 - 5.3.0-10-generic - GNOME Shell 3.34.0
Ryzen 9 3900X Redis + dav1d 1 System - 10 Benchmark Results	AMD Ryzen 9 3900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 19.10 - 5.3.0-10-generic - GNOME Shell 3.34.0
Core i5 8400 Ubuntu 1 System - 17 Benchmark Results	Intel Core i5-8400 - MSI Z370M MORTAR - Intel 8th Gen Core Ubuntu 19.04 - 5.0.0-29-generic - GNOME Shell 3.32.1
AMD Threadripper 3960X vs. Intel Core i9 10980XE 3 Systems - 335 Benchmark Results	AMD Ryzen Threadripper 3960X 24-Core - MSI Creator TRX40 - AMD Starship Ubuntu 19.10 - 5.3.0-23-generic - GNOME Shell 3.34.1
intel-ionos 3 Systems - 25 Benchmark Results	2 x Intel Core - QEMU Standard PC - Intel 440FX 82441FX PMC Ubuntu 20.04 - 5.4.0-52-generic - GCC 9.3.0
Ryzen 9 3900XT Ubuntu 20.04 LTS vs. Ubuntu 20.10 2 Systems - 406 Benchmark Results	AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship Ubuntu 20.04 - 5.4.0-48-generic - GNOME Shell 3.36.4

Memtier_benchmark

Project Site

Test Created

Last Updated

Test Maintainer

Test Type

Average Install Time

Average Run Time

Test Dependencies

Accolades

Supported Platforms

Revision History

Suites Using This Test

Performance Metrics

Memtier_benchmark 1.2.17

Protocol: Redis

Notable Instruction Set Usage

Recent Test Results

Most Popular Test Results