Tau T2A DBs

Benchmarks for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2208206-NE-2208206NE41
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

Database Test Suite 4 Tests
Server 4 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Comparison
Transpose Comparison

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Tau T2A: 8 vCPUs
August 20 2022
  3 Hours, 6 Minutes
Tau T2A: 16 vCPUs
August 20 2022
  3 Hours, 47 Minutes
Tau T2A: 32 vCPUs
August 20 2022
  3 Hours, 39 Minutes
Tau T2A: 48 vCPUs
August 20 2022
  3 Hours, 29 Minutes
Invert Hiding All Results Option
  3 Hours, 30 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


ProcessorMotherboardMemoryDiskNetworkOSKernelCompilerFile-SystemSystem LayerTau T2A 8 vCPUs 16 vCPUs 32 vCPUs 48 vCPUsARMv8 Neoverse-N1 (8 Cores)KVM Google Compute Engine32GB215GB nvme_card-pdGoogle Compute Engine VirtualUbuntu 22.045.15.0-1016-gcp (aarch64)GCC 12.0.1 20220319ext4KVMARMv8 Neoverse-N1 (16 Cores)64GBARMv8 Neoverse-N1 (32 Cores)128GBARMv8 Neoverse-N1 (48 Cores)192GBOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseEnvironment Details- CXXFLAGS="-O3 -march=native" CFLAGS="-O3 -march=native"Compiler Details- --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected

clickhouse: 100M Rows Web Analytics Dataset, Third Runclickhouse: 100M Rows Web Analytics Dataset, Second Runclickhouse: 100M Rows Web Analytics Dataset, First Run / Cold Cacheetcd: RANGE - 500 - 100 - Average Latencyetcd: RANGE - 500 - 100memtier-benchmark: Redis - 500 - 1:5memtier-benchmark: Redis - 100 - 5:1memtier-benchmark: Redis - 100 - 1:10memtier-benchmark: Redis - 50 - 5:1memtier-benchmark: Redis - 50 - 1:10etcd: PUT - 500 - 100 - Average Latencyetcd: PUT - 500 - 100etcd: RANGE - 100 - 100 - Average Latencyetcd: RANGE - 100 - 100memtier-benchmark: Redis - 100 - 1:1etcd: PUT - 100 - 100 - Average Latencyetcd: PUT - 100 - 100etcd: RANGE - 500 - 1000 - Average Latencyetcd: RANGE - 500 - 1000etcd: PUT - 500 - 1000 - Average Latencyetcd: PUT - 500 - 1000memtier-benchmark: Redis - 500 - 1:10etcd: RANGE - 100 - 1000 - Average Latencyetcd: RANGE - 100 - 1000etcd: PUT - 100 - 1000 - Average Latencyetcd: PUT - 100 - 1000memtier-benchmark: Redis - 500 - 1:1memtier-benchmark: Redis - 50 - 1:5memtier-benchmark: Redis - 500 - 5:1memtier-benchmark: Redis - 100 - 1:5dragonflydb: 200 - 5:1dragonflydb: 200 - 1:1dragonflydb: 200 - 1:5memtier-benchmark: Redis - 50 - 1:1dragonflydb: 50 - 1:1dragonflydb: 50 - 5:1dragonflydb: 50 - 1:5Tau T2A 8 vCPUs 16 vCPUs 32 vCPUs 48 vCPUs104.32103.73100.791129614.251098126.021168107.071142072.381386615.551131085.991175037.931061386.921387706.60982898.081283692.941374673.111403891.711512957.921294995.951475197.201442139.221595193.71157.81154.86150.903.132663.23801365893.271153923.991379214.161296026.291510468.573.033614.7581333140.22251217216.432.933675.176020.847394.283619.749983.89011377218.0618.553741.768018.154936.90911242844.811550016.781174862.901340638.361849882.271926869.122049725.721429340.112108004.912056183.132275161.75208.79200.83198.70333265.21641288582.051550665.241349568.701622298.80333400.5204333415.81181343677.563.033649.718820.648461.483820.648619.753619.651066.364819.651019.92191660921.571486481.562036075.912171524.162301175.421505221.662666276.282583896.232858331.46214.08218.56214.393.429571.52821361030.691603778.181398276.551668971.163.429592.03433.330069.10971409087.963.329993.70892343454.114123.043533.062622.344802.654622.344762.67051693195.221660275.791962365.802047988.932177274.121593625.772822040.312743928.472994524.68OpenBenchmarking.org

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all queries performed. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, Third Run8 vCPUs16 vCPUs32 vCPUs48 vCPUs50100150200250SE +/- 0.32, N = 12SE +/- 0.61, N = 3SE +/- 1.66, N = 15SE +/- 2.04, N = 5104.32157.81208.79214.08MIN: 9.26 / MAX: 12000MIN: 15.81 / MAX: 12000MIN: 20.93 / MAX: 12000MIN: 23.72 / MAX: 120001. ClickHouse server version 22.5.4.19 (official build).
OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, Third Run8 vCPUs16 vCPUs32 vCPUs48 vCPUs4080120160200Min: 102.65 / Avg: 104.32 / Max: 106.27Min: 156.65 / Avg: 157.81 / Max: 158.68Min: 196.86 / Avg: 208.79 / Max: 218.83Min: 207.98 / Avg: 214.08 / Max: 219.711. ClickHouse server version 22.5.4.19 (official build).

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, Second Run8 vCPUs16 vCPUs32 vCPUs48 vCPUs50100150200250SE +/- 0.36, N = 12SE +/- 2.24, N = 3SE +/- 1.98, N = 15SE +/- 1.60, N = 5103.73154.86200.83218.56MIN: 9.23 / MAX: 12000MIN: 16.08 / MAX: 12000MIN: 21.7 / MAX: 12000MIN: 25.05 / MAX: 120001. ClickHouse server version 22.5.4.19 (official build).
OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, Second Run8 vCPUs16 vCPUs32 vCPUs48 vCPUs4080120160200Min: 101.65 / Avg: 103.73 / Max: 106.14Min: 150.67 / Avg: 154.86 / Max: 158.34Min: 187.76 / Avg: 200.83 / Max: 218.37Min: 214.15 / Avg: 218.56 / Max: 222.381. ClickHouse server version 22.5.4.19 (official build).

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, First Run / Cold Cache8 vCPUs16 vCPUs32 vCPUs48 vCPUs50100150200250SE +/- 1.29, N = 12SE +/- 0.34, N = 3SE +/- 1.86, N = 15SE +/- 2.23, N = 5100.79150.90198.70214.39MIN: 5.68 / MAX: 12000MIN: 16.26 / MAX: 12000MIN: 21.74 / MAX: 12000MIN: 25.03 / MAX: 120001. ClickHouse server version 22.5.4.19 (official build).
OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, First Run / Cold Cache8 vCPUs16 vCPUs32 vCPUs48 vCPUs4080120160200Min: 90.73 / Avg: 100.79 / Max: 103.84Min: 150.41 / Avg: 150.9 / Max: 151.55Min: 185.92 / Avg: 198.7 / Max: 207.28Min: 206.35 / Avg: 214.39 / Max: 219.741. ClickHouse server version 22.5.4.19 (official build).

etcd

Etcd is a distributed, reliable key-value store intended for critical data of a distributed system. Etcd is written in Golang and part of the Cloud Native Computing Foundation (CNCF) and used by Kubernetes, Rook, CoreDNS, and other open-source software. This test profile uses Etcd's built-in benchmark to stress the PUT and RANGE performance of a single node / local system. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 500 - Clients: 100 - Average Latency16 vCPUs32 vCPUs48 vCPUs0.7651.532.2953.063.825SE +/- 0.04, N = 12SE +/- 0.00, N = 3SE +/- 0.00, N = 33.13.03.4
OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 500 - Clients: 100 - Average Latency16 vCPUs32 vCPUs48 vCPUs246810Min: 2.8 / Avg: 3.05 / Max: 3.4Min: 3 / Avg: 3 / Max: 3Min: 3.4 / Avg: 3.4 / Max: 3.4

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 500 - Clients: 10016 vCPUs32 vCPUs48 vCPUs7K14K21K28K35KSE +/- 414.72, N = 12SE +/- 48.16, N = 3SE +/- 66.83, N = 332663.2433265.2229571.53
OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 500 - Clients: 10016 vCPUs32 vCPUs48 vCPUs6K12K18K24K30KMin: 29484.27 / Avg: 32663.24 / Max: 35318.3Min: 33168.95 / Avg: 33265.22 / Max: 33316.13Min: 29458.97 / Avg: 29571.53 / Max: 29690.22

memtier_benchmark

Memtier_benchmark is a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 500 - Set To Get Ratio: 1:58 vCPUs16 vCPUs300K600K900K1200K1500KSE +/- 11571.22, N = 15SE +/- 11303.01, N = 91129614.251365893.271. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 500 - Set To Get Ratio: 1:58 vCPUs16 vCPUs200K400K600K800K1000KMin: 1078709.62 / Avg: 1129614.25 / Max: 1221519.96Min: 1314684.28 / Avg: 1365893.27 / Max: 1423557.841. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Protocol: Redis - Clients: 500 - Set To Get Ratio: 1:5

Tau T2A: 32 vCPUs: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

Tau T2A: 48 vCPUs: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 100 - Set To Get Ratio: 5:18 vCPUs16 vCPUs32 vCPUs48 vCPUs300K600K900K1200K1500KSE +/- 3242.00, N = 3SE +/- 11603.90, N = 6SE +/- 11845.28, N = 6SE +/- 11981.33, N = 151098126.021153923.991288582.051361030.691. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 100 - Set To Get Ratio: 5:18 vCPUs16 vCPUs32 vCPUs48 vCPUs200K400K600K800K1000KMin: 1091817.6 / Avg: 1098126.02 / Max: 1102578.16Min: 1096330.03 / Avg: 1153923.99 / Max: 1170744.3Min: 1236847.06 / Avg: 1288582.05 / Max: 1317274.74Min: 1302111.15 / Avg: 1361030.69 / Max: 1456367.971. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:108 vCPUs16 vCPUs32 vCPUs48 vCPUs300K600K900K1200K1500KSE +/- 13811.08, N = 3SE +/- 13805.28, N = 3SE +/- 7715.51, N = 3SE +/- 17589.49, N = 151168107.071379214.161550665.241603778.181. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:108 vCPUs16 vCPUs32 vCPUs48 vCPUs300K600K900K1200K1500KMin: 1154261.26 / Avg: 1168107.07 / Max: 1195729.2Min: 1357286.67 / Avg: 1379214.16 / Max: 1404708.76Min: 1539961.41 / Avg: 1550665.24 / Max: 1565643.07Min: 1526427.87 / Avg: 1603778.18 / Max: 1808011.481. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 5:18 vCPUs16 vCPUs32 vCPUs48 vCPUs300K600K900K1200K1500KSE +/- 1292.39, N = 3SE +/- 5310.14, N = 3SE +/- 9075.81, N = 15SE +/- 3501.53, N = 31142072.381296026.291349568.701398276.551. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 5:18 vCPUs16 vCPUs32 vCPUs48 vCPUs200K400K600K800K1000KMin: 1140507.54 / Avg: 1142072.38 / Max: 1144636.44Min: 1290193.36 / Avg: 1296026.29 / Max: 1306628.81Min: 1280673.35 / Avg: 1349568.7 / Max: 1398199.79Min: 1391562.47 / Avg: 1398276.55 / Max: 1403357.831. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:108 vCPUs16 vCPUs32 vCPUs48 vCPUs400K800K1200K1600K2000KSE +/- 9505.17, N = 15SE +/- 11161.24, N = 3SE +/- 16025.69, N = 3SE +/- 14752.64, N = 31386615.551510468.571622298.801668971.161. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:108 vCPUs16 vCPUs32 vCPUs48 vCPUs300K600K900K1200K1500KMin: 1282248.37 / Avg: 1386615.55 / Max: 1432861.62Min: 1490436.01 / Avg: 1510468.57 / Max: 1529013.74Min: 1604710.24 / Avg: 1622298.8 / Max: 1654297.61Min: 1639491.13 / Avg: 1668971.16 / Max: 1684768.181. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

etcd

Etcd is a distributed, reliable key-value store intended for critical data of a distributed system. Etcd is written in Golang and part of the Cloud Native Computing Foundation (CNCF) and used by Kubernetes, Rook, CoreDNS, and other open-source software. This test profile uses Etcd's built-in benchmark to stress the PUT and RANGE performance of a single node / local system. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 500 - Clients: 100 - Average Latency16 vCPUs32 vCPUs48 vCPUs0.7651.532.2953.063.825SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 33.03.03.4
OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 500 - Clients: 100 - Average Latency16 vCPUs32 vCPUs48 vCPUs246810Min: 2.9 / Avg: 2.97 / Max: 3Min: 3 / Avg: 3 / Max: 3Min: 3.4 / Avg: 3.4 / Max: 3.4

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 500 - Clients: 10016 vCPUs32 vCPUs48 vCPUs7K14K21K28K35KSE +/- 113.38, N = 3SE +/- 20.00, N = 3SE +/- 190.85, N = 333614.7633400.5229592.03
OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 500 - Clients: 10016 vCPUs32 vCPUs48 vCPUs6K12K18K24K30KMin: 33419.77 / Avg: 33614.76 / Max: 33812.49Min: 33379.54 / Avg: 33400.52 / Max: 33440.51Min: 29210.4 / Avg: 29592.03 / Max: 29789.34

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 100 - Clients: 100 - Average Latency16 vCPUs32 vCPUs48 vCPUs0.74251.4852.22752.973.7125SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 33.03.03.3
OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 100 - Clients: 100 - Average Latency16 vCPUs32 vCPUs48 vCPUs246810Min: 3 / Avg: 3 / Max: 3Min: 3 / Avg: 3 / Max: 3Min: 3.3 / Avg: 3.3 / Max: 3.3

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 100 - Clients: 10016 vCPUs32 vCPUs48 vCPUs7K14K21K28K35KSE +/- 49.04, N = 3SE +/- 133.33, N = 3SE +/- 102.60, N = 333140.2233415.8130069.11
OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 100 - Clients: 10016 vCPUs32 vCPUs48 vCPUs6K12K18K24K30KMin: 33086.67 / Avg: 33140.22 / Max: 33238.17Min: 33176.69 / Avg: 33415.81 / Max: 33637.6Min: 29936.49 / Avg: 30069.11 / Max: 30271.03

memtier_benchmark

Memtier_benchmark is a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:18 vCPUs16 vCPUs32 vCPUs48 vCPUs300K600K900K1200K1500KSE +/- 11021.19, N = 3SE +/- 8098.74, N = 14SE +/- 10906.40, N = 3SE +/- 3252.36, N = 31131085.991217216.431343677.561409087.961. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:18 vCPUs16 vCPUs32 vCPUs48 vCPUs200K400K600K800K1000KMin: 1109816.08 / Avg: 1131085.99 / Max: 1146730.27Min: 1166900.06 / Avg: 1217216.43 / Max: 1297830.47Min: 1323125.29 / Avg: 1343677.56 / Max: 1360282.36Min: 1403808.06 / Avg: 1409087.96 / Max: 1415018.141. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

etcd

Etcd is a distributed, reliable key-value store intended for critical data of a distributed system. Etcd is written in Golang and part of the Cloud Native Computing Foundation (CNCF) and used by Kubernetes, Rook, CoreDNS, and other open-source software. This test profile uses Etcd's built-in benchmark to stress the PUT and RANGE performance of a single node / local system. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 100 - Clients: 100 - Average Latency16 vCPUs32 vCPUs48 vCPUs0.74251.4852.22752.973.7125SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 32.93.03.3
OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 100 - Clients: 100 - Average Latency16 vCPUs32 vCPUs48 vCPUs246810Min: 2.9 / Avg: 2.93 / Max: 3Min: 2.9 / Avg: 2.97 / Max: 3Min: 3.3 / Avg: 3.3 / Max: 3.3

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 100 - Clients: 10016 vCPUs32 vCPUs48 vCPUs7K14K21K28K35KSE +/- 62.45, N = 3SE +/- 134.59, N = 3SE +/- 74.04, N = 333675.1833649.7229993.71
OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 100 - Clients: 10016 vCPUs32 vCPUs48 vCPUs6K12K18K24K30KMin: 33557.3 / Avg: 33675.18 / Max: 33769.88Min: 33384.19 / Avg: 33649.72 / Max: 33820.72Min: 29861.38 / Avg: 29993.71 / Max: 30117.41

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 500 - Clients: 1000 - Average Latency16 vCPUs32 vCPUs48 vCPUs612182430SE +/- 0.20, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 320.820.623.0
OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 500 - Clients: 1000 - Average Latency16 vCPUs32 vCPUs48 vCPUs510152025Min: 20.4 / Avg: 20.77 / Max: 21.1Min: 20.6 / Avg: 20.6 / Max: 20.6Min: 23 / Avg: 23 / Max: 23

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 500 - Clients: 100016 vCPUs32 vCPUs48 vCPUs10K20K30K40K50KSE +/- 460.86, N = 3SE +/- 43.90, N = 3SE +/- 32.22, N = 347394.2848461.4843454.11
OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 500 - Clients: 100016 vCPUs32 vCPUs48 vCPUs8K16K24K32K40KMin: 46644.62 / Avg: 47394.28 / Max: 48233.53Min: 48393.74 / Avg: 48461.48 / Max: 48543.72Min: 43407.15 / Avg: 43454.11 / Max: 43515.81

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 500 - Clients: 1000 - Average Latency16 vCPUs32 vCPUs48 vCPUs612182430SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 319.720.623.0
OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 500 - Clients: 1000 - Average Latency16 vCPUs32 vCPUs48 vCPUs510152025Min: 19.6 / Avg: 19.67 / Max: 19.8Min: 20.5 / Avg: 20.57 / Max: 20.7Min: 22.9 / Avg: 22.97 / Max: 23

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 500 - Clients: 100016 vCPUs32 vCPUs48 vCPUs11K22K33K44K55KSE +/- 142.41, N = 3SE +/- 171.63, N = 3SE +/- 12.06, N = 349983.8948619.7543533.06
OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 500 - Clients: 100016 vCPUs32 vCPUs48 vCPUs9K18K27K36K45KMin: 49704.8 / Avg: 49983.89 / Max: 50172.68Min: 48277.93 / Avg: 48619.75 / Max: 48817.89Min: 43520.34 / Avg: 43533.06 / Max: 43557.18

memtier_benchmark

Memtier_benchmark is a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 500 - Set To Get Ratio: 1:108 vCPUs16 vCPUs300K600K900K1200K1500KSE +/- 11792.63, N = 5SE +/- 2550.58, N = 31175037.931377218.061. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 500 - Set To Get Ratio: 1:108 vCPUs16 vCPUs200K400K600K800K1000KMin: 1146068.17 / Avg: 1175037.93 / Max: 1211484.94Min: 1373071.37 / Avg: 1377218.06 / Max: 1381864.361. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Protocol: Redis - Clients: 500 - Set To Get Ratio: 1:10

Tau T2A: 32 vCPUs: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

Tau T2A: 48 vCPUs: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

etcd

Etcd is a distributed, reliable key-value store intended for critical data of a distributed system. Etcd is written in Golang and part of the Cloud Native Computing Foundation (CNCF) and used by Kubernetes, Rook, CoreDNS, and other open-source software. This test profile uses Etcd's built-in benchmark to stress the PUT and RANGE performance of a single node / local system. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 100 - Clients: 1000 - Average Latency16 vCPUs32 vCPUs48 vCPUs510152025SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 318.519.622.3
OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 100 - Clients: 1000 - Average Latency16 vCPUs32 vCPUs48 vCPUs510152025Min: 18.4 / Avg: 18.47 / Max: 18.5Min: 19.5 / Avg: 19.57 / Max: 19.6Min: 22.2 / Avg: 22.27 / Max: 22.3

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 100 - Clients: 100016 vCPUs32 vCPUs48 vCPUs12K24K36K48K60KSE +/- 154.19, N = 3SE +/- 79.89, N = 3SE +/- 57.68, N = 353741.7751066.3644802.65
OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 100 - Clients: 100016 vCPUs32 vCPUs48 vCPUs9K18K27K36K45KMin: 53488.17 / Avg: 53741.77 / Max: 54020.51Min: 50954.35 / Avg: 51066.36 / Max: 51221.05Min: 44696.34 / Avg: 44802.65 / Max: 44894.59

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 100 - Clients: 1000 - Average Latency16 vCPUs32 vCPUs48 vCPUs510152025SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 318.119.622.3
OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 100 - Clients: 1000 - Average Latency16 vCPUs32 vCPUs48 vCPUs510152025Min: 18 / Avg: 18.07 / Max: 18.2Min: 19.5 / Avg: 19.57 / Max: 19.6Min: 22.1 / Avg: 22.3 / Max: 22.5

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 100 - Clients: 100016 vCPUs32 vCPUs48 vCPUs12K24K36K48K60KSE +/- 139.28, N = 3SE +/- 51.63, N = 3SE +/- 231.66, N = 354936.9151019.9244762.67
OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 100 - Clients: 100016 vCPUs32 vCPUs48 vCPUs10K20K30K40K50KMin: 54662.18 / Avg: 54936.91 / Max: 55114.16Min: 50937.8 / Avg: 51019.92 / Max: 51115.19Min: 44357.93 / Avg: 44762.67 / Max: 45160.35

memtier_benchmark

Memtier_benchmark is a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 500 - Set To Get Ratio: 1:18 vCPUs16 vCPUs300K600K900K1200K1500KSE +/- 10209.00, N = 3SE +/- 15317.60, N = 41061386.921242844.811. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 500 - Set To Get Ratio: 1:18 vCPUs16 vCPUs200K400K600K800K1000KMin: 1043520.91 / Avg: 1061386.92 / Max: 1078880.03Min: 1205564.39 / Avg: 1242844.81 / Max: 1277925.651. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Protocol: Redis - Clients: 500 - Set To Get Ratio: 1:1

Tau T2A: 32 vCPUs: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

Tau T2A: 48 vCPUs: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:58 vCPUs16 vCPUs32 vCPUs48 vCPUs400K800K1200K1600K2000KSE +/- 14679.67, N = 5SE +/- 5887.48, N = 3SE +/- 7138.66, N = 3SE +/- 2032.19, N = 31387706.601550016.781660921.571693195.221. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:58 vCPUs16 vCPUs32 vCPUs48 vCPUs300K600K900K1200K1500KMin: 1359955.21 / Avg: 1387706.6 / Max: 1441189.81Min: 1542850.78 / Avg: 1550016.78 / Max: 1561691.35Min: 1646811.42 / Avg: 1660921.57 / Max: 1669863.16Min: 1689355.57 / Avg: 1693195.22 / Max: 1696269.241. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 500 - Set To Get Ratio: 5:18 vCPUs16 vCPUs300K600K900K1200K1500KSE +/- 8628.56, N = 3SE +/- 2296.18, N = 3982898.081174862.901. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 500 - Set To Get Ratio: 5:18 vCPUs16 vCPUs200K400K600K800K1000KMin: 965766.54 / Avg: 982898.08 / Max: 993263.52Min: 1171313.65 / Avg: 1174862.9 / Max: 1179161.311. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Protocol: Redis - Clients: 500 - Set To Get Ratio: 5:1

Tau T2A: 32 vCPUs: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

Tau T2A: 48 vCPUs: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:58 vCPUs16 vCPUs32 vCPUs48 vCPUs400K800K1200K1600K2000KSE +/- 7781.12, N = 3SE +/- 2999.36, N = 3SE +/- 20825.75, N = 3SE +/- 18154.88, N = 31283692.941340638.361486481.561660275.791. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:58 vCPUs16 vCPUs32 vCPUs48 vCPUs300K600K900K1200K1500KMin: 1268438.67 / Avg: 1283692.94 / Max: 1293987.99Min: 1335509.52 / Avg: 1340638.36 / Max: 1345897.17Min: 1461320.42 / Avg: 1486481.56 / Max: 1527807.98Min: 1623966.59 / Avg: 1660275.79 / Max: 1678603.791. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Dragonfly is an open-source database server that is a "modern Redis replacement" that aims to be the fastest memory store while being compliant with the Redis and Memcached protocols. For benchmarking Dragonfly, Memtier_benchmark is used as a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 5:18 vCPUs16 vCPUs32 vCPUs48 vCPUs400K800K1200K1600K2000KSE +/- 4401.98, N = 3SE +/- 8187.63, N = 3SE +/- 2887.91, N = 3SE +/- 4991.42, N = 31374673.111849882.272036075.911962365.801. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 5:18 vCPUs16 vCPUs32 vCPUs48 vCPUs400K800K1200K1600K2000KMin: 1369300.06 / Avg: 1374673.11 / Max: 1383399.51Min: 1833507.08 / Avg: 1849882.27 / Max: 1858114.75Min: 2031759.39 / Avg: 2036075.91 / Max: 2041557.7Min: 1952749.32 / Avg: 1962365.8 / Max: 1969494.661. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 1:18 vCPUs16 vCPUs32 vCPUs48 vCPUs500K1000K1500K2000K2500KSE +/- 2899.90, N = 3SE +/- 3661.11, N = 3SE +/- 5691.58, N = 3SE +/- 4241.23, N = 31403891.711926869.122171524.162047988.931. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 1:18 vCPUs16 vCPUs32 vCPUs48 vCPUs400K800K1200K1600K2000KMin: 1399033.12 / Avg: 1403891.71 / Max: 1409063.96Min: 1921078.11 / Avg: 1926869.12 / Max: 1933645.25Min: 2162752.28 / Avg: 2171524.16 / Max: 2182192.85Min: 2039507.49 / Avg: 2047988.93 / Max: 2052343.791. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 1:58 vCPUs16 vCPUs32 vCPUs48 vCPUs500K1000K1500K2000K2500KSE +/- 4595.33, N = 3SE +/- 6286.48, N = 3SE +/- 6273.12, N = 3SE +/- 7704.61, N = 31512957.922049725.722301175.422177274.121. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 1:58 vCPUs16 vCPUs32 vCPUs48 vCPUs400K800K1200K1600K2000KMin: 1505037.36 / Avg: 1512957.92 / Max: 1520955.48Min: 2038605.31 / Avg: 2049725.72 / Max: 2060366.46Min: 2291838.95 / Avg: 2301175.42 / Max: 2313101.68Min: 2161885.51 / Avg: 2177274.12 / Max: 2185658.341. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

memtier_benchmark

Memtier_benchmark is a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:18 vCPUs16 vCPUs32 vCPUs48 vCPUs300K600K900K1200K1500KSE +/- 15919.41, N = 3SE +/- 11031.00, N = 3SE +/- 8699.17, N = 3SE +/- 6810.63, N = 31294995.951429340.111505221.661593625.771. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:18 vCPUs16 vCPUs32 vCPUs48 vCPUs300K600K900K1200K1500KMin: 1272694.26 / Avg: 1294995.95 / Max: 1325825.68Min: 1410149.58 / Avg: 1429340.11 / Max: 1448360.94Min: 1493575.19 / Avg: 1505221.66 / Max: 1522238.5Min: 1585498.65 / Avg: 1593625.77 / Max: 1607155.921. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Dragonfly is an open-source database server that is a "modern Redis replacement" that aims to be the fastest memory store while being compliant with the Redis and Memcached protocols. For benchmarking Dragonfly, Memtier_benchmark is used as a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 1:18 vCPUs16 vCPUs32 vCPUs48 vCPUs600K1200K1800K2400K3000KSE +/- 677.51, N = 3SE +/- 6165.46, N = 3SE +/- 9574.38, N = 3SE +/- 6009.00, N = 31475197.202108004.912666276.282822040.311. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 1:18 vCPUs16 vCPUs32 vCPUs48 vCPUs500K1000K1500K2000K2500KMin: 1473893.28 / Avg: 1475197.2 / Max: 1476168.4Min: 2095682.16 / Avg: 2108004.91 / Max: 2114554.77Min: 2647172.17 / Avg: 2666276.28 / Max: 2676960.23Min: 2814419.46 / Avg: 2822040.31 / Max: 2833898.491. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 5:18 vCPUs16 vCPUs32 vCPUs48 vCPUs600K1200K1800K2400K3000KSE +/- 1202.40, N = 3SE +/- 4533.22, N = 3SE +/- 7304.87, N = 3SE +/- 16749.22, N = 31442139.222056183.132583896.232743928.471. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 5:18 vCPUs16 vCPUs32 vCPUs48 vCPUs500K1000K1500K2000K2500KMin: 1439735.87 / Avg: 1442139.22 / Max: 1443413.13Min: 2050240.53 / Avg: 2056183.13 / Max: 2065084.39Min: 2570374.38 / Avg: 2583896.23 / Max: 2595448.07Min: 2717315.7 / Avg: 2743928.47 / Max: 2774853.851. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 1:58 vCPUs16 vCPUs32 vCPUs48 vCPUs600K1200K1800K2400K3000KSE +/- 2960.63, N = 3SE +/- 2687.16, N = 3SE +/- 12909.79, N = 3SE +/- 4725.62, N = 31595193.712275161.752858331.462994524.681. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 1:58 vCPUs16 vCPUs32 vCPUs48 vCPUs500K1000K1500K2000K2500KMin: 1589331.73 / Avg: 1595193.71 / Max: 1598848.44Min: 2271137.53 / Avg: 2275161.75 / Max: 2280258.79Min: 2840484.66 / Avg: 2858331.46 / Max: 2883413.67Min: 2988990.44 / Avg: 2994524.68 / Max: 3003926.821. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre