Tau T2A DBs

Benchmarks for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2208203-NE-CLOUD719610&sro&gru.

ProcessorMotherboardMemoryDiskNetworkOSKernelCompilerFile-SystemSystem LayerTau T2A 8 vCPUs 16 vCPUsARMv8 Neoverse-N1 (8 Cores)KVM Google Compute Engine32GB215GB nvme_card-pdGoogle Compute Engine VirtualUbuntu 22.045.15.0-1016-gcp (aarch64)GCC 12.0.1 20220319ext4KVMARMv8 Neoverse-N1 (16 Cores)64GBOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseEnvironment Details- CXXFLAGS="-O3 -march=native" CFLAGS="-O3 -march=native"Compiler Details- --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected

dragonflydb: 50 - 1:1dragonflydb: 50 - 1:5dragonflydb: 50 - 5:1dragonflydb: 200 - 1:1dragonflydb: 200 - 1:5dragonflydb: 200 - 5:1memtier-benchmark: Redis - 50 - 1:1memtier-benchmark: Redis - 50 - 1:5memtier-benchmark: Redis - 50 - 5:1memtier-benchmark: Redis - 100 - 1:1memtier-benchmark: Redis - 100 - 1:5memtier-benchmark: Redis - 100 - 5:1memtier-benchmark: Redis - 50 - 1:10memtier-benchmark: Redis - 500 - 1:1memtier-benchmark: Redis - 500 - 1:5memtier-benchmark: Redis - 500 - 5:1memtier-benchmark: Redis - 100 - 1:10memtier-benchmark: Redis - 500 - 1:10clickhouse: 100M Rows Web Analytics Dataset, First Run / Cold Cacheclickhouse: 100M Rows Web Analytics Dataset, Second Runclickhouse: 100M Rows Web Analytics Dataset, Third Runetcd: PUT - 100 - 100etcd: PUT - 500 - 100etcd: PUT - 100 - 1000etcd: PUT - 500 - 1000etcd: RANGE - 100 - 100etcd: RANGE - 500 - 100etcd: RANGE - 100 - 1000etcd: RANGE - 500 - 1000etcd: PUT - 100 - 100 - Average Latencyetcd: PUT - 500 - 100 - Average Latencyetcd: PUT - 100 - 1000 - Average Latencyetcd: PUT - 500 - 1000 - Average Latencyetcd: RANGE - 100 - 100 - Average Latencyetcd: RANGE - 500 - 100 - Average Latencyetcd: RANGE - 100 - 1000 - Average Latencyetcd: RANGE - 500 - 1000 - Average LatencyTau T2A 8 vCPUs 16 vCPUs1475197.201595193.711442139.221403891.711512957.921374673.111294995.951387706.601142072.381131085.991283692.941098126.021386615.551061386.921129614.25982898.081168107.071175037.93100.79103.73104.322108004.912275161.752056183.131926869.122049725.721849882.271429340.111550016.781296026.291217216.431340638.361153923.991510468.571242844.811365893.271174862.901379214.161377218.06150.90154.86157.8133675.176033614.758154936.909149983.890133140.222532663.238053741.768047394.28362.93.018.119.733.118.520.8OpenBenchmarking.org

Dragonflydb

Clients: 50 - Set To Get Ratio: 1:1

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 1:116 vCPUs8 vCPUs500K1000K1500K2000K2500KSE +/- 6165.46, N = 3SE +/- 677.51, N = 32108004.911475197.201. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients: 50 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 1:516 vCPUs8 vCPUs500K1000K1500K2000K2500KSE +/- 2687.16, N = 3SE +/- 2960.63, N = 32275161.751595193.711. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients: 50 - Set To Get Ratio: 5:1

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 5:116 vCPUs8 vCPUs400K800K1200K1600K2000KSE +/- 4533.22, N = 3SE +/- 1202.40, N = 32056183.131442139.221. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients: 200 - Set To Get Ratio: 1:1

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 1:116 vCPUs8 vCPUs400K800K1200K1600K2000KSE +/- 3661.11, N = 3SE +/- 2899.90, N = 31926869.121403891.711. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients: 200 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 1:516 vCPUs8 vCPUs400K800K1200K1600K2000KSE +/- 6286.48, N = 3SE +/- 4595.33, N = 32049725.721512957.921. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients: 200 - Set To Get Ratio: 5:1

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 5:116 vCPUs8 vCPUs400K800K1200K1600K2000KSE +/- 8187.63, N = 3SE +/- 4401.98, N = 31849882.271374673.111. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

memtier_benchmark

Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:1

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:116 vCPUs8 vCPUs300K600K900K1200K1500KSE +/- 11031.00, N = 3SE +/- 15919.41, N = 31429340.111294995.951. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

memtier_benchmark

Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:516 vCPUs8 vCPUs300K600K900K1200K1500KSE +/- 5887.48, N = 3SE +/- 14679.67, N = 51550016.781387706.601. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

memtier_benchmark

Protocol: Redis - Clients: 50 - Set To Get Ratio: 5:1

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 5:116 vCPUs8 vCPUs300K600K900K1200K1500KSE +/- 5310.14, N = 3SE +/- 1292.39, N = 31296026.291142072.381. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

memtier_benchmark

Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:1

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:116 vCPUs8 vCPUs300K600K900K1200K1500KSE +/- 8098.74, N = 14SE +/- 11021.19, N = 31217216.431131085.991. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

memtier_benchmark

Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:516 vCPUs8 vCPUs300K600K900K1200K1500KSE +/- 2999.36, N = 3SE +/- 7781.12, N = 31340638.361283692.941. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

memtier_benchmark

Protocol: Redis - Clients: 100 - Set To Get Ratio: 5:1

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 100 - Set To Get Ratio: 5:116 vCPUs8 vCPUs200K400K600K800K1000KSE +/- 11603.90, N = 6SE +/- 3242.00, N = 31153923.991098126.021. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

memtier_benchmark

Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:1016 vCPUs8 vCPUs300K600K900K1200K1500KSE +/- 11161.24, N = 3SE +/- 9505.17, N = 151510468.571386615.551. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

memtier_benchmark

Protocol: Redis - Clients: 500 - Set To Get Ratio: 1:1

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 500 - Set To Get Ratio: 1:116 vCPUs8 vCPUs300K600K900K1200K1500KSE +/- 15317.60, N = 4SE +/- 10209.00, N = 31242844.811061386.921. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

memtier_benchmark

Protocol: Redis - Clients: 500 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 500 - Set To Get Ratio: 1:516 vCPUs8 vCPUs300K600K900K1200K1500KSE +/- 11303.01, N = 9SE +/- 11571.22, N = 151365893.271129614.251. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

memtier_benchmark

Protocol: Redis - Clients: 500 - Set To Get Ratio: 5:1

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 500 - Set To Get Ratio: 5:116 vCPUs8 vCPUs300K600K900K1200K1500KSE +/- 2296.18, N = 3SE +/- 8628.56, N = 31174862.90982898.081. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

memtier_benchmark

Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:1016 vCPUs8 vCPUs300K600K900K1200K1500KSE +/- 13805.28, N = 3SE +/- 13811.08, N = 31379214.161168107.071. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

memtier_benchmark

Protocol: Redis - Clients: 500 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 500 - Set To Get Ratio: 1:1016 vCPUs8 vCPUs300K600K900K1200K1500KSE +/- 2550.58, N = 3SE +/- 11792.63, N = 51377218.061175037.931. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

ClickHouse

100M Rows Web Analytics Dataset, First Run / Cold Cache

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, First Run / Cold Cache16 vCPUs8 vCPUs306090120150SE +/- 0.34, N = 3SE +/- 1.29, N = 12150.90100.79MIN: 16.26 / MAX: 12000MIN: 5.68 / MAX: 120001. ClickHouse server version 22.5.4.19 (official build).

ClickHouse

100M Rows Web Analytics Dataset, Second Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, Second Run16 vCPUs8 vCPUs306090120150SE +/- 2.24, N = 3SE +/- 0.36, N = 12154.86103.73MIN: 16.08 / MAX: 12000MIN: 9.23 / MAX: 120001. ClickHouse server version 22.5.4.19 (official build).

ClickHouse

100M Rows Web Analytics Dataset, Third Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, Third Run16 vCPUs8 vCPUs306090120150SE +/- 0.61, N = 3SE +/- 0.32, N = 12157.81104.32MIN: 15.81 / MAX: 12000MIN: 9.26 / MAX: 120001. ClickHouse server version 22.5.4.19 (official build).

etcd

Test: PUT - Connections: 100 - Clients: 100

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 100 - Clients: 100Tau T2A: 16 vCPUs7K14K21K28K35KSE +/- 62.45, N = 333675.18

etcd

Test: PUT - Connections: 500 - Clients: 100

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 500 - Clients: 100Tau T2A: 16 vCPUs7K14K21K28K35KSE +/- 113.38, N = 333614.76

etcd

Test: PUT - Connections: 100 - Clients: 1000

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 100 - Clients: 1000Tau T2A: 16 vCPUs12K24K36K48K60KSE +/- 139.28, N = 354936.91

etcd

Test: PUT - Connections: 500 - Clients: 1000

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 500 - Clients: 1000Tau T2A: 16 vCPUs11K22K33K44K55KSE +/- 142.41, N = 349983.89

etcd

Test: RANGE - Connections: 100 - Clients: 100

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 100 - Clients: 100Tau T2A: 16 vCPUs7K14K21K28K35KSE +/- 49.04, N = 333140.22

etcd

Test: RANGE - Connections: 500 - Clients: 100

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 500 - Clients: 100Tau T2A: 16 vCPUs7K14K21K28K35KSE +/- 414.72, N = 1232663.24

etcd

Test: RANGE - Connections: 100 - Clients: 1000

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 100 - Clients: 1000Tau T2A: 16 vCPUs12K24K36K48K60KSE +/- 154.19, N = 353741.77

etcd

Test: RANGE - Connections: 500 - Clients: 1000

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 500 - Clients: 1000Tau T2A: 16 vCPUs10K20K30K40K50KSE +/- 460.86, N = 347394.28

etcd

Test: PUT - Connections: 100 - Clients: 100 - Average Latency

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 100 - Clients: 100 - Average LatencyTau T2A: 16 vCPUs0.65251.3051.95752.613.2625SE +/- 0.03, N = 32.9

etcd

Test: PUT - Connections: 500 - Clients: 100 - Average Latency

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 500 - Clients: 100 - Average LatencyTau T2A: 16 vCPUs0.6751.352.0252.73.375SE +/- 0.03, N = 33.0

etcd

Test: PUT - Connections: 100 - Clients: 1000 - Average Latency

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 100 - Clients: 1000 - Average LatencyTau T2A: 16 vCPUs48121620SE +/- 0.07, N = 318.1

etcd

Test: PUT - Connections: 500 - Clients: 1000 - Average Latency

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 500 - Clients: 1000 - Average LatencyTau T2A: 16 vCPUs510152025SE +/- 0.07, N = 319.7

etcd

Test: RANGE - Connections: 100 - Clients: 100 - Average Latency

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 100 - Clients: 100 - Average LatencyTau T2A: 16 vCPUs0.6751.352.0252.73.375SE +/- 0.00, N = 33

etcd

Test: RANGE - Connections: 500 - Clients: 100 - Average Latency

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 500 - Clients: 100 - Average LatencyTau T2A: 16 vCPUs0.69751.3952.09252.793.4875SE +/- 0.04, N = 123.1

etcd

Test: RANGE - Connections: 100 - Clients: 1000 - Average Latency

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 100 - Clients: 1000 - Average LatencyTau T2A: 16 vCPUs510152025SE +/- 0.03, N = 318.5

etcd

Test: RANGE - Connections: 500 - Clients: 1000 - Average Latency

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 500 - Clients: 1000 - Average LatencyTau T2A: 16 vCPUs510152025SE +/- 0.20, N = 320.8

Phoronix Test Suite v10.8.5