Apache IoTDB Apache IotDB is a time series database and this benchmark is facilitated using the IoT Benchmaark [https://github.com/thulab/iot-benchmark/].
To run this test with the Phoronix Test Suite , the basic command is: phoronix-test-suite benchmark apache-iotdb .
Test Created 29 July 2023
Last Updated 17 September 2023
Test Type System
Average Install Time 2 Seconds
Average Run Time 4 Minutes, 34 Seconds
Test Dependencies Java
Accolades Public Result Uploads * Reported Installs ** Reported Test Completions ** Test Profile Page Views OpenBenchmarking.org Events Apache IoTDB Popularity Statistics pts/apache-iotdb 2023.07 2023.08 2023.09 2023.10 2023.11 2023.12 2024.01 2024.02 2024.03 2024.04 2024.05 2024.06 2024.07 2024.08 2024.09 2024.10 2024.11 2024.12 4K 8K 12K 16K 20K * Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
800 36.1% 100 9.9% 500 44.2% 200 9.9% Device Count Option Popularity OpenBenchmarking.org 100 80.8% 1 19.2% Batch Size Per Write Option Popularity OpenBenchmarking.org 200 21.2% 500 35.5% 800 43.3% Sensor Count Option Popularity OpenBenchmarking.org 400 48.4% 100 51.6% Client Number Option Popularity OpenBenchmarking.org pts/apache-iotdb-1.2.0 [View Source ] Sun, 17 Sep 2023 10:51:52 GMT Update against Apache IotDB 1.2 uostream.
pts/apache-iotdb-1.0.1 [View Source ] Sat, 05 Aug 2023 20:38:28 GMT Fix lower-is-better indicator for latency metrics.
pts/apache-iotdb-1.0.0 [View Source ] Sat, 29 Jul 2023 12:08:40 GMT Add Apache IotDB Benchmark.
Analyze Test Configuration: pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 1 - Sensor Count: 500 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 1 - Sensor Count: 500 - Client Number: 400 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 1 - Sensor Count: 500 - Client Number: 400 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 1 - Sensor Count: 800 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 1 - Sensor Count: 800 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 1 - Sensor Count: 200 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 1 - Sensor Count: 200 - Client Number: 400 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 1 - Sensor Count: 200 - Client Number: 400 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 1 - Sensor Count: 800 - Client Number: 400 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 1 - Sensor Count: 800 - Client Number: 400 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 1 - Sensor Count: 200 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 800 - Batch Size Per Write: 1 - Sensor Count: 500 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 200 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 200 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 800 - Client Number: 400 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 800 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 200 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 200 - Client Number: 400 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 200 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 500 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 500 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 200 - Client Number: 400 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 500 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 800 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 200 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 800 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 500 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 800 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 500 - Client Number: 400 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 800 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 500 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 500 - Client Number: 400 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 800 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 200 - Client Number: 100 (point/sec) pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 500 - Client Number: 100 (Average Latency) pts/apache-iotdb-1.2.x - Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 800 - Client Number: 400 (Average Latency) pts/apache-iotdb-1.0.x - Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500 (point/sec) pts/apache-iotdb-1.0.x - Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500 (Average Latency) pts/apache-iotdb-1.0.x - Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500 (point/sec) pts/apache-iotdb-1.0.x - Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500 (Average Latency) pts/apache-iotdb-1.0.x - Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 500 (Average Latency) pts/apache-iotdb-1.0.x - Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 500 (point/sec) pts/apache-iotdb-1.0.x - Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 200 (Average Latency) pts/apache-iotdb-1.0.x - Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 200 (point/sec) pts/apache-iotdb-1.0.x - Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 500 (Average Latency) pts/apache-iotdb-1.0.x - Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 500 (point/sec) pts/apache-iotdb-1.0.x - Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200 (Average Latency) pts/apache-iotdb-1.0.x - Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200 (point/sec) pts/apache-iotdb-1.0.x - Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 200 (Average Latency) pts/apache-iotdb-1.0.x - Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 200 (point/sec) pts/apache-iotdb-1.0.x - Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 500 (point/sec) pts/apache-iotdb-1.0.x - Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 500 (Average Latency) pts/apache-iotdb-1.0.x - Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 200 (Average Latency) pts/apache-iotdb-1.0.x - Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 200 (point/sec) pts/apache-iotdb-1.0.x - Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 (point/sec) pts/apache-iotdb-1.0.x - Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 (Average Latency) pts/apache-iotdb-1.0.x - Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 200 (Average Latency) pts/apache-iotdb-1.0.x - Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 200 (point/sec) pts/apache-iotdb-1.0.x - Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 (Average Latency) pts/apache-iotdb-1.0.x - Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 (point/sec) Apache IoTDB 1.2 Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 OpenBenchmarking.org metrics for this test profile configuration based on 409 public results since 17 September 2023 with the latest data as of 19 November 2024 .
Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.
Component
Percentile Rank
# Compatible Public Results
Average Latency (Average)
Detailed Performance Overview OpenBenchmarking.org Distribution Of Public Results - Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 409 Results Range From 61 To 3785 Average Latency 61 136 211 286 361 436 511 586 661 736 811 886 961 1036 1111 1186 1261 1336 1411 1486 1561 1636 1711 1786 1861 1936 2011 2086 2161 2236 2311 2386 2461 2536 2611 2686 2761 2836 2911 2986 3061 3136 3211 3286 3361 3436 3511 3586 3661 3736 3811 40 80 120 160 200 Based on OpenBenchmarking.org data, the selected test / test configuration (Apache IoTDB 1.2 - Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 ) has an average run-time of 13 minutes . By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.
OpenBenchmarking.org Minutes Time Required To Complete Benchmark Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 Run-Time 7 14 21 28 35 Min: 5 / Avg: 12.87 / Max: 33 Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 1.4% .
OpenBenchmarking.org Percent, Fewer Is Better Average Deviation Between Runs Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 Deviation 2 4 6 8 10 Min: 0 / Avg: 1.43 / Max: 4 Does It Scale Well With Increasing Cores? No , based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.
AMD Intel OpenBenchmarking.org Relative Core Scaling To Base Apache IoTDB CPU Core Scaling Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 6 8 12 14 16 24 0.4667 0.9334 1.4001 1.8668 2.3335 Tested CPU Architectures This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.
CPU Architecture
Kernel Identifier
Verified On
Intel / AMD x86 64-bit
x86_64
(Many Processors)
