rk1-mainline-emmc-run, rk1-mainline-nvme, rok1, pi5-compilation, pi4-raspbian-sd

rk1-mainline-emmc testing on Ubuntu 22.04 via the Phoronix Test Suite.

rk1-mainline-nvme: rk1-mainline-nvme testing on Ubuntu 22.04 via the Phoronix Test Suite.

rok1: Rockchip ARMv8 Cortex-A76 testing with a Turing Machines RK1 and rockchipdrmfb on Ubuntu 22.04 via the Phoronix Test Suite.

pi5-compilation: ARMv8 Cortex-A76 testing on Debian 12 via the Phoronix Test Suite.

pi4-raspbian-sd: ARMv8 Cortex-A72 testing on Debian 12 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2405141-NE-RK1EMMCCO86
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Transpose Comparison
Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
rk1-mainline-emmc
February 25
  5 Days, 12 Hours, 44 Minutes
rk1-mainline-nvme
February 25
 
rk1-rok-emmc
February 25
  5 Days, 12 Hours, 20 Minutes
rk1-rok-nvme
March 11
 
pi5-raspbian-nvme
February 25
  1 Day, 6 Hours, 29 Minutes
pi4-raspbian-sd
February 25
  10 Hours, 57 Minutes
Invert Behavior (Only Show Selected Data)
 

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


rk1-mainline-emmc-run, rk1-mainline-nvme, rok1, pi5-compilation, pi4-raspbian-sdProcessorMotherboardMemoryDiskGraphicsNetworkChipsetOSKernelCompilerFile-SystemScreen ResolutionVulkanDisplay Serverrk1-rok-emmcrk1-mainline-emmcpi5-raspbian-nvmerk1-mainline-nvmepi4-raspbian-sdrk1-rok-nvmerk1-rok-emmc @ 1.80GHz (4 Cores / 8 Threads)Turing Machines RK132GB500GB CT500P3SSD8 + 31GB BJTD4RrockchipdrmfbUbuntu 22.045.10.160-rockchip (aarch64)GCC 11.4.0ext41920x1080rk1-mainline-emmc @ 1.80GHz (4 Cores / 8 Threads)1000GB CT1000P3PSSD8 + 31GB BJTD4R6.7.0 (aarch64)1.3.255ARMv8 Cortex-A76 @ 2.40GHz (4 Cores)Raspberry Pi 5 Model B Rev 1.04096MB500GB CT500P3SSD8Device 1de4:0001Debian 126.1.0-rpi7-rpi-2712 (aarch64)GCC 12.2.0rk1-mainline-nvme @ 1.80GHz (4 Cores / 8 Threads)Turing Machines RK132GB500GB CT500P3SSD8 + 31GB BJTD4RUbuntu 22.046.7.0 (aarch64)1.3.255GCC 11.4.0ARMv8 Cortex-A72 @ 1.80GHz (4 Cores)BCM2835 Raspberry Pi 400 Rev 1.0Broadcom BCM27114096MB64GB SR64GDebian 126.1.0-rpi6-rpi-v8 (aarch64)X ServerGCC 12.2.0Rockchip ARMv8 Cortex-A76 @ 1.80GHz (4 Cores / 8 Threads)Turing Machines RK132GB500GB CT500P3SSD8 + 31GB BJTD4RrockchipdrmfbUbuntu 22.045.10.160-rockchip (aarch64)GCC 11.4.01920x1080OpenBenchmarking.orgCompiler Details- rk1-rok-emmc: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - rk1-mainline-emmc: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - pi5-raspbian-nvme: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - rk1-mainline-nvme: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - pi4-raspbian-sd: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - rk1-rok-nvme: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v Processor Details- rk1-rok-emmc: Scaling Governor: cpufreq-dt performance- rk1-mainline-emmc: Scaling Governor: rockchip-cpufreq ondemand- pi5-raspbian-nvme: Scaling Governor: cpufreq-dt ondemand- rk1-mainline-nvme: Scaling Governor: rockchip-cpufreq performance- pi4-raspbian-sd: Scaling Governor: cpufreq-dt ondemand- rk1-rok-nvme: Scaling Governor: cpufreq-dt performancePython Details- rk1-rok-emmc: Python 3.10.12- rk1-mainline-emmc: Python 3.10.12- pi5-raspbian-nvme: Python 3.11.2- rk1-mainline-nvme: Python 3.10.12- pi4-raspbian-sd: Python 3.11.2- rk1-rok-nvme: Python 3.10.12Security Details- rk1-rok-emmc: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - rk1-mainline-emmc: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - pi5-raspbian-nvme: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected - rk1-mainline-nvme: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - pi4-raspbian-sd: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable + srbds: Not affected + tsx_async_abort: Not affected - rk1-rok-nvme: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected Kernel Details- rk1-mainline-emmc: Transparent Huge Pages: madvise- rk1-mainline-nvme: Transparent Huge Pages: madvise- pi4-raspbian-sd: snd_bcm2835.enable_headphones=0 snd_bcm2835.enable_hdmi=1 snd_bcm2835.enable_hdmi=0 cfg80211.ieee80211_regdom=US

rk1-mainline-emmc-run, rk1-mainline-nvme, rok1, pi5-compilation, pi4-raspbian-sdspark-tpcds: 3000rk1-rok-emmcrk1-mainline-emmcpi5-raspbian-nvmerk1-mainline-nvmepi4-raspbian-sdrk1-rok-nvmeOpenBenchmarking.org

Apache Spark TPC-DS

This is a benchmark of Apache Spark using the TPC-DS data-set. Apache Spark is an open-source unified analytics engine for large-scale data processing and dealing with big data. This test profile benchmarks the Apache Spark in a single-system configuration and leverages the https://github.com/databricks/tpcds-kit and https://github.com/IBM/spark-tpc-ds-performance-test/ projects for testing. Learn more via the OpenBenchmarking.org test page.

Scale Factor: 3000

rk1-rok-nvme: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ./spark-tpcds: line 9: echo: write error: No space left on device

Apache CouchDB

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Bulk Size Comparison (Inserts: 1000 - Rounds: 30)100300500150300450600750SE +/- 3.82, N = 9SE +/- 2.78, N = 3SE +/- 0.74, N = 3SE +/- 2.31, N = 3SE +/- 3.79, N = 3SE +/- 0.51, N = 3SE +/- 2.80, N = 9SE +/- 1.83, N = 3SE +/- 3.77, N = 3SE +/- 2.59, N = 6SE +/- 0.91, N = 3SE +/- 2.58, N = 3262.44377.97464.69247.76366.67438.30266.25384.07676.09258.52394.74679.401. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Inserts Comparison (Bulk Size: 100 - - Rounds: 30)100030002004006008001000SE +/- 3.82, N = 9SE +/- 1.11, N = 3SE +/- 2.31, N = 3SE +/- 0.84, N = 3SE +/- 2.80, N = 9SE +/- 1.88, N = 3SE +/- 2.59, N = 6SE +/- 10.18, N = 3262.44887.89247.76860.53266.25855.61258.52871.541. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 100 - Inserts: 1000)3060120180240300SE +/- 3.82, N = 9SE +/- 2.31, N = 3SE +/- 2.80, N = 9SE +/- 2.59, N = 6262.44247.76266.25258.521. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Bulk Size Comparison (Inserts: 3000 - Rounds: 30)1003005005001000150020002500SE +/- 1.11, N = 3SE +/- 14.88, N = 5SE +/- 0.87, N = 3SE +/- 0.84, N = 3SE +/- 2.19, N = 3SE +/- 1.95, N = 3SE +/- 1.88, N = 3SE +/- 31.00, N = 9SE +/- 11.33, N = 3SE +/- 10.18, N = 3SE +/- 2.59, N = 3SE +/- 13.77, N = 3887.891412.822261.83860.531314.732158.52855.611492.532083.07871.541444.002140.741. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 100 - Inserts: 3000)302004006008001000SE +/- 1.11, N = 3SE +/- 0.84, N = 3SE +/- 1.88, N = 3SE +/- 10.18, N = 3887.89860.53855.61871.541. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Inserts Comparison (Bulk Size: 300 - - Rounds: 30)1000300030060090012001500SE +/- 2.78, N = 3SE +/- 14.88, N = 5SE +/- 3.79, N = 3SE +/- 2.19, N = 3SE +/- 1.83, N = 3SE +/- 31.00, N = 9SE +/- 0.91, N = 3SE +/- 2.59, N = 3377.971412.82366.671314.73384.071492.53394.741444.001. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 300 - Inserts: 1000)3090180270360450SE +/- 2.78, N = 3SE +/- 3.79, N = 3SE +/- 1.83, N = 3SE +/- 0.91, N = 3377.97366.67384.07394.741. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 300 - Inserts: 3000)3030060090012001500SE +/- 14.88, N = 5SE +/- 2.19, N = 3SE +/- 31.00, N = 9SE +/- 2.59, N = 31412.821314.731492.531444.001. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Inserts Comparison (Bulk Size: 500 - - Rounds: 30)100030005001000150020002500SE +/- 0.74, N = 3SE +/- 0.87, N = 3SE +/- 0.51, N = 3SE +/- 1.95, N = 3SE +/- 3.77, N = 3SE +/- 11.33, N = 3SE +/- 2.58, N = 3SE +/- 13.77, N = 3464.692261.83438.302158.52676.092083.07679.402140.741. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 500 - Inserts: 1000)30150300450600750SE +/- 0.74, N = 3SE +/- 0.51, N = 3SE +/- 3.77, N = 3SE +/- 2.58, N = 3464.69438.30676.09679.401. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 500 - Inserts: 3000)305001000150020002500SE +/- 0.87, N = 3SE +/- 1.95, N = 3SE +/- 11.33, N = 3SE +/- 13.77, N = 32261.832158.522083.072140.741. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache Spark

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - SHA-512 Benchmark Time)10000001000000020000000400000004080120160200SE +/- 0.11, N = 4SE +/- 0.32, N = 3SE +/- 0.22, N = 3SE +/- 0.34, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.34, N = 3SE +/- 0.84, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.12, N = 3SE +/- 0.58, N = 3SE +/- 0.10, N = 5SE +/- 0.39, N = 3SE +/- 0.67, N = 3SE +/- 0.82, N = 310.0157.0596.68195.459.5055.2893.79190.039.3452.6988.81177.819.5652.8889.48178.89

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - SHA-512 Benchmark Time)100500100020003691215SE +/- 0.11, N = 4SE +/- 0.08, N = 3SE +/- 0.14, N = 3SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 4SE +/- 0.12, N = 9SE +/- 0.10, N = 5SE +/- 0.11, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 310.0111.2311.3812.969.5010.4311.1812.559.349.8910.7812.639.5610.4811.1412.88

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 1000000 - Partitions: 100)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time160320480640800SE +/- 0.113137090, N = 4SE +/- 9.681628257, N = 4SE +/- 0.122562063, N = 4SE +/- 0.023541873, N = 4SE +/- 0.025356347, N = 4SE +/- 0.134671456, N = 4SE +/- 0.085253143, N = 4SE +/- 0.038555282, N = 3SE +/- 1.768265132, N = 3SE +/- 0.257940983, N = 3SE +/- 0.129389851, N = 3SE +/- 0.084920457, N = 3SE +/- 0.004165140, N = 3SE +/- 0.102452612, N = 3SE +/- 0.093919752, N = 3SE +/- 1.541717417, N = 3SE +/- 0.039099097, N = 3SE +/- 0.130013375, N = 3SE +/- 0.070931558, N = 3SE +/- 0.294062371, N = 3SE +/- 0.076264083, N = 3SE +/- 0.101368246, N = 5SE +/- 0.461842438, N = 5SE +/- 0.089037280, N = 5SE +/- 0.081615689, N = 5SE +/- 0.034264151, N = 5SE +/- 0.044993077, N = 5SE +/- 0.069228259, N = 510.010000000727.52000000033.7600000009.0700000009.0800000006.5900000005.7200000009.500000000694.41000000032.1400000008.8100000008.7900000006.2500000005.6900000009.340000000581.45000000031.8400000008.7500000008.6200000006.5400000005.5000000009.560000000581.85221078531.6300000009.0900000008.7500000006.0400000005.450000000

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark)1000000100000002000000040000000160320480640800SE +/- 9.68, N = 4SE +/- 3.83, N = 3SE +/- 8.94, N = 3SE +/- 8.88, N = 3SE +/- 1.77, N = 3SE +/- 7.97, N = 3SE +/- 8.48, N = 3SE +/- 1.80, N = 3SE +/- 1.54, N = 3SE +/- 1.47, N = 3SE +/- 1.38, N = 3SE +/- 0.87, N = 3SE +/- 0.46, N = 5SE +/- 0.70, N = 3SE +/- 3.74, N = 3SE +/- 0.68, N = 3727.52722.90713.91724.99694.41681.48694.61694.62581.45581.85580.52579.98581.85580.29582.87581.19

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark)10050010002000160320480640800SE +/- 9.68, N = 4SE +/- 10.10, N = 3SE +/- 1.88, N = 3SE +/- 5.14, N = 3SE +/- 1.77, N = 3SE +/- 3.62, N = 3SE +/- 1.43, N = 3SE +/- 8.22, N = 3SE +/- 1.54, N = 3SE +/- 0.64, N = 3SE +/- 0.54, N = 4SE +/- 0.47, N = 9SE +/- 0.46, N = 5SE +/- 1.70, N = 3SE +/- 2.32, N = 3SE +/- 0.55, N = 3727.52733.90717.10733.77694.41685.12695.32690.63581.45580.99580.24580.68581.85579.16583.50582.61

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark Using Dataframe)1000000100000002000000040000000816243240SE +/- 0.12, N = 4SE +/- 0.10, N = 3SE +/- 0.32, N = 3SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.09, N = 3SE +/- 0.23, N = 3SE +/- 0.23, N = 3SE +/- 0.04, N = 3SE +/- 0.29, N = 3SE +/- 0.07, N = 3SE +/- 0.38, N = 3SE +/- 0.09, N = 5SE +/- 0.06, N = 3SE +/- 0.18, N = 3SE +/- 0.10, N = 333.7634.0233.7333.6332.1432.3532.2432.0831.8431.4931.8131.5731.6331.9731.6231.79

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark Using Dataframe)10050010002000816243240SE +/- 0.12, N = 4SE +/- 0.16, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.26, N = 3SE +/- 0.16, N = 3SE +/- 0.10, N = 3SE +/- 0.23, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 4SE +/- 0.09, N = 9SE +/- 0.09, N = 5SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.12, N = 333.7633.7633.3933.7932.1432.2732.3632.0331.8431.7931.8831.5631.6331.7231.5431.68

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Group By Test Time)100000010000000200000004000000020406080100SE +/- 0.02, N = 4SE +/- 0.30, N = 3SE +/- 0.45, N = 3SE +/- 0.13, N = 3SE +/- 0.25, N = 3SE +/- 0.32, N = 3SE +/- 2.29, N = 3SE +/- 0.13, N = 3SE +/- 3.06, N = 3SE +/- 0.73, N = 3SE +/- 0.08, N = 5SE +/- 0.24, N = 3SE +/- 0.47, N = 3SE +/- 3.33, N = 39.0725.0537.118.8123.5035.5187.328.7526.6234.669.0923.9034.4188.01

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Group By Test Time)100500100020003691215SE +/- 0.02, N = 4SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.15, N = 3SE +/- 0.13, N = 3SE +/- 0.19, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 4SE +/- 0.13, N = 9SE +/- 0.08, N = 5SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.23, N = 39.0710.1311.3913.028.819.9511.1012.868.759.8410.9312.839.0910.0311.1813.31

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Repartition Test Time)1000000100000002000000040000000306090120150SE +/- 0.03, N = 4SE +/- 0.56, N = 3SE +/- 0.55, N = 3SE +/- 0.08, N = 3SE +/- 0.18, N = 3SE +/- 0.33, N = 3SE +/- 1.31, N = 3SE +/- 0.07, N = 3SE +/- 0.76, N = 3SE +/- 2.01, N = 3SE +/- 0.03, N = 5SE +/- 0.43, N = 3SE +/- 0.15, N = 3SE +/- 0.42, N = 39.0841.2874.328.7938.2971.59137.288.6238.5872.358.7537.0768.12131.38

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Repartition Test Time)100500100020003691215SE +/- 0.03, N = 4SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.18, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 4SE +/- 0.04, N = 9SE +/- 0.03, N = 5SE +/- 0.07, N = 3SE +/- 0.18, N = 3SE +/- 0.16, N = 39.089.4610.0611.018.799.1010.0510.718.629.009.7410.578.759.219.9510.85

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Inner Join Test Time)1000000100000002000000040000000306090120150SE +/- 0.134671456, N = 4SE +/- 0.257232291, N = 3SE +/- 0.574015178, N = 3SE +/- 0.004165140, N = 3SE +/- 0.120293064, N = 3SE +/- 0.323667212, N = 3SE +/- 1.752337079, N = 3SE +/- 0.294062371, N = 3SE +/- 1.642152192, N = 3SE +/- 1.129567495, N = 3SE +/- 0.044993077, N = 5SE +/- 1.372283254, N = 3SE +/- 0.475686548, N = 3SE +/- 1.445788055, N = 36.59000000047.52000000083.9800000006.25000000043.58000000080.900000000157.8800000006.54000000043.88000000075.6800000006.04000000043.71000000076.870000000152.872557219

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Inner Join Test Time)100500100020003691215SE +/- 0.13, N = 4SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.00, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.29, N = 3SE +/- 0.52, N = 3SE +/- 0.63, N = 4SE +/- 0.50, N = 9SE +/- 0.04, N = 5SE +/- 0.04, N = 3SE +/- 0.11, N = 3SE +/- 0.40, N = 36.597.268.3310.696.257.018.0110.686.547.538.6311.066.047.037.8110.89

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Broadcast Inner Join Test Time)10000001000000020000000400000004080120160200SE +/- 0.09, N = 4SE +/- 0.25, N = 3SE +/- 0.19, N = 3SE +/- 0.10, N = 3SE +/- 0.71, N = 3SE +/- 0.43, N = 3SE +/- 2.32, N = 3SE +/- 0.08, N = 3SE +/- 0.62, N = 3SE +/- 0.59, N = 3SE +/- 0.07, N = 5SE +/- 0.21, N = 3SE +/- 0.55, N = 3SE +/- 0.60, N = 35.7247.1082.035.6944.2679.21159.015.5043.1973.605.4542.8574.60150.05

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Broadcast Inner Join Test Time)10050010002000246810SE +/- 0.09, N = 4SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.18, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.12, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 4SE +/- 0.13, N = 9SE +/- 0.07, N = 5SE +/- 0.49, N = 3SE +/- 0.06, N = 3SE +/- 0.27, N = 35.726.627.298.585.696.296.998.045.506.126.908.375.456.517.058.41

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - SHA-512 Benchmark Time)10000001000000020000000400000004080120160200SE +/- 0.075456756, N = 3SE +/- 0.109148903, N = 3SE +/- 0.307771793, N = 3SE +/- 0.260000987, N = 3SE +/- 0.073904401, N = 3SE +/- 0.088475323, N = 3SE +/- 0.105154004, N = 3SE +/- 0.553867494, N = 3SE +/- 0.026873455, N = 3SE +/- 0.112654588, N = 3SE +/- 0.160687224, N = 3SE +/- 0.477080995, N = 3SE +/- 0.114204323, N = 3SE +/- 0.195921788, N = 3SE +/- 0.331996595, N = 3SE +/- 1.561648800, N = 311.23000000052.62000000099.640000000189.39000000010.43000000050.73000000096.850000000183.2000000009.89000000047.87000000090.560000000172.06000000010.48000000048.84000000091.240000000172.690048331

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 1000000 - Partitions: 500)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time160320480640800SE +/- 0.075456756, N = 3SE +/- 10.096513371, N = 3SE +/- 0.158253119, N = 3SE +/- 0.085288962, N = 3SE +/- 0.037643391, N = 3SE +/- 0.056766652, N = 3SE +/- 0.094366471, N = 3SE +/- 0.073904401, N = 3SE +/- 3.616590948, N = 3SE +/- 0.155432056, N = 3SE +/- 0.188967987, N = 3SE +/- 0.076523207, N = 3SE +/- 0.103943425, N = 3SE +/- 0.103211248, N = 3SE +/- 0.026873455, N = 3SE +/- 0.635610275, N = 3SE +/- 0.017302603, N = 3SE +/- 0.152630685, N = 3SE +/- 0.101989022, N = 3SE +/- 0.517942458, N = 3SE +/- 0.063047733, N = 3SE +/- 0.114204323, N = 3SE +/- 1.696546131, N = 3SE +/- 0.016927629, N = 3SE +/- 0.086808001, N = 3SE +/- 0.069154351, N = 3SE +/- 0.043852959, N = 3SE +/- 0.486110869, N = 311.230000000733.90000000033.76000000010.1300000009.4600000007.2600000006.62000000010.430000000685.12000000032.2700000009.9500000009.1000000007.0100000006.2900000009.890000000580.99000000031.7900000009.8400000009.0000000007.5300000006.12000000010.480000000579.16066724031.72000000010.0300000009.2100000007.0300000006.510000000

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark)1000000100000002000000040000000160320480640800SE +/- 10.10, N = 3SE +/- 3.66, N = 3SE +/- 17.41, N = 3SE +/- 6.99, N = 3SE +/- 3.62, N = 3SE +/- 3.78, N = 3SE +/- 4.56, N = 3SE +/- 4.60, N = 3SE +/- 0.64, N = 3SE +/- 1.02, N = 3SE +/- 0.79, N = 3SE +/- 0.86, N = 3SE +/- 1.70, N = 3SE +/- 0.62, N = 3SE +/- 0.67, N = 3SE +/- 0.55, N = 3733.90692.06714.05728.26685.12684.23683.57690.62580.99579.55581.12580.30579.16581.78583.11579.01

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark Using Dataframe)1000000100000002000000040000000816243240SE +/- 0.16, N = 3SE +/- 0.13, N = 3SE +/- 0.25, N = 3SE +/- 0.10, N = 3SE +/- 0.16, N = 3SE +/- 0.05, N = 3SE +/- 0.22, N = 3SE +/- 0.36, N = 3SE +/- 0.02, N = 3SE +/- 0.11, N = 3SE +/- 0.15, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.09, N = 333.7633.8933.7233.7732.2732.1731.8431.9631.7931.7931.7631.5131.7231.8131.7431.71

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Group By Test Time)100000010000000200000004000000020406080100SE +/- 0.09, N = 3SE +/- 0.42, N = 3SE +/- 0.10, N = 3SE +/- 0.19, N = 3SE +/- 0.51, N = 3SE +/- 0.72, N = 3SE +/- 4.05, N = 3SE +/- 0.15, N = 3SE +/- 1.78, N = 3SE +/- 4.59, N = 3SE +/- 0.09, N = 3SE +/- 0.17, N = 3SE +/- 0.13, N = 3SE +/- 1.17, N = 310.1323.2837.009.9522.3736.3789.239.8423.8239.2610.0322.3835.9982.35

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Repartition Test Time)1000000100000002000000040000000306090120150SE +/- 0.037643391, N = 3SE +/- 0.579061882, N = 3SE +/- 0.150029474, N = 3SE +/- 0.076523207, N = 3SE +/- 0.263873750, N = 3SE +/- 0.119615928, N = 3SE +/- 0.575990239, N = 3SE +/- 0.101989022, N = 3SE +/- 1.074726167, N = 3SE +/- 0.840434214, N = 3SE +/- 0.069154351, N = 3SE +/- 0.254871419, N = 3SE +/- 0.310887433, N = 3SE +/- 0.835252655, N = 39.46000000040.16000000073.2200000009.10000000038.21000000071.300000000138.0400000009.00000000038.92000000070.9000000009.21000000036.44000000067.860000000131.531132677

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Inner Join Test Time)1000000100000002000000040000000306090120150SE +/- 0.056766652, N = 3SE +/- 0.422261678, N = 3SE +/- 0.562607380, N = 3SE +/- 0.103943425, N = 3SE +/- 0.391685283, N = 3SE +/- 0.747944666, N = 3SE +/- 0.391834664, N = 3SE +/- 0.517942458, N = 3SE +/- 0.798930107, N = 3SE +/- 0.488163973, N = 3SE +/- 0.043852959, N = 3SE +/- 0.324188438, N = 3SE +/- 0.097366593, N = 3SE +/- 1.021947894, N = 37.26000000044.68000000083.8400000007.01000000042.54000000080.990000000158.1100000007.53000000042.43000000078.0300000007.03000000040.24000000077.630000000152.207485397

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Broadcast Inner Join Test Time)1000000100000002000000040000000306090120150SE +/- 0.094366471, N = 3SE +/- 0.236866720, N = 3SE +/- 0.300364443, N = 3SE +/- 0.103211248, N = 3SE +/- 0.236232308, N = 3SE +/- 0.489603948, N = 3SE +/- 0.852271154, N = 3SE +/- 0.063047733, N = 3SE +/- 0.416062930, N = 3SE +/- 0.043071403, N = 3SE +/- 0.486110869, N = 3SE +/- 0.448087864, N = 3SE +/- 0.730826056, N = 3SE +/- 0.764058299, N = 36.62000000042.68000000083.5300000006.29000000040.95000000080.770000000157.0800000006.12000000039.16000000075.2300000006.51000000038.35000000076.270000000147.548531194

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - SHA-512 Benchmark Time)10000001000000020000000400000004080120160200SE +/- 0.14, N = 3SE +/- 0.22, N = 3SE +/- 0.20, N = 3SE +/- 0.54, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.20, N = 3SE +/- 0.13, N = 3SE +/- 0.12, N = 4SE +/- 0.15, N = 3SE +/- 0.29, N = 3SE +/- 0.77, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.48, N = 311.3853.52100.73189.7311.1851.6495.92183.3510.7849.2191.39172.4511.1449.4592.42172.19

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 1000000 - Partitions: 1000)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time150300450600750SE +/- 0.14, N = 3SE +/- 1.88, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 1.43, N = 3SE +/- 0.10, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 4SE +/- 0.54, N = 4SE +/- 0.05, N = 4SE +/- 0.08, N = 4SE +/- 0.07, N = 4SE +/- 0.63, N = 4SE +/- 0.06, N = 4SE +/- 0.01, N = 3SE +/- 2.32, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.18, N = 3SE +/- 0.11, N = 3SE +/- 0.06, N = 311.38717.1033.3911.3910.068.337.2911.18695.3232.3611.1010.058.016.9910.78580.2431.8810.939.748.636.9011.14583.5031.5411.189.957.817.05

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark)1000000100000002000000040000000160320480640800SE +/- 1.88, N = 3SE +/- 5.58, N = 3SE +/- 11.19, N = 3SE +/- 14.94, N = 3SE +/- 1.43, N = 3SE +/- 4.78, N = 3SE +/- 2.66, N = 3SE +/- 6.51, N = 3SE +/- 0.54, N = 4SE +/- 1.40, N = 3SE +/- 0.66, N = 3SE +/- 0.56, N = 3SE +/- 2.32, N = 3SE +/- 0.29, N = 3SE +/- 1.10, N = 3SE +/- 1.66, N = 3717.10722.36722.93721.00695.32690.24687.06697.90580.24580.37579.19581.69583.50580.46580.24581.60

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark Using Dataframe)1000000100000002000000040000000816243240SE +/- 0.08, N = 3SE +/- 0.18, N = 3SE +/- 0.19, N = 3SE +/- 0.22, N = 3SE +/- 0.10, N = 3SE +/- 0.32, N = 3SE +/- 0.15, N = 3SE +/- 0.16, N = 3SE +/- 0.05, N = 4SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.16, N = 3SE +/- 0.08, N = 3SE +/- 0.26, N = 3SE +/- 0.32, N = 3SE +/- 0.10, N = 333.3934.0033.8133.5132.3632.2432.0532.4031.8831.6631.7531.5431.5431.3631.2231.61

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Group By Test Time)100000010000000200000004000000020406080100SE +/- 0.03, N = 3SE +/- 0.35, N = 3SE +/- 0.79, N = 3SE +/- 0.02, N = 3SE +/- 0.28, N = 3SE +/- 0.15, N = 3SE +/- 2.33, N = 3SE +/- 0.08, N = 4SE +/- 0.36, N = 3SE +/- 2.03, N = 3SE +/- 0.09, N = 3SE +/- 0.20, N = 3SE +/- 0.44, N = 3SE +/- 0.85, N = 311.3923.8937.3111.1022.2935.2788.0210.9322.4435.8311.1822.6234.7079.60

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Repartition Test Time)1000000100000002000000040000000306090120150SE +/- 0.02, N = 3SE +/- 0.23, N = 3SE +/- 0.23, N = 3SE +/- 0.07, N = 3SE +/- 0.22, N = 3SE +/- 0.23, N = 3SE +/- 0.83, N = 3SE +/- 0.07, N = 4SE +/- 0.54, N = 3SE +/- 1.03, N = 3SE +/- 0.18, N = 3SE +/- 0.31, N = 3SE +/- 0.20, N = 3SE +/- 0.93, N = 310.0639.9675.1810.0538.6171.70138.879.7439.3172.989.9536.7268.54131.43

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Inner Join Test Time)10000001000000020000000400000004080120160200SE +/- 0.105150363, N = 3SE +/- 0.399790551, N = 3SE +/- 0.315382741, N = 3SE +/- 0.035374915, N = 3SE +/- 0.136942862, N = 3SE +/- 0.420756743, N = 3SE +/- 1.923212084, N = 3SE +/- 0.633875719, N = 4SE +/- 0.557375853, N = 3SE +/- 0.855084002, N = 3SE +/- 0.108422107, N = 3SE +/- 0.211182878, N = 3SE +/- 0.524371080, N = 3SE +/- 1.834767926, N = 38.33000000045.60000000085.1200000008.01000000044.00000000081.350000000162.0100000008.63000000043.30000000078.4200000007.81000000041.49000000079.290000000151.543861997

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Broadcast Inner Join Test Time)1000000100000002000000040000000306090120150SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.51, N = 3SE +/- 0.12, N = 3SE +/- 0.16, N = 3SE +/- 0.09, N = 3SE +/- 0.25, N = 3SE +/- 0.06, N = 4SE +/- 1.25, N = 3SE +/- 0.83, N = 3SE +/- 0.06, N = 3SE +/- 0.36, N = 3SE +/- 0.20, N = 3SE +/- 1.46, N = 37.2943.4784.016.9941.9880.64158.246.9040.9075.967.0539.2276.66147.55

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - SHA-512 Benchmark Time)10000001000000020000000400000004080120160200SE +/- 0.14, N = 3SE +/- 0.39, N = 3SE +/- 0.14, N = 3SE +/- 0.40, N = 3SE +/- 0.11, N = 3SE +/- 0.34, N = 3SE +/- 0.37, N = 3SE +/- 0.21, N = 3SE +/- 0.12, N = 9SE +/- 0.36, N = 3SE +/- 0.02, N = 3SE +/- 0.42, N = 3SE +/- 0.11, N = 3SE +/- 0.24, N = 3SE +/- 0.11, N = 3SE +/- 0.47, N = 312.9655.17101.15192.8112.5553.0497.65185.5112.6350.8091.96175.8412.8851.0992.19175.24

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 1000000 - Partitions: 2000)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time160320480640800SE +/- 0.139768323, N = 3SE +/- 5.138863712, N = 3SE +/- 0.013599313, N = 3SE +/- 0.146972816, N = 3SE +/- 0.181687585, N = 3SE +/- 0.098619535, N = 3SE +/- 0.177939327, N = 3SE +/- 0.112867497, N = 3SE +/- 8.221686317, N = 3SE +/- 0.230080533, N = 3SE +/- 0.090717982, N = 3SE +/- 0.042552140, N = 3SE +/- 0.094249006, N = 3SE +/- 0.011049874, N = 3SE +/- 0.121232499, N = 9SE +/- 0.468273880, N = 9SE +/- 0.090240232, N = 9SE +/- 0.134671941, N = 9SE +/- 0.039688685, N = 9SE +/- 0.501143304, N = 9SE +/- 0.128969955, N = 9SE +/- 0.113414449, N = 3SE +/- 0.548006604, N = 3SE +/- 0.123827132, N = 3SE +/- 0.230601906, N = 3SE +/- 0.155773144, N = 3SE +/- 0.401879123, N = 3SE +/- 0.269877699, N = 312.960000000733.77000000033.79000000013.02000000011.01000000010.6900000008.58000000012.550000000690.63000000032.03000000012.86000000010.71000000010.6800000008.04000000012.630000000580.68000000031.56000000012.83000000010.57000000011.0600000008.37000000012.880000000582.61489470731.68000000013.31000000010.85000000010.8900000008.410000000

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark)1000000100000002000000040000000160320480640800SE +/- 5.14, N = 3SE +/- 13.31, N = 3SE +/- 22.40, N = 3SE +/- 16.56, N = 3SE +/- 8.22, N = 3SE +/- 6.18, N = 3SE +/- 2.10, N = 3SE +/- 8.50, N = 3SE +/- 0.47, N = 9SE +/- 0.41, N = 3SE +/- 1.08, N = 3SE +/- 0.49, N = 3SE +/- 0.55, N = 3SE +/- 0.51, N = 3SE +/- 0.28, N = 3SE +/- 1.28, N = 3733.77711.60723.32710.71690.63699.96681.91695.17580.68581.17579.87580.86582.61577.92581.10579.55

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark Using Dataframe)1000000100000002000000040000000816243240SE +/- 0.01, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 3SE +/- 0.06, N = 3SE +/- 0.23, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.31, N = 3SE +/- 0.09, N = 9SE +/- 0.14, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.15, N = 3SE +/- 0.14, N = 333.7933.9633.9133.7932.0331.9232.2132.2031.5631.6631.6131.6531.6831.5831.6631.32

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Group By Test Time)100000010000000200000004000000020406080100SE +/- 0.15, N = 3SE +/- 0.28, N = 3SE +/- 0.10, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.46, N = 3SE +/- 4.77, N = 3SE +/- 0.13, N = 9SE +/- 0.22, N = 3SE +/- 0.23, N = 3SE +/- 0.39, N = 3SE +/- 0.41, N = 3SE +/- 3.36, N = 313.0224.8537.3512.8624.0936.7283.8712.8324.1013.3124.1337.1681.61

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Repartition Test Time)1000000100000002000000040000000306090120150SE +/- 0.18, N = 3SE +/- 0.03, N = 3SE +/- 0.46, N = 3SE +/- 0.04, N = 3SE +/- 0.21, N = 3SE +/- 0.20, N = 3SE +/- 0.91, N = 3SE +/- 0.04, N = 9SE +/- 0.66, N = 3SE +/- 0.16, N = 3SE +/- 0.08, N = 3SE +/- 0.14, N = 3SE +/- 0.77, N = 311.0140.5075.4410.7139.2272.28137.4510.5739.3310.8537.9469.09131.39

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Inner Join Test Time)10000001000000020000000400000004080120160200SE +/- 0.10, N = 3SE +/- 0.21, N = 3SE +/- 0.28, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.31, N = 3SE +/- 1.46, N = 3SE +/- 0.50, N = 9SE +/- 1.45, N = 3SE +/- 0.40, N = 3SE +/- 0.15, N = 3SE +/- 0.05, N = 3SE +/- 1.01, N = 310.6947.6786.4310.6845.7483.64159.1211.0647.6110.8944.2380.41151.60

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Broadcast Inner Join Test Time)1000000100000002000000040000000306090120150SE +/- 0.18, N = 3SE +/- 0.27, N = 3SE +/- 0.57, N = 3SE +/- 0.01, N = 3SE +/- 0.28, N = 3SE +/- 0.08, N = 3SE +/- 1.89, N = 3SE +/- 0.13, N = 9SE +/- 0.24, N = 3SE +/- 0.27, N = 3SE +/- 0.13, N = 3SE +/- 0.89, N = 3SE +/- 0.50, N = 38.5844.5983.948.0442.9081.25157.258.3740.938.4141.1677.56148.66

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - SHA-512 Benchmark Time)100500100020001326395265SE +/- 0.32, N = 3SE +/- 0.11, N = 3SE +/- 0.22, N = 3SE +/- 0.39, N = 3SE +/- 0.14, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.34, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 3SE +/- 0.15, N = 3SE +/- 0.36, N = 3SE +/- 0.39, N = 3SE +/- 0.20, N = 3SE +/- 0.05, N = 3SE +/- 0.24, N = 357.0552.6253.5255.1755.2850.7351.6453.0452.6947.8749.2150.8052.8848.8449.4551.09

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 10000000 - Partitions: 100)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time160320480640800SE +/- 0.32, N = 3SE +/- 3.83, N = 3SE +/- 0.10, N = 3SE +/- 0.30, N = 3SE +/- 0.56, N = 3SE +/- 0.26, N = 3SE +/- 0.25, N = 3SE +/- 0.14, N = 3SE +/- 7.97, N = 3SE +/- 0.09, N = 3SE +/- 0.25, N = 3SE +/- 0.18, N = 3SE +/- 0.12, N = 3SE +/- 0.71, N = 3SE +/- 0.05, N = 3SE +/- 1.47, N = 3SE +/- 0.29, N = 3SE +/- 3.06, N = 3SE +/- 0.76, N = 3SE +/- 1.64, N = 3SE +/- 0.62, N = 3SE +/- 0.39, N = 3SE +/- 0.70, N = 3SE +/- 0.06, N = 3SE +/- 0.24, N = 3SE +/- 0.43, N = 3SE +/- 1.37, N = 3SE +/- 0.21, N = 357.05722.9034.0225.0541.2847.5247.1055.28681.4832.3523.5038.2943.5844.2652.69581.8531.4926.6238.5843.8843.1952.88580.2931.9723.9037.0743.7142.85

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark)10050010002000160320480640800SE +/- 3.83, N = 3SE +/- 3.66, N = 3SE +/- 5.58, N = 3SE +/- 13.31, N = 3SE +/- 7.97, N = 3SE +/- 3.78, N = 3SE +/- 4.78, N = 3SE +/- 6.18, N = 3SE +/- 1.47, N = 3SE +/- 1.02, N = 3SE +/- 1.40, N = 3SE +/- 0.41, N = 3SE +/- 0.70, N = 3SE +/- 0.62, N = 3SE +/- 0.29, N = 3SE +/- 0.51, N = 3722.90692.06722.36711.60681.48684.23690.24699.96581.85579.55580.37581.17580.29581.78580.46577.92

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark Using Dataframe)10050010002000816243240SE +/- 0.10, N = 3SE +/- 0.13, N = 3SE +/- 0.18, N = 3SE +/- 0.14, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.32, N = 3SE +/- 0.06, N = 3SE +/- 0.29, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.04, N = 334.0233.8934.0033.9632.3532.1732.2431.9231.4931.7931.6631.6631.9731.8131.3631.58

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Group By Test Time)10050010002000612182430SE +/- 0.30, N = 3SE +/- 0.42, N = 3SE +/- 0.35, N = 3SE +/- 0.28, N = 3SE +/- 0.25, N = 3SE +/- 0.51, N = 3SE +/- 0.28, N = 3SE +/- 0.13, N = 3SE +/- 3.06, N = 3SE +/- 1.78, N = 3SE +/- 0.36, N = 3SE +/- 0.22, N = 3SE +/- 0.24, N = 3SE +/- 0.17, N = 3SE +/- 0.20, N = 3SE +/- 0.39, N = 325.0523.2823.8924.8523.5022.3722.2924.0926.6223.8222.4424.1023.9022.3822.6224.13

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Repartition Test Time)10050010002000918273645SE +/- 0.56, N = 3SE +/- 0.58, N = 3SE +/- 0.23, N = 3SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.26, N = 3SE +/- 0.22, N = 3SE +/- 0.21, N = 3SE +/- 0.76, N = 3SE +/- 1.07, N = 3SE +/- 0.54, N = 3SE +/- 0.66, N = 3SE +/- 0.43, N = 3SE +/- 0.25, N = 3SE +/- 0.31, N = 3SE +/- 0.08, N = 341.2840.1639.9640.5038.2938.2138.6139.2238.5838.9239.3139.3337.0736.4436.7237.94

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Inner Join Test Time)100500100020001122334455SE +/- 0.26, N = 3SE +/- 0.42, N = 3SE +/- 0.40, N = 3SE +/- 0.21, N = 3SE +/- 0.12, N = 3SE +/- 0.39, N = 3SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 1.64, N = 3SE +/- 0.80, N = 3SE +/- 0.56, N = 3SE +/- 1.45, N = 3SE +/- 1.37, N = 3SE +/- 0.32, N = 3SE +/- 0.21, N = 3SE +/- 0.15, N = 347.5244.6845.6047.6743.5842.5444.0045.7443.8842.4343.3047.6143.7140.2441.4944.23

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Broadcast Inner Join Test Time)100500100020001122334455SE +/- 0.25, N = 3SE +/- 0.24, N = 3SE +/- 0.09, N = 3SE +/- 0.27, N = 3SE +/- 0.71, N = 3SE +/- 0.24, N = 3SE +/- 0.16, N = 3SE +/- 0.28, N = 3SE +/- 0.62, N = 3SE +/- 0.42, N = 3SE +/- 1.25, N = 3SE +/- 0.24, N = 3SE +/- 0.21, N = 3SE +/- 0.45, N = 3SE +/- 0.36, N = 3SE +/- 0.13, N = 347.1042.6843.4744.5944.2640.9541.9842.9043.1939.1640.9040.9342.8538.3539.2241.16

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 10000000 - Partitions: 500)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time150300450600750SE +/- 0.11, N = 3SE +/- 3.66, N = 3SE +/- 0.13, N = 3SE +/- 0.42, N = 3SE +/- 0.58, N = 3SE +/- 0.42, N = 3SE +/- 0.24, N = 3SE +/- 0.09, N = 3SE +/- 3.78, N = 3SE +/- 0.05, N = 3SE +/- 0.51, N = 3SE +/- 0.26, N = 3SE +/- 0.39, N = 3SE +/- 0.24, N = 3SE +/- 0.11, N = 3SE +/- 1.02, N = 3SE +/- 0.11, N = 3SE +/- 1.78, N = 3SE +/- 1.07, N = 3SE +/- 0.80, N = 3SE +/- 0.42, N = 3SE +/- 0.20, N = 3SE +/- 0.62, N = 3SE +/- 0.05, N = 3SE +/- 0.17, N = 3SE +/- 0.25, N = 3SE +/- 0.32, N = 3SE +/- 0.45, N = 352.62692.0633.8923.2840.1644.6842.6850.73684.2332.1722.3738.2142.5440.9547.87579.5531.7923.8238.9242.4339.1648.84581.7831.8122.3836.4440.2438.35

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - SHA-512 Benchmark Time)1005001000200020406080100SE +/- 0.22, N = 3SE +/- 0.31, N = 3SE +/- 0.20, N = 3SE +/- 0.14, N = 3SE +/- 0.34, N = 3SE +/- 0.11, N = 3SE +/- 0.20, N = 3SE +/- 0.37, N = 3SE +/- 0.12, N = 3SE +/- 0.16, N = 3SE +/- 0.29, N = 3SE +/- 0.02, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 396.6899.64100.73101.1593.7996.8595.9297.6588.8190.5691.3991.9689.4891.2492.4292.19

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 20000000 - Partitions: 100)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time150300450600750SE +/- 0.22, N = 3SE +/- 8.94, N = 3SE +/- 0.32, N = 3SE +/- 0.45, N = 3SE +/- 0.55, N = 3SE +/- 0.57, N = 3SE +/- 0.19, N = 3SE +/- 0.34, N = 3SE +/- 8.48, N = 3SE +/- 0.23, N = 3SE +/- 0.32, N = 3SE +/- 0.33, N = 3SE +/- 0.32, N = 3SE +/- 0.43, N = 3SE +/- 0.12, N = 3SE +/- 1.38, N = 3SE +/- 0.07, N = 3SE +/- 0.73, N = 3SE +/- 2.01, N = 3SE +/- 1.13, N = 3SE +/- 0.59, N = 3SE +/- 0.67, N = 3SE +/- 3.74, N = 3SE +/- 0.18, N = 3SE +/- 0.47, N = 3SE +/- 0.15, N = 3SE +/- 0.48, N = 3SE +/- 0.55, N = 396.68713.9133.7337.1174.3283.9882.0393.79694.6132.2435.5171.5980.9079.2188.81580.5231.8134.6672.3575.6873.6089.48582.8731.6234.4168.1276.8774.60

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark)10050010002000160320480640800SE +/- 8.94, N = 3SE +/- 17.41, N = 3SE +/- 11.19, N = 3SE +/- 22.40, N = 3SE +/- 8.48, N = 3SE +/- 4.56, N = 3SE +/- 2.66, N = 3SE +/- 2.10, N = 3SE +/- 1.38, N = 3SE +/- 0.79, N = 3SE +/- 0.66, N = 3SE +/- 1.08, N = 3SE +/- 3.74, N = 3SE +/- 0.67, N = 3SE +/- 1.10, N = 3SE +/- 0.28, N = 3713.91714.05722.93723.32694.61683.57687.06681.91580.52581.12579.19579.87582.87583.11580.24581.10

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark Using Dataframe)10050010002000816243240SE +/- 0.32, N = 3SE +/- 0.25, N = 3SE +/- 0.19, N = 3SE +/- 0.11, N = 3SE +/- 0.23, N = 3SE +/- 0.22, N = 3SE +/- 0.15, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.15, N = 3SE +/- 0.14, N = 3SE +/- 0.10, N = 3SE +/- 0.18, N = 3SE +/- 0.10, N = 3SE +/- 0.32, N = 3SE +/- 0.15, N = 333.7333.7233.8133.9132.2431.8432.0532.2131.8131.7631.7531.6131.6231.7431.2231.66

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Group By Test Time)10050010002000918273645SE +/- 0.45, N = 3SE +/- 0.10, N = 3SE +/- 0.79, N = 3SE +/- 0.10, N = 3SE +/- 0.32, N = 3SE +/- 0.72, N = 3SE +/- 0.15, N = 3SE +/- 0.46, N = 3SE +/- 0.73, N = 3SE +/- 4.59, N = 3SE +/- 2.03, N = 3SE +/- 0.47, N = 3SE +/- 0.13, N = 3SE +/- 0.44, N = 3SE +/- 0.41, N = 337.1137.0037.3137.3535.5136.3735.2736.7234.6639.2635.8334.4135.9934.7037.16

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Repartition Test Time)1005001000200020406080100SE +/- 0.55, N = 3SE +/- 0.15, N = 3SE +/- 0.23, N = 3SE +/- 0.46, N = 3SE +/- 0.33, N = 3SE +/- 0.12, N = 3SE +/- 0.23, N = 3SE +/- 0.20, N = 3SE +/- 2.01, N = 3SE +/- 0.84, N = 3SE +/- 1.03, N = 3SE +/- 0.15, N = 3SE +/- 0.31, N = 3SE +/- 0.20, N = 3SE +/- 0.14, N = 374.3273.2275.1875.4471.5971.3071.7072.2872.3570.9072.9868.1267.8668.5469.09

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Inner Join Test Time)1005001000200020406080100SE +/- 0.57, N = 3SE +/- 0.56, N = 3SE +/- 0.32, N = 3SE +/- 0.28, N = 3SE +/- 0.32, N = 3SE +/- 0.75, N = 3SE +/- 0.42, N = 3SE +/- 0.31, N = 3SE +/- 1.13, N = 3SE +/- 0.49, N = 3SE +/- 0.86, N = 3SE +/- 0.48, N = 3SE +/- 0.10, N = 3SE +/- 0.52, N = 3SE +/- 0.05, N = 383.9883.8485.1286.4380.9080.9981.3583.6475.6878.0378.4276.8777.6379.2980.41

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Broadcast Inner Join Test Time)1005001000200020406080100SE +/- 0.19, N = 3SE +/- 0.30, N = 3SE +/- 0.51, N = 3SE +/- 0.57, N = 3SE +/- 0.43, N = 3SE +/- 0.49, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.59, N = 3SE +/- 0.04, N = 3SE +/- 0.83, N = 3SE +/- 0.55, N = 3SE +/- 0.73, N = 3SE +/- 0.20, N = 3SE +/- 0.89, N = 382.0383.5384.0183.9479.2180.7780.6481.2573.6075.2375.9674.6076.2776.6677.56

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 20000000 - Partitions: 500)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time150300450600750SE +/- 0.31, N = 3SE +/- 17.41, N = 3SE +/- 0.25, N = 3SE +/- 0.10, N = 3SE +/- 0.15, N = 3SE +/- 0.56, N = 3SE +/- 0.30, N = 3SE +/- 0.11, N = 3SE +/- 4.56, N = 3SE +/- 0.22, N = 3SE +/- 0.72, N = 3SE +/- 0.12, N = 3SE +/- 0.75, N = 3SE +/- 0.49, N = 3SE +/- 0.16, N = 3SE +/- 0.79, N = 3SE +/- 0.15, N = 3SE +/- 4.59, N = 3SE +/- 0.84, N = 3SE +/- 0.49, N = 3SE +/- 0.04, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.10, N = 3SE +/- 0.13, N = 3SE +/- 0.31, N = 3SE +/- 0.10, N = 3SE +/- 0.73, N = 399.64714.0533.7237.0073.2283.8483.5396.85683.5731.8436.3771.3080.9980.7790.56581.1231.7639.2670.9078.0375.2391.24583.1131.7435.9967.8677.6376.27

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - SHA-512 Benchmark Time)100500100020004080120160200SE +/- 0.34, N = 3SE +/- 0.26, N = 3SE +/- 0.54, N = 3SE +/- 0.40, N = 3SE +/- 0.84, N = 3SE +/- 0.55, N = 3SE +/- 0.13, N = 3SE +/- 0.21, N = 3SE +/- 0.58, N = 3SE +/- 0.48, N = 3SE +/- 0.77, N = 3SE +/- 0.42, N = 3SE +/- 0.82, N = 3SE +/- 1.56, N = 3SE +/- 0.48, N = 3SE +/- 0.47, N = 3195.45189.39189.73192.81190.03183.20183.35185.51177.81172.06172.45175.84178.89172.69172.19175.24

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 40000000 - Partitions: 100)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time160320480640800SE +/- 0.34, N = 3SE +/- 8.88, N = 3SE +/- 0.05, N = 3SE +/- 0.84, N = 3SE +/- 1.80, N = 3SE +/- 0.23, N = 3SE +/- 2.29, N = 3SE +/- 1.31, N = 3SE +/- 1.75, N = 3SE +/- 2.32, N = 3SE +/- 0.58, N = 3SE +/- 0.87, N = 3SE +/- 0.38, N = 3SE +/- 0.82, N = 3SE +/- 0.68, N = 3SE +/- 0.10, N = 3SE +/- 3.33, N = 3SE +/- 0.42, N = 3SE +/- 1.45, N = 3SE +/- 0.60, N = 3195.45724.9933.63190.03694.6232.0887.32137.28157.88159.01177.81579.9831.57178.89581.1931.7988.01131.38152.87150.05

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark)10050010002000160320480640800SE +/- 8.88, N = 3SE +/- 6.99, N = 3SE +/- 14.94, N = 3SE +/- 16.56, N = 3SE +/- 1.80, N = 3SE +/- 4.60, N = 3SE +/- 6.51, N = 3SE +/- 8.50, N = 3SE +/- 0.87, N = 3SE +/- 0.86, N = 3SE +/- 0.56, N = 3SE +/- 0.49, N = 3SE +/- 0.68, N = 3SE +/- 0.55, N = 3SE +/- 1.66, N = 3SE +/- 1.28, N = 3724.99728.26721.00710.71694.62690.62697.90695.17579.98580.30581.69580.86581.19579.01581.60579.55

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark Using Dataframe)10050010002000816243240SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.22, N = 3SE +/- 0.06, N = 3SE +/- 0.23, N = 3SE +/- 0.36, N = 3SE +/- 0.16, N = 3SE +/- 0.31, N = 3SE +/- 0.38, N = 3SE +/- 0.11, N = 3SE +/- 0.16, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.14, N = 333.6333.7733.5133.7932.0831.9632.4032.2031.5731.5131.5431.6531.7931.7131.6131.32

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 40000000 - Partitions: 500)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time160320480640800SE +/- 0.26, N = 3SE +/- 6.99, N = 3SE +/- 0.10, N = 3SE +/- 0.55, N = 3SE +/- 4.60, N = 3SE +/- 0.36, N = 3SE +/- 4.05, N = 3SE +/- 0.58, N = 3SE +/- 0.39, N = 3SE +/- 0.85, N = 3SE +/- 0.48, N = 3SE +/- 0.86, N = 3SE +/- 0.11, N = 3SE +/- 1.56, N = 3SE +/- 0.55, N = 3SE +/- 0.09, N = 3SE +/- 1.17, N = 3SE +/- 0.84, N = 3SE +/- 1.02, N = 3SE +/- 0.76, N = 3189.39728.2633.77183.20690.6231.9689.23138.04158.11157.08172.06580.3031.51172.69579.0131.7182.35131.53152.21147.55

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 10000000 - Partitions: 1000)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time160320480640800SE +/- 0.22, N = 3SE +/- 5.58, N = 3SE +/- 0.18, N = 3SE +/- 0.35, N = 3SE +/- 0.23, N = 3SE +/- 0.40, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 4.78, N = 3SE +/- 0.32, N = 3SE +/- 0.28, N = 3SE +/- 0.22, N = 3SE +/- 0.14, N = 3SE +/- 0.16, N = 3SE +/- 0.15, N = 3SE +/- 1.40, N = 3SE +/- 0.04, N = 3SE +/- 0.36, N = 3SE +/- 0.54, N = 3SE +/- 0.56, N = 3SE +/- 1.25, N = 3SE +/- 0.05, N = 3SE +/- 0.29, N = 3SE +/- 0.26, N = 3SE +/- 0.20, N = 3SE +/- 0.31, N = 3SE +/- 0.21, N = 3SE +/- 0.36, N = 353.52722.3634.0023.8939.9645.6043.4751.64690.2432.2422.2938.6144.0041.9849.21580.3731.6622.4439.3143.3040.9049.45580.4631.3622.6236.7241.4939.22

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 10000000 - Partitions: 2000)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time150300450600750SE +/- 0.39, N = 3SE +/- 13.31, N = 3SE +/- 0.14, N = 3SE +/- 0.28, N = 3SE +/- 0.03, N = 3SE +/- 0.21, N = 3SE +/- 0.27, N = 3SE +/- 0.34, N = 3SE +/- 6.18, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.21, N = 3SE +/- 0.04, N = 3SE +/- 0.28, N = 3SE +/- 0.36, N = 3SE +/- 0.41, N = 3SE +/- 0.14, N = 3SE +/- 0.22, N = 3SE +/- 0.66, N = 3SE +/- 1.45, N = 3SE +/- 0.24, N = 3SE +/- 0.24, N = 3SE +/- 0.51, N = 3SE +/- 0.04, N = 3SE +/- 0.39, N = 3SE +/- 0.08, N = 3SE +/- 0.15, N = 3SE +/- 0.13, N = 355.17711.6033.9624.8540.5047.6744.5953.04699.9631.9224.0939.2245.7442.9050.80581.1731.6624.1039.3347.6140.9351.09577.9231.5824.1337.9444.2341.16

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 20000000 - Partitions: 1000)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time160320480640800SE +/- 0.20, N = 3SE +/- 11.19, N = 3SE +/- 0.19, N = 3SE +/- 0.79, N = 3SE +/- 0.23, N = 3SE +/- 0.32, N = 3SE +/- 0.51, N = 3SE +/- 0.20, N = 3SE +/- 2.66, N = 3SE +/- 0.15, N = 3SE +/- 0.15, N = 3SE +/- 0.23, N = 3SE +/- 0.42, N = 3SE +/- 0.09, N = 3SE +/- 0.29, N = 3SE +/- 0.66, N = 3SE +/- 0.14, N = 3SE +/- 2.03, N = 3SE +/- 1.03, N = 3SE +/- 0.86, N = 3SE +/- 0.83, N = 3SE +/- 0.10, N = 3SE +/- 1.10, N = 3SE +/- 0.32, N = 3SE +/- 0.44, N = 3SE +/- 0.20, N = 3SE +/- 0.52, N = 3SE +/- 0.20, N = 3100.73722.9333.8137.3175.1885.1284.0195.92687.0632.0535.2771.7081.3580.6491.39579.1931.7535.8372.9878.4275.9692.42580.2431.2234.7068.5479.2976.66

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 20000000 - Partitions: 2000)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time160320480640800SE +/- 0.14, N = 3SE +/- 22.40, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.46, N = 3SE +/- 0.28, N = 3SE +/- 0.57, N = 3SE +/- 0.37, N = 3SE +/- 2.10, N = 3SE +/- 0.09, N = 3SE +/- 0.46, N = 3SE +/- 0.20, N = 3SE +/- 0.31, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 1.08, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.28, N = 3SE +/- 0.15, N = 3SE +/- 0.41, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 3SE +/- 0.89, N = 3101.15723.3233.9137.3575.4486.4383.9497.65681.9132.2136.7272.2883.6481.2591.96579.8731.6192.19581.1031.6637.1669.0980.4177.56

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 40000000 - Partitions: 1000)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time160320480640800SE +/- 0.54, N = 3SE +/- 14.94, N = 3SE +/- 0.22, N = 3SE +/- 0.13, N = 3SE +/- 6.51, N = 3SE +/- 0.16, N = 3SE +/- 2.33, N = 3SE +/- 0.83, N = 3SE +/- 1.92, N = 3SE +/- 0.25, N = 3SE +/- 0.77, N = 3SE +/- 0.56, N = 3SE +/- 0.16, N = 3SE +/- 0.48, N = 3SE +/- 1.66, N = 3SE +/- 0.10, N = 3SE +/- 0.85, N = 3SE +/- 0.93, N = 3SE +/- 1.83, N = 3SE +/- 1.46, N = 3189.73721.0033.51183.35697.9032.4088.02138.87162.01158.24172.45581.6931.54172.19581.6031.6179.60131.43151.54147.55

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 40000000 - Partitions: 2000)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time150300450600750SE +/- 0.40, N = 3SE +/- 16.56, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 3SE +/- 8.50, N = 3SE +/- 0.31, N = 3SE +/- 4.77, N = 3SE +/- 0.91, N = 3SE +/- 1.46, N = 3SE +/- 1.89, N = 3SE +/- 0.42, N = 3SE +/- 0.49, N = 3SE +/- 0.10, N = 3SE +/- 0.47, N = 3SE +/- 1.28, N = 3SE +/- 0.14, N = 3SE +/- 3.36, N = 3SE +/- 0.77, N = 3SE +/- 1.01, N = 3SE +/- 0.50, N = 3192.81710.7133.79185.51695.1732.2083.87137.45159.12157.25175.84580.8631.65175.24579.5531.3281.61131.39151.60148.66

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Group By Test Time)1005001000200020406080100SE +/- 2.29, N = 3SE +/- 4.05, N = 3SE +/- 2.33, N = 3SE +/- 4.77, N = 3SE +/- 3.33, N = 3SE +/- 1.17, N = 3SE +/- 0.85, N = 3SE +/- 3.36, N = 387.3289.2388.0283.8788.0182.3579.6081.61

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Repartition Test Time)10050010002000306090120150SE +/- 1.31, N = 3SE +/- 0.58, N = 3SE +/- 0.83, N = 3SE +/- 0.91, N = 3SE +/- 0.42, N = 3SE +/- 0.84, N = 3SE +/- 0.93, N = 3SE +/- 0.77, N = 3137.28138.04138.87137.45131.38131.53131.43131.39

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Inner Join Test Time)100500100020004080120160200SE +/- 1.75, N = 3SE +/- 0.39, N = 3SE +/- 1.92, N = 3SE +/- 1.46, N = 3SE +/- 1.45, N = 3SE +/- 1.02, N = 3SE +/- 1.83, N = 3SE +/- 1.01, N = 3157.88158.11162.01159.12152.87152.21151.54151.60

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Broadcast Inner Join Test Time)100500100020004080120160200SE +/- 2.32, N = 3SE +/- 0.85, N = 3SE +/- 0.25, N = 3SE +/- 1.89, N = 3SE +/- 0.60, N = 3SE +/- 0.76, N = 3SE +/- 1.46, N = 3SE +/- 0.50, N = 3159.01157.08158.24157.25150.05147.55147.55148.66

Apache Spark TPC-DS

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q01)11050100510152025SE +/- 0.10, N = 3SE +/- 0.14, N = 4SE +/- 0.04, N = 3SE +/- 0.10, N = 4SE +/- 0.02, N = 3SE +/- 0.20, N = 3SE +/- 0.05, N = 38.9311.2915.858.9811.2315.4120.131. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 1)Q01Q02Q03Q04Q05Q06Q07Q08Q09Q10Q11Q12Q13Q14Q15Q16Q17Q18Q19Q20Q21Q22Q23Q24Q25Q26Q27Q28Q29Q30Q31Q32Q33Q34Q35Q36Q37Q38Q39Q40Q41Q42Q43Q44Q45Q46Q47Q48Q49Q50Q51Q52Q53Q54Q55Q56Q57Q58Q60Q61Q62Q63Q64Q65Q66Q67Q68Q69Q70Q71Q72Q73Q74Q75Q76Q77Q78Q79Q80Q81Q82Q83Q84Q85Q86Q87Q88Q89Q90Q91Q92Q94Q95Q96Q97Q59Q93Q98Q99510152025SE +/- 0.10, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.22, N = 3SE +/- 0.19, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.12, N = 3SE +/- 0.11, N = 3SE +/- 0.17, N = 3SE +/- 0.10, N = 3SE +/- 0.02, N = 3SE +/- 0.16, N = 3SE +/- 0.33, N = 3SE +/- 0.09, N = 3SE +/- 0.16, N = 3SE +/- 0.10, N = 3SE +/- 0.19, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.14, N = 3SE +/- 0.21, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.02, N = 3SE +/- 0.17, N = 3SE +/- 0.06, N = 2SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.13, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 2SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 0.13, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 2SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.18, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.11, N = 3SE +/- 0.09, N = 3SE +/- 0.28, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 2SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.19, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 2SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.14, N = 2SE +/- 0.01, N = 2SE +/- 0.07, N = 3SE +/- 0.04, N = 2SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.15, N = 2SE +/- 0.02, N = 2SE +/- 0.02, N = 2SE +/- 0.22, N = 2SE +/- 0.10, N = 4SE +/- 0.06, N = 4SE +/- 0.07, N = 4SE +/- 0.10, N = 4SE +/- 0.11, N = 4SE +/- 0.05, N = 4SE +/- 0.04, N = 4SE +/- 0.01, N = 4SE +/- 0.05, N = 4SE +/- 0.16, N = 4SE +/- 0.05, N = 4SE +/- 0.02, N = 4SE +/- 0.11, N = 4SE +/- 0.11, N = 4SE +/- 0.02, N = 4SE +/- 0.10, N = 4SE +/- 0.12, N = 4SE +/- 0.08, N = 4SE +/- 0.05, N = 4SE +/- 0.02, N = 4SE +/- 0.08, N = 4SE +/- 0.18, N = 4SE +/- 0.23, N = 4SE +/- 0.05, N = 4SE +/- 0.11, N = 4SE +/- 0.14, N = 4SE +/- 0.05, N = 4SE +/- 0.12, N = 3SE +/- 0.04, N = 4SE +/- 0.07, N = 3SE +/- 0.14, N = 4SE +/- 0.04, N = 4SE +/- 0.09, N = 4SE +/- 0.13, N = 2SE +/- 0.08, N = 4SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 4SE +/- 0.12, N = 4SE +/- 0.04, N = 3SE +/- 0.05, N = 4SE +/- 0.03, N = 4SE +/- 0.09, N = 4SE +/- 0.03, N = 4SE +/- 0.03, N = 4SE +/- 0.06, N = 3SE +/- 0.16, N = 4SE +/- 0.07, N = 4SE +/- 0.08, N = 4SE +/- 0.14, N = 4SE +/- 0.19, N = 4SE +/- 0.02, N = 4SE +/- 0.07, N = 4SE +/- 0.10, N = 4SE +/- 0.06, N = 4SE +/- 0.05, N = 4SE +/- 0.07, N = 4SE +/- 0.05, N = 2SE +/- 0.10, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.19, N = 4SE +/- 0.06, N = 4SE +/- 0.13, N = 3SE +/- 0.13, N = 4SE +/- 0.07, N = 4SE +/- 0.18, N = 4SE +/- 0.15, N = 3SE +/- 0.10, N = 4SE +/- 0.25, N = 4SE +/- 0.05, N = 4SE +/- 0.05, N = 4SE +/- 0.13, N = 4SE +/- 0.10, N = 4SE +/- 0.05, N = 4SE +/- 0.07, N = 4SE +/- 0.06, N = 4SE +/- 0.10, N = 4SE +/- 0.08, N = 3SE +/- 0.07, N = 4SE +/- 0.02, N = 3SE +/- 0.05, N = 4SE +/- 0.19, N = 3SE +/- 0.11, N = 4SE +/- 0.05, N = 4SE +/- 0.12, N = 3SE +/- 0.10, N = 4SE +/- 0.06, N = 4SE +/- 0.06, N = 4SE +/- 0.08, N = 4SE +/- 0.03, N = 4SE +/- 0.04, N = 3SE +/- 0.03, N = 4SE +/- 0.06, N = 4SE +/- 0.04, N = 4SE +/- 0.04, N = 3SE +/- 0.02, N = 4SE +/- 0.02, N = 28.939.776.7515.1612.119.118.488.758.1911.4512.754.958.269.017.576.3111.7210.598.174.977.9910.758.082.7211.217.899.1211.1411.639.0012.087.6810.208.4111.229.255.2210.183.768.076.236.707.248.647.538.6712.597.8911.148.5613.306.787.8811.166.809.8810.6410.1710.256.547.637.7917.1510.1011.2712.318.4611.0710.298.9919.618.3011.7214.438.8211.2414.038.5113.458.768.889.217.1312.008.1310.0911.838.706.768.327.586.117.465.759.719.097.714.877.838.989.696.7915.0411.799.338.468.807.9011.5312.704.908.409.037.496.2911.9910.588.024.947.9110.428.072.6811.277.888.9911.0211.199.2612.297.7010.048.6111.488.835.0910.083.728.006.226.727.158.617.608.6912.437.6510.778.7513.226.737.9010.896.579.8710.769.9210.196.497.837.8817.1910.2711.2712.088.5310.9510.359.0419.118.3111.9514.268.7811.3914.338.4413.528.878.869.247.3011.868.0410.0711.398.816.638.197.796.097.265.739.839.117.754.857.621. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q02)11050100500714212835SE +/- 0.14, N = 3SE +/- 0.25, N = 4SE +/- 0.12, N = 3SE +/- 0.06, N = 4SE +/- 0.36, N = 3SE +/- 0.09, N = 3SE +/- 0.29, N = 3SE +/- 0.07, N = 29.7711.3217.559.6911.6317.5827.5527.901. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q03)11050100500510152025SE +/- 0.03, N = 3SE +/- 0.03, N = 4SE +/- 0.08, N = 3SE +/- 0.07, N = 4SE +/- 0.17, N = 3SE +/- 0.28, N = 3SE +/- 0.20, N = 3SE +/- 0.21, N = 26.758.4814.186.799.0214.1219.5119.481. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q04)110501004080120160200SE +/- 0.22, N = 3SE +/- 0.36, N = 4SE +/- 0.56, N = 3SE +/- 0.10, N = 4SE +/- 0.31, N = 3SE +/- 0.72, N = 3SE +/- 1.16, N = 315.1650.14154.3115.0448.88153.78192.451. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q05)110501001530456075SE +/- 0.19, N = 3SE +/- 0.37, N = 4SE +/- 0.56, N = 3SE +/- 0.11, N = 4SE +/- 0.60, N = 3SE +/- 1.08, N = 3SE +/- 0.44, N = 312.1123.8543.1711.7923.3843.7466.741. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q06)110501005001122334455SE +/- 0.03, N = 3SE +/- 0.14, N = 4SE +/- 0.91, N = 3SE +/- 0.05, N = 4SE +/- 0.30, N = 3SE +/- 0.46, N = 3SE +/- 0.17, N = 3SE +/- 0.05, N = 29.1118.8149.099.3319.4047.6723.7423.611. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q07)11050100500714212835SE +/- 0.10, N = 3SE +/- 0.32, N = 4SE +/- 0.48, N = 3SE +/- 0.04, N = 4SE +/- 0.10, N = 3SE +/- 0.21, N = 3SE +/- 0.64, N = 3SE +/- 1.17, N = 28.4812.5821.528.4612.7620.7229.3227.831. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q08)11050100500510152025SE +/- 0.12, N = 3SE +/- 0.13, N = 4SE +/- 0.44, N = 3SE +/- 0.01, N = 4SE +/- 0.14, N = 3SE +/- 0.26, N = 3SE +/- 0.28, N = 3SE +/- 0.13, N = 28.7511.8317.208.8011.8417.2722.2422.661. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q09)11050100500918273645SE +/- 0.11, N = 3SE +/- 0.10, N = 4SE +/- 0.25, N = 3SE +/- 0.05, N = 4SE +/- 0.28, N = 3SE +/- 0.16, N = 3SE +/- 0.49, N = 3SE +/- 0.61, N = 28.1912.0524.137.9011.8324.4641.1939.801. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q10)11050100500714212835SE +/- 0.17, N = 3SE +/- 0.12, N = 4SE +/- 0.37, N = 3SE +/- 0.16, N = 4SE +/- 0.09, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 3SE +/- 1.72, N = 211.4514.1420.1611.5314.3320.2427.5927.691. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q11)11050100306090120150SE +/- 0.10, N = 3SE +/- 0.27, N = 4SE +/- 0.28, N = 3SE +/- 0.05, N = 4SE +/- 0.37, N = 3SE +/- 0.53, N = 3SE +/- 0.56, N = 312.7535.77103.2812.7035.90101.84121.651. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q12)110501005001.18582.37163.55744.74325.929SE +/- 0.02, N = 3SE +/- 0.04, N = 4SE +/- 0.08, N = 3SE +/- 0.02, N = 4SE +/- 0.03, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 24.955.145.274.905.145.215.225.231. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q13)11050100500714212835SE +/- 0.16, N = 3SE +/- 0.16, N = 4SE +/- 0.11, N = 3SE +/- 0.11, N = 4SE +/- 0.10, N = 3SE +/- 0.17, N = 3SE +/- 0.50, N = 3SE +/- 0.38, N = 28.2611.8019.788.4011.4319.4528.1928.721. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q14)1105010050020406080100SE +/- 0.33, N = 3SE +/- 0.35, N = 4SE +/- 0.35, N = 3SE +/- 0.11, N = 4SE +/- 0.58, N = 3SE +/- 2.04, N = 3SE +/- 2.66, N = 3SE +/- 1.32, N = 39.0122.7675.669.0322.1977.16101.62100.361. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q15)11050100500612182430SE +/- 0.09, N = 3SE +/- 0.21, N = 4SE +/- 0.24, N = 3SE +/- 0.02, N = 4SE +/- 0.19, N = 3SE +/- 0.09, N = 3SE +/- 0.30, N = 3SE +/- 0.11, N = 37.5710.3917.777.4910.3317.5926.1926.111. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q16)1246810SE +/- 0.16, N = 3SE +/- 0.10, N = 46.316.291. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q17)11050100500306090120150SE +/- 0.10, N = 3SE +/- 0.36, N = 4SE +/- 1.40, N = 3SE +/- 0.12, N = 4SE +/- 0.15, N = 3SE +/- 0.43, N = 3SE +/- 0.40, N = 3SE +/- 0.71, N = 311.7235.11119.3511.9934.68119.3142.9243.551. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q18)11050100500714212835SE +/- 0.19, N = 3SE +/- 0.12, N = 4SE +/- 0.20, N = 3SE +/- 0.08, N = 4SE +/- 0.21, N = 3SE +/- 0.21, N = 3SE +/- 0.54, N = 3SE +/- 0.23, N = 310.5913.7820.8710.5813.8121.4127.8827.731. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q19)11050100500612182430SE +/- 0.09, N = 3SE +/- 0.21, N = 4SE +/- 0.18, N = 3SE +/- 0.05, N = 4SE +/- 0.22, N = 3SE +/- 0.37, N = 3SE +/- 0.67, N = 3SE +/- 0.52, N = 38.1711.8118.238.0211.1517.8925.5725.801. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q20)110501005001.1972.3943.5914.7885.985SE +/- 0.04, N = 3SE +/- 0.03, N = 4SE +/- 0.08, N = 3SE +/- 0.02, N = 4SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 24.975.095.214.945.055.275.325.221. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q21)11050100500510152025SE +/- 0.03, N = 3SE +/- 0.17, N = 4SE +/- 0.26, N = 3SE +/- 0.08, N = 4SE +/- 0.17, N = 3SE +/- 0.34, N = 3SE +/- 0.09, N = 3SE +/- 0.28, N = 37.9912.5415.807.9112.1015.8320.5721.021. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q22)110501005001428425670SE +/- 0.05, N = 3SE +/- 0.40, N = 4SE +/- 0.54, N = 3SE +/- 0.18, N = 4SE +/- 0.14, N = 3SE +/- 0.38, N = 3SE +/- 0.29, N = 3SE +/- 0.40, N = 310.7526.5736.1210.4226.9436.6660.7561.501. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q23)1105010050100150200250SE +/- 0.02, N = 3SE +/- 0.43, N = 4SE +/- 1.35, N = 3SE +/- 0.23, N = 4SE +/- 0.46, N = 3SE +/- 1.31, N = 3SE +/- 0.08, N = 38.0833.00178.138.0733.70173.15223.121. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q24)110501001326395265SE +/- 0.02, N = 3SE +/- 0.11, N = 4SE +/- 0.49, N = 3SE +/- 0.05, N = 4SE +/- 0.64, N = 3SE +/- 0.08, N = 3SE +/- 0.74, N = 32.7217.4657.152.6816.7956.7839.991. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q25)11050100500306090120150SE +/- 0.12, N = 3SE +/- 0.27, N = 4SE +/- 1.06, N = 3SE +/- 0.11, N = 4SE +/- 0.79, N = 3SE +/- 0.72, N = 3SE +/- 0.33, N = 3SE +/- 0.28, N = 311.2135.36112.6511.2735.47109.5141.9741.301. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q26)11050100500510152025SE +/- 0.06, N = 3SE +/- 0.27, N = 4SE +/- 0.12, N = 3SE +/- 0.14, N = 4SE +/- 0.29, N = 3SE +/- 0.30, N = 3SE +/- 0.57, N = 3SE +/- 0.61, N = 37.8910.3216.027.8810.4816.2320.4420.591. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q27)11050100500714212835SE +/- 0.14, N = 3SE +/- 0.20, N = 4SE +/- 0.47, N = 3SE +/- 0.05, N = 4SE +/- 0.27, N = 2SE +/- 0.39, N = 3SE +/- 0.26, N = 3SE +/- 0.46, N = 39.1212.9222.108.9913.4320.6928.4629.861. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q28)110501005001530456075SE +/- 0.21, N = 3SE +/- 0.21, N = 4SE +/- 0.48, N = 3SE +/- 0.12, N = 3SE +/- 0.51, N = 3SE +/- 0.66, N = 3SE +/- 2.08, N = 3SE +/- 0.64, N = 311.1417.4642.7711.0217.5441.6268.1767.041. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q29)11050100306090120150SE +/- 0.09, N = 3SE +/- 0.41, N = 4SE +/- 1.14, N = 3SE +/- 0.04, N = 4SE +/- 0.40, N = 3SE +/- 0.16, N = 3SE +/- 0.23, N = 311.6335.87118.4111.1934.69117.3447.471. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q30)11050100500510152025SE +/- 0.05, N = 3SE +/- 0.06, N = 4SE +/- 0.32, N = 3SE +/- 0.07, N = 3SE +/- 0.16, N = 3SE +/- 0.07, N = 3SE +/- 0.28, N = 3SE +/- 0.06, N = 39.0011.9115.989.2611.9016.0419.5118.891. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q31)110501005001224364860SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.17, N = 3SE +/- 0.14, N = 4SE +/- 0.63, N = 3SE +/- 0.41, N = 3SE +/- 0.70, N = 3SE +/- 0.67, N = 312.0818.6435.8012.2919.3333.5251.4949.001. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q32)11050100500510152025SE +/- 0.07, N = 3SE +/- 0.25, N = 4SE +/- 0.17, N = 3SE +/- 0.04, N = 4SE +/- 0.14, N = 3SE +/- 0.41, N = 3SE +/- 0.17, N = 3SE +/- 0.33, N = 37.689.7414.407.709.3815.2922.6522.591. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q33)11050100500714212835SE +/- 0.09, N = 3SE +/- 0.16, N = 4SE +/- 0.40, N = 3SE +/- 0.09, N = 4SE +/- 0.26, N = 3SE +/- 0.37, N = 3SE +/- 0.45, N = 3SE +/- 0.12, N = 310.2014.1022.3110.0413.6022.0029.1729.041. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q34)11050100500612182430SE +/- 0.02, N = 3SE +/- 0.22, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 2SE +/- 0.46, N = 3SE +/- 0.11, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 38.4111.9117.688.6112.0417.9123.9522.811. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q35)11050100500816243240SE +/- 0.17, N = 3SE +/- 0.12, N = 4SE +/- 0.27, N = 3SE +/- 0.08, N = 4SE +/- 0.93, N = 3SE +/- 0.22, N = 3SE +/- 0.17, N = 3SE +/- 0.28, N = 311.2215.9125.6011.4816.5725.0736.6036.501. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q36)11050100500714212835SE +/- 0.06, N = 2SE +/- 0.13, N = 4SE +/- 0.71, N = 3SE +/- 0.12, N = 3SE +/- 0.63, N = 3SE +/- 0.63, N = 3SE +/- 0.49, N = 3SE +/- 0.57, N = 39.2511.9222.148.8312.4822.3931.0430.731. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q37)11050100500510152025SE +/- 0.05, N = 3SE +/- 0.27, N = 4SE +/- 0.18, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.24, N = 3SE +/- 0.33, N = 35.2213.8222.765.0913.3622.7420.9921.401. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q38)110501005001530456075SE +/- 0.07, N = 3SE +/- 0.28, N = 4SE +/- 0.66, N = 3SE +/- 0.05, N = 4SE +/- 0.11, N = 3SE +/- 0.89, N = 3SE +/- 0.66, N = 3SE +/- 0.18, N = 310.1817.6943.1910.0817.4143.4867.3868.081. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q39)11050100500612182430SE +/- 0.07, N = 3SE +/- 0.31, N = 4SE +/- 0.36, N = 3SE +/- 0.12, N = 4SE +/- 0.20, N = 3SE +/- 0.36, N = 3SE +/- 1.30, N = 3SE +/- 0.37, N = 33.7610.4215.193.7210.7515.1922.7724.991. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q40)110501001020304050SE +/- 0.13, N = 3SE +/- 0.11, N = 4SE +/- 0.58, N = 3SE +/- 0.04, N = 3SE +/- 0.26, N = 3SE +/- 0.37, N = 3SE +/- 0.17, N = 28.0717.6842.828.0017.3841.4324.081. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q41)11050100500246810SE +/- 0.01, N = 3SE +/- 0.07, N = 4SE +/- 0.10, N = 3SE +/- 0.05, N = 4SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 36.237.177.376.227.097.287.297.321. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q42)1105010050048121620SE +/- 0.06, N = 3SE +/- 0.06, N = 4SE +/- 0.30, N = 3SE +/- 0.03, N = 4SE +/- 0.06, N = 3SE +/- 0.34, N = 3SE +/- 0.15, N = 3SE +/- 0.25, N = 36.708.6913.566.728.4413.2517.7217.611. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q43)11050100500510152025SE +/- 0.06, N = 3SE +/- 0.09, N = 4SE +/- 0.34, N = 3SE +/- 0.09, N = 4SE +/- 0.08, N = 3SE +/- 0.30, N = 3SE +/- 0.17, N = 2SE +/- 0.32, N = 37.248.5514.177.158.4213.7718.7119.231. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q44)11050100500612182430SE +/- 0.13, N = 3SE +/- 0.04, N = 4SE +/- 0.06, N = 3SE +/- 0.03, N = 4SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.66, N = 3SE +/- 0.23, N = 38.646.547.748.616.407.8425.2225.031. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q45)1105010050048121620SE +/- 0.01, N = 3SE +/- 0.13, N = 4SE +/- 0.13, N = 3SE +/- 0.03, N = 4SE +/- 0.05, N = 3SE +/- 0.28, N = 3SE +/- 0.16, N = 3SE +/- 0.37, N = 37.539.7613.157.609.8413.4616.8616.901. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q46)11050100500714212835SE +/- 0.11, N = 3SE +/- 0.16, N = 4SE +/- 0.27, N = 3SE +/- 0.06, N = 3SE +/- 0.34, N = 3SE +/- 0.09, N = 3SE +/- 0.26, N = 3SE +/- 0.29, N = 38.6712.6622.298.6912.4721.8730.0429.871. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q47)110501005001122334455SE +/- 0.05, N = 3SE +/- 0.16, N = 4SE +/- 0.22, N = 3SE +/- 0.16, N = 4SE +/- 0.08, N = 3SE +/- 0.40, N = 3SE +/- 0.31, N = 3SE +/- 0.43, N = 312.5919.1033.3412.4319.0833.7350.0549.441. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q48)11050100500612182430SE +/- 0.05, N = 3SE +/- 0.10, N = 4SE +/- 0.24, N = 3SE +/- 0.07, N = 4SE +/- 0.09, N = 3SE +/- 0.32, N = 3SE +/- 0.17, N = 3SE +/- 0.27, N = 37.8910.4916.977.6510.0016.6723.0023.131. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q49)110501001020304050SE +/- 0.08, N = 2SE +/- 0.11, N = 4SE +/- 0.37, N = 3SE +/- 0.08, N = 4SE +/- 0.20, N = 3SE +/- 0.10, N = 3SE +/- 0.18, N = 311.1418.9340.2710.7719.5139.3444.001. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q50)1105010020406080100SE +/- 0.02, N = 3SE +/- 0.25, N = 4SE +/- 0.37, N = 3SE +/- 0.14, N = 4SE +/- 0.22, N = 3SE +/- 0.11, N = 3SE +/- 0.82, N = 38.5622.0050.088.7521.9049.3681.061. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q51)1105010020406080100SE +/- 0.07, N = 3SE +/- 0.18, N = 4SE +/- 0.66, N = 3SE +/- 0.19, N = 4SE +/- 0.17, N = 2SE +/- 0.65, N = 3SE +/- 1.20, N = 313.3026.3259.4613.2226.2858.63101.721. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q52)11050100500510152025SE +/- 0.08, N = 3SE +/- 0.10, N = 4SE +/- 0.36, N = 3SE +/- 0.02, N = 4SE +/- 0.15, N = 3SE +/- 0.10, N = 3SE +/- 0.18, N = 3SE +/- 0.29, N = 36.788.7613.596.738.6513.2218.8719.141. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q53)11050100500510152025SE +/- 0.13, N = 3SE +/- 0.08, N = 4SE +/- 0.18, N = 3SE +/- 0.07, N = 4SE +/- 0.11, N = 3SE +/- 0.25, N = 3SE +/- 0.21, N = 3SE +/- 0.11, N = 37.889.7515.367.909.4614.9420.0619.961. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q54)11050100500918273645SE +/- 0.13, N = 3SE +/- 0.07, N = 4SE +/- 0.16, N = 3SE +/- 0.10, N = 4SE +/- 0.42, N = 3SE +/- 0.12, N = 3SE +/- 0.19, N = 3SE +/- 0.13, N = 211.1616.9737.7710.8917.0736.9633.8333.991. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q55)1105010050048121620SE +/- 0.03, N = 3SE +/- 0.14, N = 4SE +/- 0.23, N = 3SE +/- 0.06, N = 4SE +/- 0.19, N = 3SE +/- 0.12, N = 3SE +/- 0.36, N = 3SE +/- 0.34, N = 36.808.6313.936.578.7013.6018.2217.951. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q56)11050100500714212835SE +/- 0.05, N = 3SE +/- 0.11, N = 4SE +/- 0.09, N = 3SE +/- 0.05, N = 4SE +/- 0.14, N = 3SE +/- 0.24, N = 3SE +/- 0.32, N = 3SE +/- 0.14, N = 39.8813.0220.679.8712.8021.1027.5928.051. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q57)11050100500714212835SE +/- 0.10, N = 3SE +/- 0.07, N = 4SE +/- 0.60, N = 3SE +/- 0.07, N = 4SE +/- 0.16, N = 3SE +/- 0.03, N = 3SE +/- 0.74, N = 3SE +/- 0.61, N = 310.6416.4824.4410.7616.3824.7831.6731.631. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q58)11050100500816243240SE +/- 0.04, N = 2SE +/- 0.09, N = 4SE +/- 0.54, N = 3SE +/- 0.05, N = 2SE +/- 0.34, N = 3SE +/- 0.28, N = 3SE +/- 0.53, N = 3SE +/- 1.31, N = 310.1713.8424.389.9214.7424.2035.6134.211. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q60)11050100500714212835SE +/- 0.04, N = 3SE +/- 0.34, N = 4SE +/- 0.32, N = 3SE +/- 0.10, N = 3SE +/- 0.51, N = 3SE +/- 0.21, N = 3SE +/- 0.71, N = 3SE +/- 0.70, N = 310.2514.2123.5910.1914.3222.5730.6931.171. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q61)11050100500246810SE +/- 0.04, N = 3SE +/- 0.05, N = 4SE +/- 0.39, N = 2SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.13, N = 3SE +/- 0.16, N = 3SE +/- 0.17, N = 36.547.107.706.497.037.657.517.711. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q62)1105010050048121620SE +/- 0.10, N = 4SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.27, N = 3SE +/- 0.22, N = 3SE +/- 0.07, N = 37.639.1912.977.838.9812.6115.6615.611. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q63)11050100500510152025SE +/- 0.05, N = 3SE +/- 0.13, N = 4SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.24, N = 3SE +/- 0.06, N = 2SE +/- 0.33, N = 3SE +/- 0.31, N = 37.799.5515.017.889.8314.7319.9319.861. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q64)110501004080120160200SE +/- 0.18, N = 3SE +/- 0.32, N = 4SE +/- 1.53, N = 3SE +/- 0.19, N = 4SE +/- 0.51, N = 3SE +/- 3.02, N = 3SE +/- 2.48, N = 317.1551.48170.8517.1950.33165.96151.381. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q65)110501001632486480SE +/- 0.02, N = 3SE +/- 0.84, N = 4SE +/- 0.84, N = 3SE +/- 0.06, N = 4SE +/- 0.21, N = 3SE +/- 0.48, N = 3SE +/- 1.31, N = 310.1018.6442.4210.2718.1242.6973.381. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q66)11050100500714212835SE +/- 0.08, N = 3SE +/- 0.18, N = 4SE +/- 0.17, N = 2SE +/- 0.13, N = 3SE +/- 0.16, N = 3SE +/- 0.24, N = 3SE +/- 0.44, N = 3SE +/- 0.43, N = 311.2714.0320.0711.2713.7520.6227.6827.081. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q67)1105010050100150200250SE +/- 0.11, N = 3SE +/- 0.13, N = 4SE +/- 0.63, N = 3SE +/- 0.13, N = 4SE +/- 0.11, N = 3SE +/- 0.51, N = 3SE +/- 1.23, N = 312.3133.19106.6112.0832.61106.30205.561. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q68)11050100500714212835SE +/- 0.09, N = 3SE +/- 0.14, N = 4SE +/- 0.18, N = 3SE +/- 0.07, N = 4SE +/- 0.27, N = 3SE +/- 0.47, N = 3SE +/- 0.84, N = 3SE +/- 0.26, N = 38.4612.5121.688.5312.8122.6031.3130.481. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q69)11050100500612182430SE +/- 0.28, N = 3SE +/- 0.17, N = 4SE +/- 0.29, N = 3SE +/- 0.18, N = 4SE +/- 0.02, N = 3SE +/- 0.21, N = 2SE +/- 0.33, N = 3SE +/- 0.42, N = 311.0713.8220.2810.9513.9720.1726.7626.081. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q70)11050100500816243240SE +/- 0.01, N = 3SE +/- 0.14, N = 4SE +/- 0.35, N = 3SE +/- 0.15, N = 3SE +/- 0.32, N = 3SE +/- 0.53, N = 3SE +/- 0.83, N = 3SE +/- 1.37, N = 310.2913.4423.7610.3513.7122.9535.1535.881. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q71)11050100500714212835SE +/- 0.08, N = 3SE +/- 0.21, N = 4SE +/- 1.15, N = 2SE +/- 0.10, N = 4SE +/- 0.02, N = 3SE +/- 0.38, N = 3SE +/- 0.15, N = 3SE +/- 0.82, N = 38.9913.1222.279.0412.7123.1931.4430.911. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q72)11050100100200300400500SE +/- 0.12, N = 3SE +/- 1.21, N = 4SE +/- 5.27, N = 3SE +/- 0.25, N = 4SE +/- 0.40, N = 3SE +/- 11.04, N = 3SE +/- 1.63, N = 319.61118.28445.1119.11118.08419.79135.021. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q73)11050100500510152025SE +/- 0.07, N = 3SE +/- 0.10, N = 4SE +/- 0.02, N = 2SE +/- 0.05, N = 4SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.46, N = 3SE +/- 0.37, N = 38.3011.1916.298.3111.1516.6521.9221.301. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q74)11050100306090120150SE +/- 0.08, N = 3SE +/- 0.13, N = 4SE +/- 1.15, N = 3SE +/- 0.05, N = 4SE +/- 0.09, N = 3SE +/- 0.64, N = 3SE +/- 1.38, N = 311.7219.8097.5211.9519.7495.45112.491. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q75)1105010020406080100SE +/- 0.15, N = 3SE +/- 0.35, N = 4SE +/- 0.38, N = 3SE +/- 0.13, N = 4SE +/- 0.38, N = 3SE +/- 1.20, N = 3SE +/- 0.98, N = 314.4327.4959.6014.2627.0459.3796.421. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q76)11050100500714212835SE +/- 0.03, N = 2SE +/- 0.21, N = 3SE +/- 0.40, N = 3SE +/- 0.10, N = 4SE +/- 0.13, N = 2SE +/- 0.40, N = 3SE +/- 0.17, N = 3SE +/- 0.72, N = 38.8212.5220.508.7812.3020.5929.1428.591. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q77)11050100816243240SE +/- 0.08, N = 3SE +/- 0.24, N = 4SE +/- 0.16, N = 3SE +/- 0.05, N = 4SE +/- 0.15, N = 3SE +/- 0.31, N = 3SE +/- 0.30, N = 311.2415.2524.6611.3914.5724.2433.671. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q78)110501004080120160200SE +/- 0.08, N = 3SE +/- 0.31, N = 4SE +/- 0.64, N = 3SE +/- 0.07, N = 4SE +/- 0.13, N = 3SE +/- 2.63, N = 3SE +/- 2.62, N = 314.0344.14145.2914.3343.40145.20186.011. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q79)11050100500714212835SE +/- 0.19, N = 3SE +/- 0.14, N = 4SE +/- 0.10, N = 3SE +/- 0.06, N = 4SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.27, N = 3SE +/- 0.49, N = 38.5111.9121.248.4411.9921.0430.3330.271. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q80)11050100306090120150SE +/- 0.04, N = 3SE +/- 0.46, N = 4SE +/- 2.12, N = 3SE +/- 0.10, N = 4SE +/- 0.75, N = 3SE +/- 1.43, N = 3SE +/- 1.28, N = 313.4548.08154.5313.5247.18154.37100.241. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q81)11050100510152025SE +/- 0.04, N = 3SE +/- 0.17, N = 3SE +/- 0.42, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.16, N = 3SE +/- 0.23, N = 38.7611.5415.868.8711.4615.6018.701. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q82)11050100500918273645SE +/- 0.10, N = 2SE +/- 0.22, N = 4SE +/- 0.08, N = 3SE +/- 0.07, N = 4SE +/- 0.19, N = 3SE +/- 0.80, N = 3SE +/- 0.16, N = 3SE +/- 0.43, N = 38.8816.9940.318.8616.6438.4626.0626.021. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q83)1105010048121620SE +/- 0.06, N = 3SE +/- 0.11, N = 4SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.23, N = 3SE +/- 0.04, N = 3SE +/- 0.25, N = 39.2110.7413.639.2410.7913.2615.751. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q84)110501005003691215SE +/- 0.05, N = 3SE +/- 0.07, N = 4SE +/- 0.21, N = 3SE +/- 0.05, N = 4SE +/- 0.14, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 37.139.1311.687.309.1511.7013.5713.551. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q85)11050100500612182430SE +/- 0.03, N = 3SE +/- 0.03, N = 4SE +/- 0.28, N = 3SE +/- 0.19, N = 3SE +/- 0.29, N = 3SE +/- 0.47, N = 2SE +/- 0.30, N = 3SE +/- 0.20, N = 312.0014.8519.5911.8614.5620.2225.2324.601. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q86)1105010050048121620SE +/- 0.03, N = 3SE +/- 0.04, N = 4SE +/- 0.31, N = 3SE +/- 0.11, N = 4SE +/- 0.23, N = 3SE +/- 0.23, N = 3SE +/- 0.31, N = 3SE +/- 0.13, N = 38.139.1712.238.049.2812.3015.5715.401. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q87)110501005001530456075SE +/- 0.01, N = 3SE +/- 0.72, N = 3SE +/- 0.51, N = 3SE +/- 0.05, N = 4SE +/- 0.23, N = 3SE +/- 0.36, N = 3SE +/- 0.15, N = 3SE +/- 0.70, N = 310.0917.6644.4210.0718.0443.6067.9768.191. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q88)110501005001326395265SE +/- 0.14, N = 2SE +/- 0.39, N = 4SE +/- 0.85, N = 3SE +/- 0.12, N = 3SE +/- 0.21, N = 3SE +/- 1.14, N = 3SE +/- 1.29, N = 3SE +/- 0.43, N = 311.8317.1836.3011.3917.4836.1455.6853.701. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q89)11050100500612182430SE +/- 0.01, N = 2SE +/- 0.10, N = 4SE +/- 0.22, N = 3SE +/- 0.10, N = 4SE +/- 0.06, N = 3SE +/- 0.51, N = 3SE +/- 0.16, N = 3SE +/- 0.42, N = 38.7011.0117.658.8110.7817.7023.2223.461. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q90)110501005003691215SE +/- 0.07, N = 3SE +/- 0.03, N = 4SE +/- 0.37, N = 3SE +/- 0.06, N = 4SE +/- 0.13, N = 3SE +/- 0.37, N = 3SE +/- 0.43, N = 3SE +/- 0.31, N = 36.767.469.976.637.529.8212.1112.101. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q91)110501003691215SE +/- 0.04, N = 2SE +/- 0.02, N = 3SE +/- 0.18, N = 3SE +/- 0.06, N = 4SE +/- 0.25, N = 2SE +/- 0.27, N = 3SE +/- 0.17, N = 38.329.7810.928.1910.0010.7312.211. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q92)1105010050048121620SE +/- 0.06, N = 3SE +/- 0.05, N = 4SE +/- 0.07, N = 3SE +/- 0.08, N = 4SE +/- 0.16, N = 3SE +/- 0.43, N = 3SE +/- 0.13, N = 3SE +/- 0.44, N = 37.589.0712.357.799.0113.1816.2416.041. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q94)11050100714212835SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.33, N = 3SE +/- 0.03, N = 4SE +/- 0.09, N = 3SE +/- 0.44, N = 3SE +/- 0.28, N = 36.119.9319.046.0910.1218.9627.971. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q95)11050100612182430SE +/- 0.08, N = 3SE +/- 0.09, N = 4SE +/- 0.36, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.17, N = 2SE +/- 0.06, N = 37.4610.2118.237.2610.1618.1026.651. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q96)110501003691215SE +/- 0.03, N = 3SE +/- 0.25, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 4SE +/- 0.06, N = 3SE +/- 0.19, N = 3SE +/- 0.19, N = 35.757.1610.915.736.6410.1813.531. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q97)1105010020406080100SE +/- 0.07, N = 3SE +/- 0.17, N = 4SE +/- 0.27, N = 3SE +/- 0.06, N = 4SE +/- 0.33, N = 3SE +/- 0.11, N = 3SE +/- 0.24, N = 39.7116.9948.419.8317.2347.0878.071. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q59)11050100500816243240SE +/- 0.15, N = 2SE +/- 0.10, N = 4SE +/- 0.13, N = 3SE +/- 0.04, N = 4SE +/- 0.23, N = 2SE +/- 0.53, N = 3SE +/- 0.85, N = 3SE +/- 1.04, N = 39.0913.1024.119.1112.5125.2436.2136.061. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q93)11050100306090120150SE +/- 0.02, N = 2SE +/- 0.26, N = 4SE +/- 0.71, N = 3SE +/- 0.04, N = 3SE +/- 0.41, N = 3SE +/- 2.38, N = 3SE +/- 1.70, N = 37.7127.1585.827.7527.0785.15140.111. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q98)110501001.20152.4033.60454.8066.0075SE +/- 0.02, N = 2SE +/- 0.02, N = 4SE +/- 0.04, N = 3SE +/- 0.02, N = 4SE +/- 0.08, N = 2SE +/- 0.14, N = 2SE +/- 0.05, N = 34.875.005.164.855.045.265.341. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q99)11050100510152025SE +/- 0.22, N = 2SE +/- 0.36, N = 3SE +/- 0.29, N = 3SE +/- 0.02, N = 2SE +/- 0.16, N = 3SE +/- 0.13, N = 3SE +/- 0.64, N = 27.8310.2316.267.6210.2016.3722.451. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 10)Q01Q02Q03Q04Q05Q06Q07Q08Q09Q10Q11Q12Q13Q14Q15Q17Q18Q19Q20Q21Q22Q23Q24Q25Q26Q27Q28Q29Q30Q31Q32Q33Q34Q35Q36Q37Q38Q39Q40Q41Q42Q43Q44Q45Q46Q47Q48Q49Q50Q51Q52Q53Q54Q55Q56Q57Q58Q59Q60Q61Q62Q63Q64Q65Q66Q67Q68Q69Q70Q71Q72Q73Q74Q75Q77Q78Q79Q80Q82Q83Q84Q85Q86Q88Q89Q90Q91Q92Q93Q95Q96Q97Q98Q99Q76Q81Q87Q94306090120150SE +/- 0.14, N = 4SE +/- 0.25, N = 4SE +/- 0.03, N = 4SE +/- 0.36, N = 4SE +/- 0.37, N = 4SE +/- 0.14, N = 4SE +/- 0.32, N = 4SE +/- 0.13, N = 4SE +/- 0.10, N = 4SE +/- 0.12, N = 4SE +/- 0.27, N = 4SE +/- 0.04, N = 4SE +/- 0.16, N = 4SE +/- 0.35, N = 4SE +/- 0.21, N = 4SE +/- 0.36, N = 4SE +/- 0.12, N = 4SE +/- 0.21, N = 4SE +/- 0.03, N = 4SE +/- 0.17, N = 4SE +/- 0.40, N = 4SE +/- 0.43, N = 4SE +/- 0.11, N = 4SE +/- 0.27, N = 4SE +/- 0.27, N = 4SE +/- 0.20, N = 4SE +/- 0.21, N = 4SE +/- 0.41, N = 4SE +/- 0.06, N = 4SE +/- 0.26, N = 3SE +/- 0.25, N = 4SE +/- 0.16, N = 4SE +/- 0.22, N = 3SE +/- 0.12, N = 4SE +/- 0.13, N = 4SE +/- 0.27, N = 4SE +/- 0.28, N = 4SE +/- 0.31, N = 4SE +/- 0.11, N = 4SE +/- 0.07, N = 4SE +/- 0.06, N = 4SE +/- 0.09, N = 4SE +/- 0.04, N = 4SE +/- 0.13, N = 4SE +/- 0.16, N = 4SE +/- 0.16, N = 4SE +/- 0.10, N = 4SE +/- 0.11, N = 4SE +/- 0.25, N = 4SE +/- 0.18, N = 4SE +/- 0.10, N = 4SE +/- 0.08, N = 4SE +/- 0.07, N = 4SE +/- 0.14, N = 4SE +/- 0.11, N = 4SE +/- 0.07, N = 4SE +/- 0.09, N = 4SE +/- 0.10, N = 4SE +/- 0.34, N = 4SE +/- 0.05, N = 4SE +/- 0.10, N = 4SE +/- 0.13, N = 4SE +/- 0.32, N = 4SE +/- 0.84, N = 4SE +/- 0.18, N = 4SE +/- 0.13, N = 4SE +/- 0.14, N = 4SE +/- 0.17, N = 4SE +/- 0.14, N = 4SE +/- 0.21, N = 4SE +/- 1.21, N = 4SE +/- 0.10, N = 4SE +/- 0.13, N = 4SE +/- 0.35, N = 4SE +/- 0.24, N = 4SE +/- 0.31, N = 4SE +/- 0.14, N = 4SE +/- 0.46, N = 4SE +/- 0.22, N = 4SE +/- 0.11, N = 4SE +/- 0.07, N = 4SE +/- 0.03, N = 4SE +/- 0.04, N = 4SE +/- 0.39, N = 4SE +/- 0.10, N = 4SE +/- 0.03, N = 4SE +/- 0.02, N = 3SE +/- 0.05, N = 4SE +/- 0.26, N = 4SE +/- 0.09, N = 4SE +/- 0.25, N = 3SE +/- 0.17, N = 4SE +/- 0.02, N = 4SE +/- 0.36, N = 3SE +/- 0.21, N = 3SE +/- 0.17, N = 3SE +/- 0.72, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.36, N = 3SE +/- 0.17, N = 3SE +/- 0.31, N = 3SE +/- 0.60, N = 3SE +/- 0.30, N = 3SE +/- 0.10, N = 3SE +/- 0.14, N = 3SE +/- 0.28, N = 3SE +/- 0.09, N = 3SE +/- 0.37, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.58, N = 3SE +/- 0.19, N = 3SE +/- 0.15, N = 3SE +/- 0.21, N = 3SE +/- 0.22, N = 3SE +/- 0.05, N = 3SE +/- 0.17, N = 3SE +/- 0.14, N = 3SE +/- 0.46, N = 3SE +/- 0.64, N = 3SE +/- 0.79, N = 3SE +/- 0.29, N = 3SE +/- 0.27, N = 2SE +/- 0.51, N = 3SE +/- 0.40, N = 3SE +/- 0.16, N = 3SE +/- 0.63, N = 3SE +/- 0.14, N = 3SE +/- 0.26, N = 3SE +/- 0.46, N = 3SE +/- 0.93, N = 3SE +/- 0.63, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.20, N = 3SE +/- 0.26, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.34, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.20, N = 3SE +/- 0.22, N = 3SE +/- 0.17, N = 2SE +/- 0.15, N = 3SE +/- 0.11, N = 3SE +/- 0.42, N = 3SE +/- 0.19, N = 3SE +/- 0.14, N = 3SE +/- 0.16, N = 3SE +/- 0.34, N = 3SE +/- 0.23, N = 2SE +/- 0.51, N = 3SE +/- 0.05, N = 3SE +/- 0.13, N = 3SE +/- 0.24, N = 3SE +/- 0.51, N = 3SE +/- 0.21, N = 3SE +/- 0.16, N = 3SE +/- 0.11, N = 3SE +/- 0.27, N = 3SE +/- 0.02, N = 3SE +/- 0.32, N = 3SE +/- 0.02, N = 3SE +/- 0.40, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.38, N = 3SE +/- 0.15, N = 3SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.75, N = 3SE +/- 0.19, N = 3SE +/- 0.23, N = 3SE +/- 0.14, N = 3SE +/- 0.29, N = 3SE +/- 0.23, N = 3SE +/- 0.21, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.25, N = 2SE +/- 0.16, N = 3SE +/- 0.41, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.33, N = 3SE +/- 0.08, N = 2SE +/- 0.16, N = 3SE +/- 0.13, N = 2SE +/- 0.06, N = 3SE +/- 0.23, N = 3SE +/- 0.09, N = 311.2911.328.4850.1423.8518.8112.5811.8312.0514.1435.775.1411.8022.7610.3935.1113.7811.815.0912.5426.5733.0017.4635.3610.3212.9217.4635.8711.9118.649.7414.1011.9115.9111.9213.8217.6910.4217.687.178.698.556.549.7612.6619.1010.4918.9322.0026.328.769.7516.978.6313.0216.4813.8413.1014.217.109.199.5551.4818.6414.0333.1912.5113.8213.4413.12118.2811.1919.8027.4915.2544.1411.9148.0816.9910.749.1314.859.1717.1811.017.469.789.0727.1510.217.1616.995.0010.2312.5211.5417.669.9311.2311.639.0248.8823.3819.4012.7611.8411.8314.3335.905.1411.4322.1910.3334.6813.8111.155.0512.1026.9433.7016.7935.4710.4813.4317.5434.6911.9019.339.3813.6012.0416.5712.4813.3617.4110.7517.387.098.448.426.409.8412.4719.0810.0019.5121.9026.288.659.4617.078.7012.8016.3814.7412.5114.327.038.989.8350.3318.1213.7532.6112.8113.9713.7112.71118.0811.1519.7427.0414.5743.4011.9947.1816.6410.799.1514.569.2817.4810.787.5210.009.0127.0710.166.6417.235.0410.2012.3011.4618.0410.121. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 50)Q01Q02Q03Q04Q05Q06Q07Q08Q09Q10Q11Q12Q13Q14Q15Q17Q18Q19Q20Q21Q22Q23Q24Q25Q26Q27Q28Q29Q30Q31Q32Q33Q34Q35Q36Q37Q38Q39Q40Q41Q42Q43Q44Q45Q46Q47Q48Q49Q50Q51Q52Q53Q54Q55Q56Q57Q58Q59Q60Q62Q63Q64Q65Q66Q67Q68Q69Q70Q72Q73Q74Q75Q76Q77Q78Q79Q80Q81Q82Q83Q84Q85Q86Q87Q88Q89Q90Q91Q92Q93Q94Q95Q96Q97Q98Q99Q61Q71100200300400500SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.08, N = 3SE +/- 0.56, N = 3SE +/- 0.56, N = 3SE +/- 0.91, N = 3SE +/- 0.48, N = 3SE +/- 0.44, N = 3SE +/- 0.25, N = 3SE +/- 0.37, N = 3SE +/- 0.28, N = 3SE +/- 0.08, N = 3SE +/- 0.11, N = 3SE +/- 0.35, N = 3SE +/- 0.24, N = 3SE +/- 1.40, N = 3SE +/- 0.20, N = 3SE +/- 0.18, N = 3SE +/- 0.08, N = 3SE +/- 0.26, N = 3SE +/- 0.54, N = 3SE +/- 1.35, N = 3SE +/- 0.49, N = 3SE +/- 1.06, N = 3SE +/- 0.12, N = 3SE +/- 0.47, N = 3SE +/- 0.48, N = 3SE +/- 1.14, N = 3SE +/- 0.32, N = 3SE +/- 0.17, N = 3SE +/- 0.17, N = 3SE +/- 0.40, N = 3SE +/- 0.09, N = 3SE +/- 0.27, N = 3SE +/- 0.71, N = 3SE +/- 0.18, N = 3SE +/- 0.66, N = 3SE +/- 0.36, N = 3SE +/- 0.58, N = 3SE +/- 0.10, N = 3SE +/- 0.30, N = 3SE +/- 0.34, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.27, N = 3SE +/- 0.22, N = 3SE +/- 0.24, N = 3SE +/- 0.37, N = 3SE +/- 0.37, N = 3SE +/- 0.66, N = 3SE +/- 0.36, N = 3SE +/- 0.18, N = 3SE +/- 0.16, N = 3SE +/- 0.23, N = 3SE +/- 0.09, N = 3SE +/- 0.60, N = 3SE +/- 0.54, N = 3SE +/- 0.13, N = 3SE +/- 0.32, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 1.53, N = 3SE +/- 0.84, N = 3SE +/- 0.17, N = 2SE +/- 0.63, N = 3SE +/- 0.18, N = 3SE +/- 0.29, N = 3SE +/- 0.35, N = 3SE +/- 5.27, N = 3SE +/- 0.02, N = 2SE +/- 1.15, N = 3SE +/- 0.38, N = 3SE +/- 0.40, N = 3SE +/- 0.16, N = 3SE +/- 0.64, N = 3SE +/- 0.10, N = 3SE +/- 2.12, N = 3SE +/- 0.42, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.21, N = 3SE +/- 0.28, N = 3SE +/- 0.31, N = 3SE +/- 0.51, N = 3SE +/- 0.85, N = 3SE +/- 0.22, N = 3SE +/- 0.37, N = 3SE +/- 0.18, N = 3SE +/- 0.07, N = 3SE +/- 0.71, N = 3SE +/- 0.33, N = 3SE +/- 0.36, N = 3SE +/- 0.08, N = 3SE +/- 0.27, N = 3SE +/- 0.04, N = 3SE +/- 0.29, N = 3SE +/- 0.39, N = 2SE +/- 1.15, N = 2SE +/- 0.20, N = 3SE +/- 0.09, N = 3SE +/- 0.28, N = 3SE +/- 0.72, N = 3SE +/- 1.08, N = 3SE +/- 0.46, N = 3SE +/- 0.21, N = 3SE +/- 0.26, N = 3SE +/- 0.16, N = 3SE +/- 0.15, N = 3SE +/- 0.53, N = 3SE +/- 0.13, N = 3SE +/- 0.17, N = 3SE +/- 2.04, N = 3SE +/- 0.09, N = 3SE +/- 0.43, N = 3SE +/- 0.21, N = 3SE +/- 0.37, N = 3SE +/- 0.02, N = 3SE +/- 0.34, N = 3SE +/- 0.38, N = 3SE +/- 1.31, N = 3SE +/- 0.08, N = 3SE +/- 0.72, N = 3SE +/- 0.30, N = 3SE +/- 0.39, N = 3SE +/- 0.66, N = 3SE +/- 0.16, N = 3SE +/- 0.07, N = 3SE +/- 0.41, N = 3SE +/- 0.41, N = 3SE +/- 0.37, N = 3SE +/- 0.11, N = 3SE +/- 0.22, N = 3SE +/- 0.63, N = 3SE +/- 0.11, N = 3SE +/- 0.89, N = 3SE +/- 0.36, N = 3SE +/- 0.37, N = 3SE +/- 0.06, N = 3SE +/- 0.34, N = 3SE +/- 0.30, N = 3SE +/- 0.09, N = 3SE +/- 0.28, N = 3SE +/- 0.09, N = 3SE +/- 0.40, N = 3SE +/- 0.32, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.65, N = 3SE +/- 0.10, N = 3SE +/- 0.25, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 0.24, N = 3SE +/- 0.03, N = 3SE +/- 0.28, N = 3SE +/- 0.53, N = 3SE +/- 0.21, N = 3SE +/- 0.27, N = 3SE +/- 0.06, N = 2SE +/- 3.02, N = 3SE +/- 0.48, N = 3SE +/- 0.24, N = 3SE +/- 0.51, N = 3SE +/- 0.47, N = 3SE +/- 0.21, N = 2SE +/- 0.53, N = 3SE +/- 11.04, N = 3SE +/- 0.08, N = 3SE +/- 0.64, N = 3SE +/- 1.20, N = 3SE +/- 0.40, N = 3SE +/- 0.31, N = 3SE +/- 2.63, N = 3SE +/- 0.08, N = 3SE +/- 1.43, N = 3SE +/- 0.16, N = 3SE +/- 0.80, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.47, N = 2SE +/- 0.23, N = 3SE +/- 0.36, N = 3SE +/- 1.14, N = 3SE +/- 0.51, N = 3SE +/- 0.37, N = 3SE +/- 0.27, N = 3SE +/- 0.43, N = 3SE +/- 2.38, N = 3SE +/- 0.44, N = 3SE +/- 0.17, N = 2SE +/- 0.19, N = 3SE +/- 0.11, N = 3SE +/- 0.14, N = 2SE +/- 0.13, N = 3SE +/- 0.13, N = 3SE +/- 0.38, N = 315.8517.5514.18154.3143.1749.0921.5217.2024.1320.16103.285.2719.7875.6617.77119.3520.8718.235.2115.8036.12178.1357.15112.6516.0222.1042.77118.4115.9835.8014.4022.3117.6825.6022.1422.7643.1915.1942.827.3713.5614.177.7413.1522.2933.3416.9740.2750.0859.4613.5915.3637.7713.9320.6724.4424.3824.1123.5912.9715.01170.8542.4220.07106.6121.6820.2823.76445.1116.2997.5259.6020.5024.66145.2921.24154.5315.8640.3113.6311.6819.5912.2344.4236.3017.659.9710.9212.3585.8219.0418.2310.9148.415.1616.267.7022.2715.4117.5814.12153.7843.7447.6720.7217.2724.4620.24101.845.2119.4577.1617.59119.3121.4117.895.2715.8336.66173.1556.78109.5116.2320.6941.62117.3416.0433.5215.2922.0017.9125.0722.3922.7443.4815.1941.437.2813.2513.777.8413.4621.8733.7316.6739.3449.3658.6313.2214.9436.9613.6021.1024.7824.2025.2422.5712.6114.73165.9642.6920.62106.3022.6020.1722.95419.7916.6595.4559.3720.5924.24145.2021.04154.3715.6038.4613.2611.7020.2212.3043.6036.1417.709.8210.7313.1885.1518.9618.1010.1847.085.2616.377.6523.191. (CC) gcc options: -O3 -fcommon -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 100)Q01Q02Q03Q04Q05Q06Q07Q08Q09Q10Q11Q12Q13Q14Q15Q17Q18Q19Q20Q21Q22Q23Q24Q25Q26Q27Q28Q29Q30Q31Q32Q33Q34Q35Q36Q37Q38Q39Q40Q41Q42Q43Q44Q45Q46Q47Q48Q49Q50Q51Q52Q53Q54Q55Q56Q57Q58Q59Q60Q61Q62Q63Q64Q65Q66Q67Q68Q69Q70Q71Q72Q73Q74Q75Q76Q77Q78Q79Q80Q81Q82Q83Q84Q85Q86Q87Q88Q89Q90Q91Q92Q93Q94Q95Q96Q97Q98Q9950100150200250SE +/- 0.05, N = 3SE +/- 0.29, N = 3SE +/- 0.20, N = 3SE +/- 1.16, N = 3SE +/- 0.44, N = 3SE +/- 0.17, N = 3SE +/- 0.64, N = 3SE +/- 0.28, N = 3SE +/- 0.49, N = 3SE +/- 0.08, N = 3SE +/- 0.56, N = 3SE +/- 0.08, N = 3SE +/- 0.50, N = 3SE +/- 2.66, N = 3SE +/- 0.30, N = 3SE +/- 0.40, N = 3SE +/- 0.54, N = 3SE +/- 0.67, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.29, N = 3SE +/- 0.08, N = 3SE +/- 0.74, N = 3SE +/- 0.33, N = 3SE +/- 0.57, N = 3SE +/- 0.26, N = 3SE +/- 2.08, N = 3SE +/- 0.23, N = 3SE +/- 0.28, N = 3SE +/- 0.70, N = 3SE +/- 0.17, N = 3SE +/- 0.45, N = 3SE +/- 0.07, N = 3SE +/- 0.17, N = 3SE +/- 0.49, N = 3SE +/- 0.24, N = 3SE +/- 0.66, N = 3SE +/- 1.30, N = 3SE +/- 0.17, N = 2SE +/- 0.04, N = 3SE +/- 0.15, N = 3SE +/- 0.17, N = 2SE +/- 0.66, N = 3SE +/- 0.16, N = 3SE +/- 0.26, N = 3SE +/- 0.31, N = 3SE +/- 0.17, N = 3SE +/- 0.18, N = 3SE +/- 0.82, N = 3SE +/- 1.20, N = 3SE +/- 0.18, N = 3SE +/- 0.21, N = 3SE +/- 0.19, N = 3SE +/- 0.36, N = 3SE +/- 0.32, N = 3SE +/- 0.74, N = 3SE +/- 0.53, N = 3SE +/- 0.85, N = 3SE +/- 0.71, N = 3SE +/- 0.16, N = 3SE +/- 0.22, N = 3SE +/- 0.33, N = 3SE +/- 2.48, N = 3SE +/- 1.31, N = 3SE +/- 0.44, N = 3SE +/- 1.23, N = 3SE +/- 0.84, N = 3SE +/- 0.33, N = 3SE +/- 0.83, N = 3SE +/- 0.15, N = 3SE +/- 1.63, N = 3SE +/- 0.46, N = 3SE +/- 1.38, N = 3SE +/- 0.98, N = 3SE +/- 0.17, N = 3SE +/- 0.30, N = 3SE +/- 2.62, N = 3SE +/- 0.27, N = 3SE +/- 1.28, N = 3SE +/- 0.23, N = 3SE +/- 0.16, N = 3SE +/- 0.25, N = 3SE +/- 0.03, N = 3SE +/- 0.30, N = 3SE +/- 0.31, N = 3SE +/- 0.15, N = 3SE +/- 1.29, N = 3SE +/- 0.16, N = 3SE +/- 0.43, N = 3SE +/- 0.17, N = 3SE +/- 0.13, N = 3SE +/- 1.70, N = 3SE +/- 0.28, N = 3SE +/- 0.06, N = 3SE +/- 0.19, N = 3SE +/- 0.24, N = 3SE +/- 0.05, N = 3SE +/- 0.64, N = 220.1327.5519.51192.4566.7423.7429.3222.2441.1927.59121.655.2228.19101.6226.1942.9227.8825.575.3220.5760.75223.1239.9941.9720.4428.4668.1747.4719.5151.4922.6529.1723.9536.6031.0420.9967.3822.7724.087.2917.7218.7125.2216.8630.0450.0523.0044.0081.06101.7218.8720.0633.8318.2227.5931.6735.6136.2130.697.5115.6619.93151.3873.3827.68205.5631.3126.7635.1531.44135.0221.92112.4996.4229.1433.67186.0130.33100.2418.7026.0615.7513.5725.2315.5767.9755.6823.2212.1112.2116.24140.1127.9726.6513.5378.075.3422.451. (CC) gcc options: -O3 -fcommon -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 500)Q02Q03Q06Q07Q08Q09Q10Q12Q13Q14Q15Q17Q18Q19Q20Q21Q22Q25Q26Q27Q28Q30Q31Q32Q33Q34Q35Q36Q37Q38Q39Q41Q42Q43Q44Q45Q46Q47Q48Q52Q53Q54Q55Q56Q57Q58Q59Q60Q61Q62Q63Q66Q68Q69Q70Q71Q73Q76Q79Q82Q84Q85Q86Q87Q88Q89Q90Q9220406080100SE +/- 0.07, N = 2SE +/- 0.21, N = 2SE +/- 0.05, N = 2SE +/- 1.17, N = 2SE +/- 0.13, N = 2SE +/- 0.61, N = 2SE +/- 1.72, N = 2SE +/- 0.09, N = 2SE +/- 0.38, N = 2SE +/- 1.32, N = 3SE +/- 0.11, N = 3SE +/- 0.71, N = 3SE +/- 0.23, N = 3SE +/- 0.52, N = 3SE +/- 0.02, N = 2SE +/- 0.28, N = 3SE +/- 0.40, N = 3SE +/- 0.28, N = 3SE +/- 0.61, N = 3SE +/- 0.46, N = 3SE +/- 0.64, N = 3SE +/- 0.06, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 0.28, N = 3SE +/- 0.57, N = 3SE +/- 0.33, N = 3SE +/- 0.18, N = 3SE +/- 0.37, N = 3SE +/- 0.09, N = 3SE +/- 0.25, N = 3SE +/- 0.32, N = 3SE +/- 0.23, N = 3SE +/- 0.37, N = 3SE +/- 0.29, N = 3SE +/- 0.43, N = 3SE +/- 0.27, N = 3SE +/- 0.29, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 2SE +/- 0.34, N = 3SE +/- 0.14, N = 3SE +/- 0.61, N = 3SE +/- 1.31, N = 3SE +/- 1.04, N = 3SE +/- 0.70, N = 3SE +/- 0.17, N = 3SE +/- 0.07, N = 3SE +/- 0.31, N = 3SE +/- 0.43, N = 3SE +/- 0.26, N = 3SE +/- 0.42, N = 3SE +/- 1.37, N = 3SE +/- 0.82, N = 3SE +/- 0.37, N = 3SE +/- 0.72, N = 3SE +/- 0.49, N = 3SE +/- 0.43, N = 3SE +/- 0.08, N = 3SE +/- 0.20, N = 3SE +/- 0.13, N = 3SE +/- 0.70, N = 3SE +/- 0.43, N = 3SE +/- 0.42, N = 3SE +/- 0.31, N = 3SE +/- 0.44, N = 327.9019.4823.6127.8322.6639.8027.695.2328.72100.3626.1143.5527.7325.805.2221.0261.5041.3020.5929.8667.0418.8949.0022.5929.0422.8136.5030.7321.4068.0824.997.3217.6119.2325.0316.9029.8749.4423.1319.1419.9633.9917.9528.0531.6334.2136.0631.177.7115.6119.8627.0830.4826.0835.8830.9121.3028.5930.2726.0213.5524.6015.4068.1953.7023.4612.1016.041. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-H

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Geometric Mean Of All Queries)11.05842.11683.17524.23365.292SE +/- 0.02205715, N = 3SE +/- 0.03832583, N = 84.703943664.58796121

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Comparison (Scale Factor: 1)Geometric Mean Of All QueriesQ01Q02Q03Q04Q05Q06Q07Q08Q09Q10Q11Q12Q13Q14Q15Q16Q17Q18Q19Q20Q21Q2248121620SE +/- 0.02205715, N = 3SE +/- 0.17776740, N = 3SE +/- 0.06585723, N = 3SE +/- 0.17085945, N = 3SE +/- 0.15831346, N = 3SE +/- 0.08288138, N = 3SE +/- 0.06400088, N = 3SE +/- 0.01424190, N = 3SE +/- 0.07990249, N = 3SE +/- 0.03195754, N = 3SE +/- 0.12475642, N = 3SE +/- 0.00889576, N = 3SE +/- 0.07812445, N = 3SE +/- 0.05404231, N = 3SE +/- 0.09844103, N = 3SE +/- 0.01587727, N = 3SE +/- 0.04807800, N = 3SE +/- 0.11188602, N = 3SE +/- 0.02944973, N = 3SE +/- 0.08247514, N = 3SE +/- 0.16740673, N = 3SE +/- 0.45650715, N = 3SE +/- 0.05419067, N = 3SE +/- 0.03832583, N = 8SE +/- 0.10385415, N = 8SE +/- 0.10497115, N = 8SE +/- 0.07160103, N = 8SE +/- 0.15490647, N = 8SE +/- 0.06264325, N = 8SE +/- 0.02204410, N = 8SE +/- 0.12029949, N = 8SE +/- 0.01870892, N = 8SE +/- 0.06360940, N = 8SE +/- 0.08702141, N = 8SE +/- 0.02504461, N = 8SE +/- 0.07037349, N = 8SE +/- 0.02994103, N = 8SE +/- 0.08797017, N = 8SE +/- 0.02096419, N = 8SE +/- 0.04873253, N = 8SE +/- 0.05677966, N = 8SE +/- 0.15655408, N = 8SE +/- 0.04107179, N = 8SE +/- 0.02853109, N = 8SE +/- 0.09251555, N = 8SE +/- 0.40940044, N = 84.703943668.991113985.121564716.219260696.352845996.451014203.144960965.678459015.125953208.098931315.488646352.229465094.411468983.309991523.483763383.733936312.365291437.480081888.852170943.456161104.9555333518.002487182.635502584.587961218.898104675.176648266.013409675.946094636.250915592.872663115.712453195.013944217.734836885.450984962.230567374.261494313.002522233.417816823.521971972.378982937.148795848.634209873.266044204.5986599416.831480503.25603971

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q01)13691215SE +/- 0.17776740, N = 3SE +/- 0.10385415, N = 88.991113988.89810467

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q02)11.16472.32943.49414.65885.8235SE +/- 0.06585723, N = 3SE +/- 0.10497115, N = 85.121564715.17664826

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q03)1246810SE +/- 0.17085945, N = 3SE +/- 0.07160103, N = 86.219260696.01340967

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q04)1246810SE +/- 0.15831346, N = 3SE +/- 0.15490647, N = 86.352845995.94609463

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q05)1246810SE +/- 0.08288138, N = 3SE +/- 0.06264325, N = 86.451014206.25091559

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q06)10.70761.41522.12282.83043.538SE +/- 0.06400088, N = 3SE +/- 0.02204410, N = 83.144960962.87266311

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q07)11.28532.57063.85595.14126.4265SE +/- 0.01424190, N = 3SE +/- 0.12029949, N = 85.678459015.71245319

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q08)11.15332.30663.45994.61325.7665SE +/- 0.07990249, N = 3SE +/- 0.01870892, N = 85.125953205.01394421

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q09)1246810SE +/- 0.03195754, N = 3SE +/- 0.06360940, N = 88.098931317.73483688

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q10)11.23492.46983.70474.93966.1745SE +/- 0.12475642, N = 3SE +/- 0.08702141, N = 85.488646355.45098496

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q11)10.50191.00381.50572.00762.5095SE +/- 0.00889576, N = 3SE +/- 0.02504461, N = 82.229465092.23056737

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q12)10.99261.98522.97783.97044.963SE +/- 0.07812445, N = 3SE +/- 0.07037349, N = 84.411468984.26149431

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q13)10.74471.48942.23412.97883.7235SE +/- 0.05404231, N = 3SE +/- 0.02994103, N = 83.309991523.00252223

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q14)10.78381.56762.35143.13523.919SE +/- 0.09844103, N = 3SE +/- 0.08797017, N = 83.483763383.41781682

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q15)10.84011.68022.52033.36044.2005SE +/- 0.01587727, N = 3SE +/- 0.02096419, N = 83.733936313.52197197

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q16)10.53531.07061.60592.14122.6765SE +/- 0.04807800, N = 3SE +/- 0.04873253, N = 82.365291432.37898293

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q17)1246810SE +/- 0.11188602, N = 3SE +/- 0.05677966, N = 87.480081887.14879584

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q18)1246810SE +/- 0.02944973, N = 3SE +/- 0.15655408, N = 88.852170948.63420987

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q19)10.77761.55522.33283.11043.888SE +/- 0.08247514, N = 3SE +/- 0.04107179, N = 83.456161103.26604420

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q20)11.1152.233.3454.465.575SE +/- 0.16740673, N = 3SE +/- 0.02853109, N = 84.955533354.59865994

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q21)148121620SE +/- 0.46, N = 3SE +/- 0.09, N = 818.0016.83

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q22)10.73261.46522.19782.93043.663SE +/- 0.05419067, N = 3SE +/- 0.40940044, N = 82.635502583.25603971

Scale Factor Comparison

rk1-mainline-emmc: 10: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ./spark-tpch: line 6: echo: write error: No space left on device

rk1-rok-emmc: 10: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ./spark-tpch: line 6: echo: write error: No space left on device

rk1-mainline-emmc: 50: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ./spark-tpch: line 6: echo: write error: No space left on device

rk1-rok-emmc: 50: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ./spark-tpch: line 6: echo: write error: No space left on device

rk1-mainline-emmc: 100: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ./spark-tpch: line 6: echo: write error: No space left on device

rk1-rok-emmc: 100: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ./spark-tpch: line 6: echo: write error: No space left on device

asmFish

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgNodes/second, More Is BetterasmFish 2018-07-23Comparison1024 Hash Memory, 26 Depth2M4M6M8M10MSE +/- 75549.20, N = 6SE +/- 43781.35, N = 3SE +/- 65797.59, N = 9SE +/- 44374.95, N = 3SE +/- 34823.82, N = 375838568005820781721077211592767131

Comparison

pi5-raspbian-nvme: : The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

Build2

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterBuild2 0.15ComparisonTime To Compile2004006008001000SE +/- 1.02, N = 3SE +/- 2.62, N = 3SE +/- 2.22, N = 3SE +/- 3.79, N = 3SE +/- 4.32, N = 3688.05673.85668.87669.641064.90

ClickHouse

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5Comparison100M Rows Hits Dataset, First Run / Cold Cache100M Rows Hits Dataset, Second Run100M Rows Hits Dataset, Third Run1020304050SE +/- 0.56, N = 3SE +/- 0.67, N = 3SE +/- 0.37, N = 3SE +/- 0.29, N = 3SE +/- 0.32, N = 3SE +/- 0.71, N = 343.4546.1545.7238.8341.3741.81

etcd

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 50 - Clients: 100)PUTRANGE4K8K12K16K20KSE +/- 548.13, N = 9SE +/- 162.99, N = 9SE +/- 103.48, N = 3SE +/- 149.49, N = 3SE +/- 580.79, N = 9SE +/- 213.67, N = 9SE +/- 13.84, N = 3SE +/- 170.29, N = 69019.798177.7117919.7417702.599143.018026.1217625.6417733.58

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Connections Comparison (Test: PUT - - Clients: 100)501005004K8K12K16K20KSE +/- 548.13, N = 9SE +/- 78.80, N = 3SE +/- 154.99, N = 9SE +/- 103.48, N = 3SE +/- 121.87, N = 3SE +/- 210.10, N = 3SE +/- 580.79, N = 9SE +/- 59.42, N = 3SE +/- 162.97, N = 9SE +/- 13.84, N = 3SE +/- 230.09, N = 3SE +/- 107.83, N = 39019.797525.007773.6817919.7416623.4016740.459143.017417.327555.4817625.6416034.3316067.27

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 50)10010007K14K21K28K35KSE +/- 548.13, N = 9SE +/- 452.84, N = 9SE +/- 103.48, N = 3SE +/- 166.43, N = 3SE +/- 580.79, N = 9SE +/- 523.12, N = 12SE +/- 13.84, N = 3SE +/- 97.60, N = 39019.7916573.1917919.7432076.419143.0119495.9717625.6430813.77

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 50 - Clients: 100 - Average Latency)PUTRANGE3691215SE +/- 0.57, N = 9SE +/- 0.23, N = 9SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.55, N = 9SE +/- 0.31, N = 9SE +/- 0.00, N = 3SE +/- 0.05, N = 611.312.25.55.611.112.45.65.6

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Connections Comparison (Test: PUT - - Clients: 100 - Average Latency)501005003691215SE +/- 0.57, N = 9SE +/- 0.15, N = 3SE +/- 0.25, N = 9SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.55, N = 9SE +/- 0.12, N = 3SE +/- 0.26, N = 9SE +/- 0.00, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 311.313.212.85.55.95.911.113.413.25.66.26.1

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 50 - - Average Latency)10010001326395265SE +/- 0.57, N = 9SE +/- 1.79, N = 9SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.55, N = 9SE +/- 1.66, N = 12SE +/- 0.00, N = 3SE +/- 0.12, N = 311.359.05.529.911.150.35.630.9

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 50 - Clients: 100)Average Latency3691215SE +/- 0.57, N = 9SE +/- 0.03, N = 3SE +/- 0.55, N = 9SE +/- 0.00, N = 311.35.511.15.6

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 100 - Clients: 100)PUTRANGE4K8K12K16K20KSE +/- 78.80, N = 3SE +/- 43.16, N = 3SE +/- 121.87, N = 3SE +/- 92.45, N = 3SE +/- 59.42, N = 3SE +/- 90.88, N = 3SE +/- 230.09, N = 3SE +/- 51.41, N = 37525.007344.5816623.4016784.837417.327054.6216034.3315796.44

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 100)10010006K12K18K24K30KSE +/- 78.80, N = 3SE +/- 392.03, N = 9SE +/- 121.87, N = 3SE +/- 119.58, N = 3SE +/- 59.42, N = 3SE +/- 530.09, N = 12SE +/- 230.09, N = 3SE +/- 97.95, N = 37525.0015482.1316623.4030106.847417.3219163.3516034.3328950.57

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 100 - Clients: 100 - Average Latency)PUTRANGE48121620SE +/- 0.15, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.15, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 313.213.55.95.913.414.06.26.2

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 100 - - Average Latency)10010001428425670SE +/- 0.15, N = 3SE +/- 1.82, N = 9SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 1.74, N = 12SE +/- 0.09, N = 3SE +/- 0.13, N = 313.263.05.931.713.450.96.232.6

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 100 - Clients: 100)Average Latency3691215SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 313.25.913.46.2

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 50 - Clients: 1000)PUTRANGE7K14K21K28K35KSE +/- 452.84, N = 9SE +/- 428.03, N = 9SE +/- 166.43, N = 3SE +/- 208.41, N = 3SE +/- 523.12, N = 12SE +/- 466.92, N = 12SE +/- 97.60, N = 3SE +/- 55.90, N = 316573.1915862.1232076.4132275.1519495.9718635.5030813.7730789.21

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Connections Comparison (Test: PUT - - Clients: 1000)501005007K14K21K28K35KSE +/- 452.84, N = 9SE +/- 392.03, N = 9SE +/- 131.09, N = 3SE +/- 166.43, N = 3SE +/- 119.58, N = 3SE +/- 6.47, N = 3SE +/- 523.12, N = 12SE +/- 530.09, N = 12SE +/- 178.58, N = 3SE +/- 97.60, N = 3SE +/- 97.95, N = 3SE +/- 76.06, N = 316573.1915482.1313947.8732076.4130106.8422994.3819495.9719163.3516043.0030813.7728950.5721936.54

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 50 - Clients: 1000 - Average Latency)PUTRANGE1428425670SE +/- 1.79, N = 9SE +/- 1.90, N = 9SE +/- 0.18, N = 3SE +/- 0.22, N = 3SE +/- 1.66, N = 12SE +/- 1.59, N = 12SE +/- 0.12, N = 3SE +/- 0.07, N = 359.061.829.929.750.352.630.931.0

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Connections Comparison (Test: PUT - - Clients: 1000 - Average Latency)501005001530456075SE +/- 1.79, N = 9SE +/- 1.82, N = 9SE +/- 0.71, N = 3SE +/- 0.18, N = 3SE +/- 0.12, N = 3SE +/- 0.00, N = 3SE +/- 1.66, N = 12SE +/- 1.74, N = 12SE +/- 0.73, N = 3SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 0.21, N = 359.063.067.829.931.740.650.350.958.730.932.641.9

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 50 - Clients: 1000)Average Latency1326395265SE +/- 1.79, N = 9SE +/- 0.18, N = 3SE +/- 1.66, N = 12SE +/- 0.12, N = 359.029.950.330.9

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 500 - Clients: 100)PUTRANGE4K8K12K16K20KSE +/- 154.99, N = 9SE +/- 186.80, N = 6SE +/- 210.10, N = 3SE +/- 32.79, N = 3SE +/- 162.97, N = 9SE +/- 157.07, N = 9SE +/- 107.83, N = 3SE +/- 51.80, N = 37773.687871.6916740.4516375.197555.487311.1416067.2715844.21

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 500)10010005K10K15K20K25KSE +/- 154.99, N = 9SE +/- 131.09, N = 3SE +/- 210.10, N = 3SE +/- 6.47, N = 3SE +/- 162.97, N = 9SE +/- 178.58, N = 3SE +/- 107.83, N = 3SE +/- 76.06, N = 37773.6813947.8716740.4522994.387555.4816043.0016067.2721936.54

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 500 - Clients: 100 - Average Latency)PUTRANGE3691215SE +/- 0.25, N = 9SE +/- 0.31, N = 6SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.26, N = 9SE +/- 0.26, N = 9SE +/- 0.06, N = 3SE +/- 0.00, N = 312.812.65.96.013.213.66.16.2

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 500 - - Average Latency)10010001530456075SE +/- 0.25, N = 9SE +/- 0.71, N = 3SE +/- 0.06, N = 3SE +/- 0.00, N = 3SE +/- 0.26, N = 9SE +/- 0.73, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 312.867.85.940.613.258.76.141.9

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 500 - Clients: 100)Average Latency3691215SE +/- 0.25, N = 9SE +/- 0.06, N = 3SE +/- 0.26, N = 9SE +/- 0.06, N = 312.85.913.26.1

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 100 - Clients: 1000)PUTRANGE6K12K18K24K30KSE +/- 392.03, N = 9SE +/- 438.82, N = 9SE +/- 119.58, N = 3SE +/- 136.35, N = 3SE +/- 530.09, N = 12SE +/- 414.34, N = 12SE +/- 97.95, N = 3SE +/- 123.00, N = 315482.1315177.0530106.8430214.1019163.3518202.3628950.5728883.95

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 100 - Clients: 1000 - Average Latency)PUTRANGE1428425670SE +/- 1.82, N = 9SE +/- 2.12, N = 9SE +/- 0.12, N = 3SE +/- 0.15, N = 3SE +/- 1.74, N = 12SE +/- 1.57, N = 12SE +/- 0.13, N = 3SE +/- 0.18, N = 363.064.431.731.650.953.532.632.7

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 100 - Clients: 1000)Average Latency1428425670SE +/- 1.82, N = 9SE +/- 0.12, N = 3SE +/- 1.74, N = 12SE +/- 0.13, N = 363.031.750.932.6

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 500 - Clients: 1000)PUTRANGE5K10K15K20K25KSE +/- 131.09, N = 3SE +/- 181.75, N = 3SE +/- 6.47, N = 3SE +/- 44.26, N = 3SE +/- 178.58, N = 3SE +/- 379.06, N = 6SE +/- 76.06, N = 3SE +/- 41.44, N = 313947.8713685.5922994.3822948.3416043.0015827.1221936.5421829.11

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 500 - Clients: 1000 - Average Latency)PUTRANGE1530456075SE +/- 0.71, N = 3SE +/- 0.98, N = 3SE +/- 0.00, N = 3SE +/- 0.12, N = 3SE +/- 0.73, N = 3SE +/- 1.51, N = 6SE +/- 0.21, N = 3SE +/- 0.06, N = 367.869.240.640.758.759.841.942.2

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 500 - Clients: 1000)Average Latency1530456075SE +/- 0.71, N = 3SE +/- 0.00, N = 3SE +/- 0.73, N = 3SE +/- 0.21, N = 367.840.658.741.9

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Connections Comparison (Test: RANGE - - Clients: 100)501005004K8K12K16K20KSE +/- 162.99, N = 9SE +/- 43.16, N = 3SE +/- 186.80, N = 6SE +/- 149.49, N = 3SE +/- 92.45, N = 3SE +/- 32.79, N = 3SE +/- 213.67, N = 9SE +/- 90.88, N = 3SE +/- 157.07, N = 9SE +/- 170.29, N = 6SE +/- 51.41, N = 3SE +/- 51.80, N = 38177.717344.587871.6917702.5916784.8316375.198026.127054.627311.1417733.5815796.4415844.21

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 50)10010007K14K21K28K35KSE +/- 162.99, N = 9SE +/- 428.03, N = 9SE +/- 149.49, N = 3SE +/- 208.41, N = 3SE +/- 213.67, N = 9SE +/- 466.92, N = 12SE +/- 170.29, N = 6SE +/- 55.90, N = 38177.7115862.1217702.5932275.158026.1218635.5017733.5830789.21

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Connections Comparison (Test: RANGE - - Clients: 100 - Average Latency)5010050048121620SE +/- 0.23, N = 9SE +/- 0.09, N = 3SE +/- 0.31, N = 6SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.31, N = 9SE +/- 0.15, N = 3SE +/- 0.26, N = 9SE +/- 0.05, N = 6SE +/- 0.03, N = 3SE +/- 0.00, N = 312.213.512.65.65.96.012.414.013.65.66.26.2

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 50 - - Average Latency)10010001428425670SE +/- 0.23, N = 9SE +/- 1.90, N = 9SE +/- 0.06, N = 3SE +/- 0.22, N = 3SE +/- 0.31, N = 9SE +/- 1.59, N = 12SE +/- 0.05, N = 6SE +/- 0.07, N = 312.261.85.629.712.452.65.631.0

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 50 - Clients: 100)Average Latency3691215SE +/- 0.23, N = 9SE +/- 0.06, N = 3SE +/- 0.31, N = 9SE +/- 0.05, N = 612.25.612.45.6

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 100)10010006K12K18K24K30KSE +/- 43.16, N = 3SE +/- 438.82, N = 9SE +/- 92.45, N = 3SE +/- 136.35, N = 3SE +/- 90.88, N = 3SE +/- 414.34, N = 12SE +/- 51.41, N = 3SE +/- 123.00, N = 37344.5815177.0516784.8330214.107054.6218202.3615796.4428883.95

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 100 - - Average Latency)10010001428425670SE +/- 0.09, N = 3SE +/- 2.12, N = 9SE +/- 0.03, N = 3SE +/- 0.15, N = 3SE +/- 0.15, N = 3SE +/- 1.57, N = 12SE +/- 0.03, N = 3SE +/- 0.18, N = 313.564.45.931.614.053.56.232.7

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 100 - Clients: 100)Average Latency48121620SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 313.55.914.06.2

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Connections Comparison (Test: RANGE - - Clients: 1000)501005007K14K21K28K35KSE +/- 428.03, N = 9SE +/- 438.82, N = 9SE +/- 181.75, N = 3SE +/- 208.41, N = 3SE +/- 136.35, N = 3SE +/- 44.26, N = 3SE +/- 466.92, N = 12SE +/- 414.34, N = 12SE +/- 379.06, N = 6SE +/- 55.90, N = 3SE +/- 123.00, N = 3SE +/- 41.44, N = 315862.1215177.0513685.5932275.1530214.1022948.3418635.5018202.3615827.1230789.2128883.9521829.11

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Connections Comparison (Test: RANGE - - Clients: 1000 - Average Latency)501005001530456075SE +/- 1.90, N = 9SE +/- 2.12, N = 9SE +/- 0.98, N = 3SE +/- 0.22, N = 3SE +/- 0.15, N = 3SE +/- 0.12, N = 3SE +/- 1.59, N = 12SE +/- 1.57, N = 12SE +/- 1.51, N = 6SE +/- 0.07, N = 3SE +/- 0.18, N = 3SE +/- 0.06, N = 361.864.469.229.731.640.752.653.559.831.032.742.2

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 50 - Clients: 1000)Average Latency1428425670SE +/- 1.90, N = 9SE +/- 0.22, N = 3SE +/- 1.59, N = 12SE +/- 0.07, N = 361.829.752.631.0

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 500)10010005K10K15K20K25KSE +/- 186.80, N = 6SE +/- 181.75, N = 3SE +/- 32.79, N = 3SE +/- 44.26, N = 3SE +/- 157.07, N = 9SE +/- 379.06, N = 6SE +/- 51.80, N = 3SE +/- 41.44, N = 37871.6913685.5916375.1922948.347311.1415827.1215844.2121829.11

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 500 - - Average Latency)10010001530456075SE +/- 0.31, N = 6SE +/- 0.98, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.26, N = 9SE +/- 1.51, N = 6SE +/- 0.00, N = 3SE +/- 0.06, N = 312.669.26.040.713.659.86.242.2

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 500 - Clients: 100)Average Latency3691215SE +/- 0.31, N = 6SE +/- 0.03, N = 3SE +/- 0.26, N = 9SE +/- 0.00, N = 312.66.013.66.2

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 100 - Clients: 1000)Average Latency1428425670SE +/- 2.12, N = 9SE +/- 0.15, N = 3SE +/- 1.57, N = 12SE +/- 0.18, N = 364.431.653.532.7

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 500 - Clients: 1000)Average Latency1530456075SE +/- 0.98, N = 3SE +/- 0.12, N = 3SE +/- 1.51, N = 6SE +/- 0.06, N = 369.240.759.842.2

FLAC Audio Encoding

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterFLAC Audio Encoding 1.4ComparisonWAV To FLAC20406080100SE +/- 0.33, N = 25SE +/- 0.14, N = 5SE +/- 0.55, N = 25SE +/- 0.02, N = 5SE +/- 0.45, N = 554.3145.3351.6043.5190.291. (CXX) g++ options: -O3 -fvisibility=hidden -logg -lm

LAME MP3 Encoding

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterLAME MP3 Encoding 3.100ComparisonWAV To MP3612182430SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 313.0512.5011.8911.9624.371. (CC) gcc options: -O3 -ffast-math -funroll-loops -fschedule-insns2 -fbranch-count-reg -fforce-addr -pipe -lncurses -lm

LeelaChessZero

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend ComparisonBLAS246810SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.11, N = 9SE +/- 0.00, N = 3SE +/- 0.00, N = 35566711. (CXX) g++ options: -flto -pthread

LevelDB

rk1-mainline-emmcrk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgMicroseconds Per Op, Fewer Is BetterLevelDB 1.23Benchmark ComparisonHot ReadFill SyncOverwriteRandom FillRandom ReadSeek RandomRandom DeleteSequential Fill8001600240032004000SE +/- 0.032, N = 3SE +/- 124.904, N = 15SE +/- 0.512, N = 15SE +/- 0.486, N = 10SE +/- 0.043, N = 3SE +/- 0.148, N = 15SE +/- 0.132, N = 3SE +/- 0.405, N = 3SE +/- 0.014, N = 3SE +/- 80.483, N = 15SE +/- 1.898, N = 5SE +/- 0.770, N = 3SE +/- 0.015, N = 3SE +/- 0.013, N = 3SE +/- 1.094, N = 3SE +/- 0.648, N = 3SE +/- 0.015, N = 3SE +/- 9.836, N = 3SE +/- 0.482, N = 3SE +/- 1.262, N = 3SE +/- 0.015, N = 3SE +/- 0.008, N = 3SE +/- 0.861, N = 3SE +/- 0.569, N = 34.5933015.64662.01361.5504.6066.37655.52759.0314.5203224.474156.267153.4934.4976.275142.858149.8534.5173817.429149.216150.3524.5026.273139.647147.1511. (CXX) g++ options: -fno-exceptions -fno-rtti -O3 -lgmock -lgtest -lsnappy

Benchmark Comparison

rk1-mainline-nvme: Hot Read: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result. E: ./leveldb: 3: ./db_bench: not found

rk1-mainline-nvme: Fill Sync: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result. E: ./leveldb: 3: ./db_bench: not found

rk1-mainline-nvme: Overwrite: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result. E: ./leveldb: 3: ./db_bench: not found

rk1-mainline-nvme: Random Fill: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result. E: ./leveldb: 3: ./db_bench: not found

rk1-mainline-nvme: Random Read: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result. E: ./leveldb: 3: ./db_bench: not found

rk1-mainline-nvme: Seek Random: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result. E: ./leveldb: 3: ./db_bench: not found

rk1-mainline-nvme: Random Delete: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result. E: ./leveldb: 3: ./db_bench: not found

rk1-mainline-nvme: Sequential Fill: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result. E: ./leveldb: 3: ./db_bench: not found

rk1-mainline-emmcrk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgMB/s, More Is BetterLevelDB 1.23Benchmark ComparisonFill SyncOverwriteRandom FillSequential Fill48121620SE +/- 0.01, N = 15SE +/- 0.11, N = 15SE +/- 0.11, N = 10SE +/- 0.12, N = 3SE +/- 0.01, N = 15SE +/- 0.06, N = 5SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 30.314.214.315.00.35.55.65.80.25.85.86.01. (CXX) g++ options: -fno-exceptions -fno-rtti -O3 -lgmock -lgtest -lsnappy

m-queens

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is Betterm-queens 1.2ComparisonTime To Solve120240360480600SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.33, N = 3216.46206.45206.26206.40316.59567.491. (CXX) g++ options: -fopenmp -O2 -march=native

Monkey Audio Encoding

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterMonkey Audio Encoding 3.99.6ComparisonWAV To APE1122334455SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.66, N = 2520.2819.4818.5718.6746.561. (CXX) g++ options: -O3 -pedantic -rdynamic -lrt

N-Queens

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterN-Queens 1.0ComparisonElapsed Time20406080100SE +/- 0.70, N = 15SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 359.4855.7656.1856.2463.00109.661. (CC) gcc options: -static -fopenmp -O3 -march=native

Opus Codec Encoding

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterOpus Codec Encoding 1.4ComparisonWAV To Opus Encode306090120150SE +/- 0.17, N = 5SE +/- 0.02, N = 5SE +/- 0.31, N = 5SE +/- 0.02, N = 5SE +/- 0.17, N = 571.5067.6265.4564.44129.791. (CXX) g++ options: -O3 -fvisibility=hidden -logg -lm

SQLite

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies Comparison1816243240SE +/- 0.28, N = 15SE +/- 0.11, N = 3SE +/- 0.35, N = 3SE +/- 0.04, N = 336.0731.2836.3033.271. (CC) gcc options: -O2 -lreadline -ltermcap -lz -lm

Stargate Digital Audio Workstation

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate Comparison (Buffer Size: 512)44100960001920004800000.17930.35860.53790.71720.8965SE +/- 0.000792, N = 3SE +/- 0.000635, N = 3SE +/- 0.000865, N = 3SE +/- 0.000670, N = 3SE +/- 0.000393, N = 3SE +/- 0.000167, N = 3SE +/- 0.000291, N = 3SE +/- 0.000207, N = 3SE +/- 0.006662, N = 12SE +/- 0.000630, N = 3SE +/- 0.000095, N = 3SE +/- 0.006668, N = 12SE +/- 0.010750, N = 3SE +/- 0.000529, N = 3SE +/- 0.000288, N = 3SE +/- 0.003804, N = 3SE +/- 0.000267, N = 3SE +/- 0.000135, N = 3SE +/- 0.000076, N = 3SE +/- 0.000305, N = 30.7757920.5491470.3643850.7437710.7970650.5633470.3732820.7642510.7762970.5912680.3928780.7477070.7705080.5902210.3917290.7620930.3355090.2255670.1451090.3218431. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Buffer Size Comparison (Sample Rate: 44100)51210240.18480.36960.55440.73920.924SE +/- 0.000792, N = 3SE +/- 0.000604, N = 3SE +/- 0.000393, N = 3SE +/- 0.000098, N = 3SE +/- 0.006662, N = 12SE +/- 0.000730, N = 3SE +/- 0.010750, N = 3SE +/- 0.000258, N = 3SE +/- 0.000267, N = 3SE +/- 0.000223, N = 30.7757920.7972600.7970650.8213730.7762970.8005280.7705080.8000440.3355090.3624481. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Buffer Size Comparison (Sample Rate: 96000)51210240.1330.2660.3990.5320.665SE +/- 0.000635, N = 3SE +/- 0.000339, N = 3SE +/- 0.000167, N = 3SE +/- 0.000195, N = 3SE +/- 0.000630, N = 3SE +/- 0.003479, N = 3SE +/- 0.000529, N = 3SE +/- 0.005146, N = 9SE +/- 0.000135, N = 3SE +/- 0.000279, N = 30.5491470.5708350.5633470.5852210.5912680.5586620.5902210.5763900.2255670.2521971. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Buffer Size Comparison (Sample Rate: 192000)51210240.08870.17740.26610.35480.4435SE +/- 0.000865, N = 3SE +/- 0.000191, N = 3SE +/- 0.000291, N = 3SE +/- 0.000285, N = 3SE +/- 0.000095, N = 3SE +/- 0.003917, N = 3SE +/- 0.000288, N = 3SE +/- 0.000760, N = 3SE +/- 0.000076, N = 3SE +/- 0.000090, N = 30.3643850.3815700.3732820.3907500.3928780.3911850.3917290.3942900.1451090.1666061. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate Comparison (Buffer Size: 1024)44100960001920004800000.18480.36960.55440.73920.924SE +/- 0.000604, N = 3SE +/- 0.000339, N = 3SE +/- 0.000191, N = 3SE +/- 0.000798, N = 3SE +/- 0.000098, N = 3SE +/- 0.000195, N = 3SE +/- 0.000285, N = 3SE +/- 0.001050, N = 3SE +/- 0.000730, N = 3SE +/- 0.003479, N = 3SE +/- 0.003917, N = 3SE +/- 0.000633, N = 3SE +/- 0.000258, N = 3SE +/- 0.005146, N = 9SE +/- 0.000760, N = 3SE +/- 0.000443, N = 3SE +/- 0.000223, N = 3SE +/- 0.000279, N = 3SE +/- 0.000090, N = 3SE +/- 0.000131, N = 30.7972600.5708350.3815700.7656160.8213730.5852210.3907500.7859610.8005280.5586620.3911850.7678290.8000440.5763900.3942900.7668230.3624480.2521970.1666060.3481211. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Buffer Size Comparison (Sample Rate: 480000)51210240.17680.35360.53040.70720.884SE +/- 0.000670, N = 3SE +/- 0.000798, N = 3SE +/- 0.000207, N = 3SE +/- 0.001050, N = 3SE +/- 0.006668, N = 12SE +/- 0.000633, N = 3SE +/- 0.003804, N = 3SE +/- 0.000443, N = 3SE +/- 0.000305, N = 3SE +/- 0.000131, N = 30.7437710.7656160.7642510.7859610.7477070.7678290.7620930.7668230.3218430.3481211. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stockfish

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 15ComparisonTotal Time1.1M2.2M3.3M4.4M5.5MSE +/- 385132.57, N = 9SE +/- 121318.23, N = 9SE +/- 138882.38, N = 7SE +/- 88074.41, N = 9SE +/- 38968.66, N = 9SE +/- 21647.79, N = 95271840487374748637654326446311657211366601. (CXX) g++ options: -lgcov -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -flto -flto=jobserver

Timed Apache Compilation

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Apache Compilation 2.4.41ComparisonTime To Compile50100150200250SE +/- 0.16, N = 3SE +/- 0.22, N = 3SE +/- 0.26, N = 3SE +/- 0.38, N = 3SE +/- 0.37, N = 3SE +/- 0.49, N = 360.6359.3259.1659.7677.31223.03

Timed CPython Compilation

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed CPython Compilation 3.10.6Build Configuration ComparisonDefaultReleased Build, PGO + LTO Optimized200400600800100066.13784.3059.76744.6060.52764.7261.47783.8793.78862.02

Timed Eigen Compilation

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Eigen Compilation 3.3.9ComparisonTime To Compile4080120160200SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 2.34, N = 3SE +/- 1.77, N = 3SE +/- 0.03, N = 3173.21166.90192.10202.51166.00

Timed Erlang/OTP Compilation

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Erlang/OTP Compilation 25.0ComparisonTime To Compile90180270360450SE +/- 0.61, N = 3SE +/- 0.12, N = 3SE +/- 0.77, N = 3SE +/- 0.74, N = 3SE +/- 0.17, N = 3310.70298.12301.84330.42405.21

Timed FFmpeg Compilation

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.1ComparisonTime To Compile2004006008001000SE +/- 0.50, N = 3SE +/- 0.58, N = 3SE +/- 0.84, N = 3SE +/- 0.36, N = 3SE +/- 0.09, N = 3SE +/- 1.65, N = 3209.95200.28196.60194.15349.94971.00

Timed GCC Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed GCC Compilation 13.2ComparisonTime To Compile9001800270036004500SE +/- 12.28, N = 34406.83

Comparison

rk1-mainline-emmc: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status.

rk1-mainline-nvme: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status.

rk1-rok-emmc: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status.

pi5-raspbian-nvme: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: collect2: fatal error: ld terminated with signal 9 [Killed]

pi4-raspbian-sd: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status.

Timed GDB GNU Debugger Compilation

rk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed GDB GNU Debugger Compilation 10.2ComparisonTime To Compile90180270360450SE +/- 1.39, N = 3SE +/- 1.63, N = 3249.25393.65

Comparison

rk1-mainline-emmc: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: gdb-10.2/missing: 81: makeinfo: not found

rk1-mainline-nvme: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: gdb-10.2/missing: 81: makeinfo: not found

rk1-rok-emmc: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: gdb-10.2/missing: 81: makeinfo: not found

pi4-raspbian-sd: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: gdb-10.2/missing: 81: makeinfo: not found

Timed Gem5 Compilation

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 23.0.1ComparisonTime To Compile5001000150020002500SE +/- 3.08, N = 3SE +/- 0.90, N = 3SE +/- 2.55, N = 3SE +/- 0.96, N = 32329.032257.242222.422220.18

Comparison

pi5-raspbian-nvme: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: g++: fatal error: Killed signal terminated program cc1plus

Timed Godot Game Engine Compilation

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 4.0ComparisonTime To Compile8001600240032004000SE +/- 7.67, N = 3SE +/- 4.62, N = 3SE +/- 4.83, N = 3SE +/- 6.78, N = 3SE +/- 3.05, N = 31922.641852.591835.921844.363498.30

Timed ImageMagick Compilation

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed ImageMagick Compilation 6.9.0ComparisonTime To Compile50100150200250SE +/- 0.66, N = 3SE +/- 0.50, N = 3SE +/- 0.41, N = 3SE +/- 0.43, N = 3SE +/- 0.49, N = 3120.10115.09114.08112.86211.59

Timed Linux Kernel Compilation

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build Comparisondefconfigallmodconfig2K4K6K8K10KSE +/- 1.10, N = 3SE +/- 4.42, N = 3SE +/- 1.28, N = 3SE +/- 1.62, N = 3SE +/- 5.72, N = 3SE +/- 1.83, N = 3SE +/- 2.04, N = 3SE +/- 2.80, N = 3SE +/- 9.15, N = 3SE +/- 14.83, N = 31199.615759.511160.505536.031138.205375.951131.975371.021904.559463.57

Timed LLVM Compilation

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System ComparisonNinjaUnix Makefiles8001600240032004000SE +/- 5.47, N = 3SE +/- 5.63, N = 3SE +/- 1.73, N = 3SE +/- 3.39, N = 3SE +/- 3.31, N = 3SE +/- 6.63, N = 3SE +/- 1.23, N = 3SE +/- 2.47, N = 33662.543722.373524.423577.043480.733524.743468.303511.13

Build System Comparison

pi5-raspbian-nvme: Ninja: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status.

pi5-raspbian-nvme: Unix Makefiles: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: c++: fatal error: Killed signal terminated program cc1plus

Timed Mesa Compilation

Comparison

rk1-mainline-emmc: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ninja: error: loading 'build.ninja': No such file or directory

rk1-mainline-nvme: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ninja: error: loading 'build.ninja': No such file or directory

rk1-rok-emmc: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ninja: error: loading 'build.ninja': No such file or directory

rk1-rok-nvme: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ninja: error: loading 'build.ninja': No such file or directory

pi5-raspbian-nvme: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ninja: error: loading 'build.ninja': No such file or directory

Timed MPlayer Compilation

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed MPlayer Compilation 1.5ComparisonTime To Compile60120180240300SE +/- 0.66, N = 3SE +/- 1.17, N = 3SE +/- 1.75, N = 3SE +/- 1.68, N = 3SE +/- 0.06, N = 3158.06152.52148.87150.11254.69

Timed Node.js Compilation

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 19.8.1ComparisonTime To Compile7001400210028003500SE +/- 2.91, N = 3SE +/- 1.20, N = 3SE +/- 3.73, N = 3SE +/- 0.29, N = 33378.823261.913289.073283.24

Comparison

pi5-raspbian-nvme: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: g++: fatal error: Killed signal terminated program cc1plus

Timed PHP Compilation

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed PHP Compilation 8.1.9ComparisonTime To Compile110220330440550SE +/- 4.51, N = 3SE +/- 1.19, N = 3SE +/- 2.82, N = 3SE +/- 2.08, N = 3SE +/- 1.64, N = 3364.44334.21346.68343.16519.40

Timed Wasmer Compilation

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Wasmer Compilation 2.3ComparisonTime To Compile80160240320400SE +/- 0.59, N = 3SE +/- 0.10, N = 3SE +/- 1.67, N = 3SE +/- 1.65, N = 3SE +/- 0.79, N = 3215.92204.89198.46188.16372.861. (CC) gcc options: -ldl -lgcc_s -lutil -lrt -lpthread -lm -lc -pie -nodefaultlibs

TSCP

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgNodes Per Second, More Is BetterTSCP 1.81ComparisonAI Chess Performance200K400K600K800K1000KSE +/- 370.48, N = 5SE +/- 1140.25, N = 5SE +/- 238.60, N = 5SE +/- 239.20, N = 5SE +/- 350.28, N = 5SE +/- 463.49, N = 57385077724868109218121178877794454711. (CC) gcc options: -O3 -march=native

WavPack Audio Encoding

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcpi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterWavPack Audio Encoding 5.3ComparisonWAV To WavPack4080120160200SE +/- 0.07, N = 5SE +/- 0.13, N = 5SE +/- 0.05, N = 5SE +/- 0.08, N = 5104.0499.6294.62188.001. (CXX) g++ options: -rdynamic

293 Results Shown

Apache CouchDB:
  1000 - 30)
  100 - - 30)
  100 - 1000)
  3000 - 30)
  100 - 3000)
  300 - - 30)
  300 - 1000)
  300 - 3000)
  500 - - 30)
  500 - 1000)
  500 - 3000)
  100 - SHA-512 Benchmark Time)
  1000000 - - SHA-512 Benchmark Time)
  1000000 - 100)
  100 - Calculate Pi Benchmark)
  1000000 - - Calculate Pi Benchmark)
  100 - Calculate Pi Benchmark Using Dataframe)
  1000000 - - Calculate Pi Benchmark Using Dataframe)
  100 - Group By Test Time)
  1000000 - - Group By Test Time)
  100 - Repartition Test Time)
  1000000 - - Repartition Test Time)
  100 - Inner Join Test Time)
  1000000 - - Inner Join Test Time)
  100 - Broadcast Inner Join Test Time)
  1000000 - - Broadcast Inner Join Test Time)
  500 - SHA-512 Benchmark Time)
  1000000 - 500)
  500 - Calculate Pi Benchmark)
  500 - Calculate Pi Benchmark Using Dataframe)
  500 - Group By Test Time)
  500 - Repartition Test Time)
  500 - Inner Join Test Time)
  500 - Broadcast Inner Join Test Time)
  1000 - SHA-512 Benchmark Time)
  1000000 - 1000)
  1000 - Calculate Pi Benchmark)
  1000 - Calculate Pi Benchmark Using Dataframe)
  1000 - Group By Test Time)
  1000 - Repartition Test Time)
  1000 - Inner Join Test Time)
  1000 - Broadcast Inner Join Test Time)
  2000 - SHA-512 Benchmark Time)
  1000000 - 2000)
  2000 - Calculate Pi Benchmark)
  2000 - Calculate Pi Benchmark Using Dataframe)
  2000 - Group By Test Time)
  2000 - Repartition Test Time)
  2000 - Inner Join Test Time)
  2000 - Broadcast Inner Join Test Time)
  10000000 - - SHA-512 Benchmark Time)
  10000000 - 100)
  10000000 - - Calculate Pi Benchmark)
  10000000 - - Calculate Pi Benchmark Using Dataframe)
  10000000 - - Group By Test Time)
  10000000 - - Repartition Test Time)
  10000000 - - Inner Join Test Time)
  10000000 - - Broadcast Inner Join Test Time)
  10000000 - 500)
  20000000 - - SHA-512 Benchmark Time)
  20000000 - 100)
  20000000 - - Calculate Pi Benchmark)
  20000000 - - Calculate Pi Benchmark Using Dataframe)
  20000000 - - Group By Test Time)
  20000000 - - Repartition Test Time)
  20000000 - - Inner Join Test Time)
  20000000 - - Broadcast Inner Join Test Time)
  20000000 - 500)
  40000000 - - SHA-512 Benchmark Time)
  40000000 - 100)
  40000000 - - Calculate Pi Benchmark)
  40000000 - - Calculate Pi Benchmark Using Dataframe)
  40000000 - 500)
  10000000 - 1000)
  10000000 - 2000)
  20000000 - 1000)
  20000000 - 2000)
  40000000 - 1000)
  40000000 - 2000)
  40000000 - - Group By Test Time)
  40000000 - - Repartition Test Time)
  40000000 - - Inner Join Test Time)
  40000000 - - Broadcast Inner Join Test Time)
  Scale Factor Comparison (Q01)
  1)
  Scale Factor Comparison (Q02)
  Scale Factor Comparison (Q03)
  Scale Factor Comparison (Q04)
  Scale Factor Comparison (Q05)
  Scale Factor Comparison (Q06)
  Scale Factor Comparison (Q07)
  Scale Factor Comparison (Q08)
  Scale Factor Comparison (Q09)
  Scale Factor Comparison (Q10)
  Scale Factor Comparison (Q11)
  Scale Factor Comparison (Q12)
  Scale Factor Comparison (Q13)
  Scale Factor Comparison (Q14)
  Scale Factor Comparison (Q15)
  Scale Factor Comparison (Q16)
  Scale Factor Comparison (Q17)
  Scale Factor Comparison (Q18)
  Scale Factor Comparison (Q19)
  Scale Factor Comparison (Q20)
  Scale Factor Comparison (Q21)
  Scale Factor Comparison (Q22)
  Scale Factor Comparison (Q23)
  Scale Factor Comparison (Q24)
  Scale Factor Comparison (Q25)
  Scale Factor Comparison (Q26)
  Scale Factor Comparison (Q27)
  Scale Factor Comparison (Q28)
  Scale Factor Comparison (Q29)
  Scale Factor Comparison (Q30)
  Scale Factor Comparison (Q31)
  Scale Factor Comparison (Q32)
  Scale Factor Comparison (Q33)
  Scale Factor Comparison (Q34)
  Scale Factor Comparison (Q35)
  Scale Factor Comparison (Q36)
  Scale Factor Comparison (Q37)
  Scale Factor Comparison (Q38)
  Scale Factor Comparison (Q39)
  Scale Factor Comparison (Q40)
  Scale Factor Comparison (Q41)
  Scale Factor Comparison (Q42)
  Scale Factor Comparison (Q43)
  Scale Factor Comparison (Q44)
  Scale Factor Comparison (Q45)
  Scale Factor Comparison (Q46)
  Scale Factor Comparison (Q47)
  Scale Factor Comparison (Q48)
  Scale Factor Comparison (Q49)
  Scale Factor Comparison (Q50)
  Scale Factor Comparison (Q51)
  Scale Factor Comparison (Q52)
  Scale Factor Comparison (Q53)
  Scale Factor Comparison (Q54)
  Scale Factor Comparison (Q55)
  Scale Factor Comparison (Q56)
  Scale Factor Comparison (Q57)
  Scale Factor Comparison (Q58)
  Scale Factor Comparison (Q60)
  Scale Factor Comparison (Q61)
  Scale Factor Comparison (Q62)
  Scale Factor Comparison (Q63)
  Scale Factor Comparison (Q64)
  Scale Factor Comparison (Q65)
  Scale Factor Comparison (Q66)
  Scale Factor Comparison (Q67)
  Scale Factor Comparison (Q68)
  Scale Factor Comparison (Q69)
  Scale Factor Comparison (Q70)
  Scale Factor Comparison (Q71)
  Scale Factor Comparison (Q72)
  Scale Factor Comparison (Q73)
  Scale Factor Comparison (Q74)
  Scale Factor Comparison (Q75)
  Scale Factor Comparison (Q76)
  Scale Factor Comparison (Q77)
  Scale Factor Comparison (Q78)
  Scale Factor Comparison (Q79)
  Scale Factor Comparison (Q80)
  Scale Factor Comparison (Q81)
  Scale Factor Comparison (Q82)
  Scale Factor Comparison (Q83)
  Scale Factor Comparison (Q84)
  Scale Factor Comparison (Q85)
  Scale Factor Comparison (Q86)
  Scale Factor Comparison (Q87)
  Scale Factor Comparison (Q88)
  Scale Factor Comparison (Q89)
  Scale Factor Comparison (Q90)
  Scale Factor Comparison (Q91)
  Scale Factor Comparison (Q92)
  Scale Factor Comparison (Q94)
  Scale Factor Comparison (Q95)
  Scale Factor Comparison (Q96)
  Scale Factor Comparison (Q97)
  Scale Factor Comparison (Q59)
  Scale Factor Comparison (Q93)
  Scale Factor Comparison (Q98)
  Scale Factor Comparison (Q99)
  10)
  50)
  100)
  500)
  Scale Factor Comparison (Geometric Mean Of All Queries)
  1)
  Scale Factor Comparison (Q01)
  Scale Factor Comparison (Q02)
  Scale Factor Comparison (Q03)
  Scale Factor Comparison (Q04)
  Scale Factor Comparison (Q05)
  Scale Factor Comparison (Q06)
  Scale Factor Comparison (Q07)
  Scale Factor Comparison (Q08)
  Scale Factor Comparison (Q09)
  Scale Factor Comparison (Q10)
  Scale Factor Comparison (Q11)
  Scale Factor Comparison (Q12)
  Scale Factor Comparison (Q13)
  Scale Factor Comparison (Q14)
  Scale Factor Comparison (Q15)
  Scale Factor Comparison (Q16)
  Scale Factor Comparison (Q17)
  Scale Factor Comparison (Q18)
  Scale Factor Comparison (Q19)
  Scale Factor Comparison (Q20)
  Scale Factor Comparison (Q21)
  Scale Factor Comparison (Q22)
  Comparison
  Comparison
  Comparison
  50 - 100)
  PUT - - 100)
  PUT - 50)
  50 - 100 - Average Latency)
  PUT - - 100 - Average Latency)
  PUT - 50 - - Average Latency)
  PUT - 50 - 100)
  100 - 100)
  PUT - 100)
  100 - 100 - Average Latency)
  PUT - 100 - - Average Latency)
  PUT - 100 - 100)
  50 - 1000)
  PUT - - 1000)
  50 - 1000 - Average Latency)
  PUT - - 1000 - Average Latency)
  PUT - 50 - 1000)
  500 - 100)
  PUT - 500)
  500 - 100 - Average Latency)
  PUT - 500 - - Average Latency)
  PUT - 500 - 100)
  100 - 1000)
  100 - 1000 - Average Latency)
  PUT - 100 - 1000)
  500 - 1000)
  500 - 1000 - Average Latency)
  PUT - 500 - 1000)
  RANGE - - 100)
  RANGE - 50)
  RANGE - - 100 - Average Latency)
  RANGE - 50 - - Average Latency)
  RANGE - 50 - 100)
  RANGE - 100)
  RANGE - 100 - - Average Latency)
  RANGE - 100 - 100)
  RANGE - - 1000)
  RANGE - - 1000 - Average Latency)
  RANGE - 50 - 1000)
  RANGE - 500)
  RANGE - 500 - - Average Latency)
  RANGE - 500 - 100)
  RANGE - 100 - 1000)
  RANGE - 500 - 1000)
  Comparison
  Comparison
  Backend Comparison
  Benchmark Comparison
  Benchmark Comparison
  Comparison
  Comparison
  Comparison
  Comparison
  Threads / Copies Comparison
  512)
  44100)
  96000)
  192000)
  1024)
  480000)
  Comparison
  Comparison
  Build Configuration Comparison
  Comparison
  Comparison
  Comparison
  Comparison
  Comparison
  Comparison
  Comparison
  Comparison
  Build Comparison
  Build System Comparison
  Comparison
  Comparison
  Comparison
  Comparison
  Comparison
  Comparison