rk1-mainline-emmc-run, rk1-mainline-nvme, rok1, pi5-compilation, pi4-raspbian-sd

rk1-mainline-emmc testing on Ubuntu 22.04 via the Phoronix Test Suite.

rk1-mainline-nvme: rk1-mainline-nvme testing on Ubuntu 22.04 via the Phoronix Test Suite.

rok1: Rockchip ARMv8 Cortex-A76 testing with a Turing Machines RK1 and rockchipdrmfb on Ubuntu 22.04 via the Phoronix Test Suite.

pi5-compilation: ARMv8 Cortex-A76 testing on Debian 12 via the Phoronix Test Suite.

pi4-raspbian-sd: ARMv8 Cortex-A72 testing on Debian 12 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2405141-NE-RK1EMMCCO86
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Transpose Comparison
Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
rk1-mainline-emmc
February 25
  5 Days, 12 Hours, 44 Minutes
rk1-mainline-nvme
February 25
 
rk1-rok-emmc
February 25
  5 Days, 12 Hours, 20 Minutes
rk1-rok-nvme
March 11
 
pi5-raspbian-nvme
February 25
  1 Day, 6 Hours, 29 Minutes
pi4-raspbian-sd
February 25
  10 Hours, 57 Minutes
Invert Behavior (Only Show Selected Data)
 

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


rk1-mainline-emmc-run, rk1-mainline-nvme, rok1, pi5-compilation, pi4-raspbian-sdProcessorMotherboardMemoryDiskGraphicsNetworkChipsetOSKernelVulkanCompilerFile-SystemScreen ResolutionDisplay Serverrk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdrk1-mainline-emmc @ 1.80GHz (4 Cores / 8 Threads)Turing Machines RK132GB1000GB CT1000P3PSSD8 + 31GB BJTD4RUbuntu 22.046.7.0 (aarch64)1.3.255GCC 11.4.0ext4rk1-mainline-nvme @ 1.80GHz (4 Cores / 8 Threads)500GB CT500P3SSD8 + 31GB BJTD4Rrk1-rok-emmc @ 1.80GHz (4 Cores / 8 Threads)rockchipdrmfb5.10.160-rockchip (aarch64)1920x1080Rockchip ARMv8 Cortex-A76 @ 1.80GHz (4 Cores / 8 Threads)ARMv8 Cortex-A76 @ 2.40GHz (4 Cores)Raspberry Pi 5 Model B Rev 1.04096MB500GB CT500P3SSD8Device 1de4:0001Debian 126.1.0-rpi7-rpi-2712 (aarch64)GCC 12.2.0ARMv8 Cortex-A72 @ 1.80GHz (4 Cores)BCM2835 Raspberry Pi 400 Rev 1.0Broadcom BCM271164GB SR64G6.1.0-rpi6-rpi-v8 (aarch64)X ServerOpenBenchmarking.orgKernel Details- rk1-mainline-emmc: Transparent Huge Pages: madvise- rk1-mainline-nvme: Transparent Huge Pages: madvise- pi4-raspbian-sd: snd_bcm2835.enable_headphones=0 snd_bcm2835.enable_hdmi=1 snd_bcm2835.enable_hdmi=0 cfg80211.ieee80211_regdom=USCompiler Details- rk1-mainline-emmc: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - rk1-mainline-nvme: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - rk1-rok-emmc: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - rk1-rok-nvme: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - pi5-raspbian-nvme: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - pi4-raspbian-sd: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v Processor Details- rk1-mainline-emmc: Scaling Governor: rockchip-cpufreq ondemand- rk1-mainline-nvme: Scaling Governor: rockchip-cpufreq performance- rk1-rok-emmc: Scaling Governor: cpufreq-dt performance- rk1-rok-nvme: Scaling Governor: cpufreq-dt performance- pi5-raspbian-nvme: Scaling Governor: cpufreq-dt ondemand- pi4-raspbian-sd: Scaling Governor: cpufreq-dt ondemandPython Details- rk1-mainline-emmc: Python 3.10.12- rk1-mainline-nvme: Python 3.10.12- rk1-rok-emmc: Python 3.10.12- rk1-rok-nvme: Python 3.10.12- pi5-raspbian-nvme: Python 3.11.2- pi4-raspbian-sd: Python 3.11.2Security Details- rk1-mainline-emmc: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - rk1-mainline-nvme: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - rk1-rok-emmc: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - rk1-rok-nvme: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - pi5-raspbian-nvme: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected - pi4-raspbian-sd: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable + srbds: Not affected + tsx_async_abort: Not affected

rk1-mainline-emmc-run, rk1-mainline-nvme, rok1, pi5-compilation, pi4-raspbian-sdspark-tpcds: 3000rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.org

Apache Spark TPC-DS

This is a benchmark of Apache Spark using the TPC-DS data-set. Apache Spark is an open-source unified analytics engine for large-scale data processing and dealing with big data. This test profile benchmarks the Apache Spark in a single-system configuration and leverages the https://github.com/databricks/tpcds-kit and https://github.com/IBM/spark-tpc-ds-performance-test/ projects for testing. Learn more via the OpenBenchmarking.org test page.

Scale Factor: 3000

rk1-rok-nvme: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ./spark-tpcds: line 9: echo: write error: No space left on device

Timed Apache Compilation

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcpi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Apache Compilation 2.4.41ComparisonTime To Compile50100150200250SE +/- 0.26, N = 3SE +/- 0.22, N = 3SE +/- 0.38, N = 3SE +/- 0.16, N = 3SE +/- 0.37, N = 3SE +/- 0.49, N = 359.1659.3259.7660.6377.31223.03

Timed FFmpeg Compilation

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcpi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.1ComparisonTime To Compile2004006008001000SE +/- 0.36, N = 3SE +/- 0.84, N = 3SE +/- 0.58, N = 3SE +/- 0.50, N = 3SE +/- 0.09, N = 3SE +/- 1.65, N = 3194.15196.60200.28209.95349.94971.00

Timed GCC Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed GCC Compilation 13.2ComparisonTime To Compile9001800270036004500SE +/- 12.28, N = 34406.83

Comparison

rk1-mainline-emmc: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status.

rk1-mainline-nvme: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status.

rk1-rok-emmc: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status.

pi5-raspbian-nvme: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: collect2: fatal error: ld terminated with signal 9 [Killed]

pi4-raspbian-sd: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status.

Timed GDB GNU Debugger Compilation

rk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed GDB GNU Debugger Compilation 10.2ComparisonTime To Compile90180270360450SE +/- 1.39, N = 3SE +/- 1.63, N = 3249.25393.65

Comparison

rk1-mainline-emmc: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: gdb-10.2/missing: 81: makeinfo: not found

rk1-mainline-nvme: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: gdb-10.2/missing: 81: makeinfo: not found

rk1-rok-emmc: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: gdb-10.2/missing: 81: makeinfo: not found

pi4-raspbian-sd: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: gdb-10.2/missing: 81: makeinfo: not found

Timed Gem5 Compilation

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 23.0.1ComparisonTime To Compile5001000150020002500SE +/- 0.96, N = 3SE +/- 2.55, N = 3SE +/- 0.90, N = 3SE +/- 3.08, N = 32220.182222.422257.242329.03

Comparison

pi5-raspbian-nvme: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: g++: fatal error: Killed signal terminated program cc1plus

Timed Godot Game Engine Compilation

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcpi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 4.0ComparisonTime To Compile8001600240032004000SE +/- 4.83, N = 3SE +/- 6.78, N = 3SE +/- 4.62, N = 3SE +/- 7.67, N = 3SE +/- 3.05, N = 31835.921844.361852.591922.643498.30

Timed ImageMagick Compilation

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcpi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed ImageMagick Compilation 6.9.0ComparisonTime To Compile50100150200250SE +/- 0.43, N = 3SE +/- 0.41, N = 3SE +/- 0.50, N = 3SE +/- 0.66, N = 3SE +/- 0.49, N = 3112.86114.08115.09120.10211.59

Timed Linux Kernel Compilation

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcpi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build Comparisondefconfigallmodconfig2K4K6K8K10KSE +/- 2.04, N = 3SE +/- 2.80, N = 3SE +/- 5.72, N = 3SE +/- 1.83, N = 3SE +/- 1.28, N = 3SE +/- 1.62, N = 3SE +/- 1.10, N = 3SE +/- 4.42, N = 3SE +/- 9.15, N = 3SE +/- 14.83, N = 31131.975371.021138.205375.951160.505536.031199.615759.511904.559463.57

Timed LLVM Compilation

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System ComparisonNinjaUnix Makefiles8001600240032004000SE +/- 1.23, N = 3SE +/- 2.47, N = 3SE +/- 3.31, N = 3SE +/- 6.63, N = 3SE +/- 1.73, N = 3SE +/- 3.39, N = 3SE +/- 5.47, N = 3SE +/- 5.63, N = 33468.303511.133480.733524.743524.423577.043662.543722.37

Build System Comparison

pi5-raspbian-nvme: Ninja: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status.

pi5-raspbian-nvme: Unix Makefiles: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: c++: fatal error: Killed signal terminated program cc1plus

Timed Mesa Compilation

Comparison

rk1-mainline-emmc: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ninja: error: loading 'build.ninja': No such file or directory

rk1-mainline-nvme: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ninja: error: loading 'build.ninja': No such file or directory

rk1-rok-emmc: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ninja: error: loading 'build.ninja': No such file or directory

rk1-rok-nvme: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ninja: error: loading 'build.ninja': No such file or directory

pi5-raspbian-nvme: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ninja: error: loading 'build.ninja': No such file or directory

Timed MPlayer Compilation

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcpi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed MPlayer Compilation 1.5ComparisonTime To Compile60120180240300SE +/- 1.75, N = 3SE +/- 1.68, N = 3SE +/- 1.17, N = 3SE +/- 0.66, N = 3SE +/- 0.06, N = 3148.87150.11152.52158.06254.69

Timed Node.js Compilation

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 19.8.1ComparisonTime To Compile7001400210028003500SE +/- 1.20, N = 3SE +/- 0.29, N = 3SE +/- 3.73, N = 3SE +/- 2.91, N = 33261.913283.243289.073378.82

Comparison

pi5-raspbian-nvme: : The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: g++: fatal error: Killed signal terminated program cc1plus

Timed PHP Compilation

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcpi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed PHP Compilation 8.1.9ComparisonTime To Compile110220330440550SE +/- 1.19, N = 3SE +/- 2.08, N = 3SE +/- 2.82, N = 3SE +/- 4.51, N = 3SE +/- 1.64, N = 3334.21343.16346.68364.44519.40

Timed CPython Compilation

rk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcpi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed CPython Compilation 3.10.6Build Configuration ComparisonDefaultReleased Build, PGO + LTO Optimized200400600800100059.76744.6060.52764.7261.47783.8766.13784.3093.78862.02

Build2

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcpi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterBuild2 0.15ComparisonTime To Compile2004006008001000SE +/- 2.22, N = 3SE +/- 3.79, N = 3SE +/- 2.62, N = 3SE +/- 1.02, N = 3SE +/- 4.32, N = 3668.87669.64673.85688.051064.90

Timed Eigen Compilation

pi5-raspbian-nvmerk1-mainline-nvmerk1-mainline-emmcrk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Eigen Compilation 3.3.9ComparisonTime To Compile4080120160200SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 2.34, N = 3SE +/- 1.77, N = 3166.00166.90173.21192.10202.51

Timed Erlang/OTP Compilation

rk1-mainline-nvmerk1-rok-emmcrk1-mainline-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Erlang/OTP Compilation 25.0ComparisonTime To Compile90180270360450SE +/- 0.12, N = 3SE +/- 0.77, N = 3SE +/- 0.61, N = 3SE +/- 0.74, N = 3SE +/- 0.17, N = 3298.12301.84310.70330.42405.21

Timed Wasmer Compilation

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcpi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Wasmer Compilation 2.3ComparisonTime To Compile80160240320400SE +/- 1.65, N = 3SE +/- 1.67, N = 3SE +/- 0.10, N = 3SE +/- 0.59, N = 3SE +/- 0.79, N = 3188.16198.46204.89215.92372.861. (CC) gcc options: -ldl -lgcc_s -lutil -lrt -lpthread -lm -lc -pie -nodefaultlibs

LeelaChessZero

pi5-raspbian-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend ComparisonBLAS246810SE +/- 0.00, N = 3SE +/- 0.11, N = 9SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 37665511. (CXX) g++ options: -flto -pthread

TSCP

pi5-raspbian-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgNodes Per Second, More Is BetterTSCP 1.81ComparisonAI Chess Performance200K400K600K800K1000KSE +/- 350.28, N = 5SE +/- 239.20, N = 5SE +/- 238.60, N = 5SE +/- 1140.25, N = 5SE +/- 370.48, N = 5SE +/- 463.49, N = 58877798121178109217724867385074454711. (CC) gcc options: -O3 -march=native

Stockfish

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 15ComparisonTotal Time1.1M2.2M3.3M4.4M5.5MSE +/- 385132.57, N = 9SE +/- 121318.23, N = 9SE +/- 138882.38, N = 7SE +/- 88074.41, N = 9SE +/- 38968.66, N = 9SE +/- 21647.79, N = 95271840487374748637654326446311657211366601. (CXX) g++ options: -lgcov -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -flto -flto=jobserver

asmFish

rk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgNodes/second, More Is BetterasmFish 2018-07-23Comparison1024 Hash Memory, 26 Depth2M4M6M8M10MSE +/- 43781.35, N = 3SE +/- 65797.59, N = 9SE +/- 44374.95, N = 3SE +/- 75549.20, N = 6SE +/- 34823.82, N = 380058207817210772115975838562767131

Comparison

pi5-raspbian-nvme: : The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

m-queens

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcpi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is Betterm-queens 1.2ComparisonTime To Solve120240360480600SE +/- 0.02, N = 3SE +/- 0.14, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.33, N = 3206.26206.40206.45216.46316.59567.491. (CXX) g++ options: -fopenmp -O2 -march=native

N-Queens

rk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcpi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterN-Queens 1.0ComparisonElapsed Time20406080100SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.70, N = 15SE +/- 0.00, N = 3SE +/- 0.01, N = 355.7656.1856.2459.4863.00109.661. (CC) gcc options: -static -fopenmp -O3 -march=native

LevelDB

rk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgMicroseconds Per Op, Fewer Is BetterLevelDB 1.23Benchmark ComparisonRandom ReadHot ReadSeek RandomRandom DeleteSequential FillRandom FillOverwriteFill Sync8001600240032004000SE +/- 0.015, N = 3SE +/- 0.014, N = 3SE +/- 0.013, N = 3SE +/- 1.094, N = 3SE +/- 0.648, N = 3SE +/- 0.770, N = 3SE +/- 1.898, N = 5SE +/- 80.483, N = 15SE +/- 0.015, N = 3SE +/- 0.015, N = 3SE +/- 0.008, N = 3SE +/- 0.861, N = 3SE +/- 0.569, N = 3SE +/- 0.482, N = 3SE +/- 1.262, N = 3SE +/- 9.836, N = 3SE +/- 0.032, N = 3SE +/- 0.043, N = 3SE +/- 0.148, N = 15SE +/- 0.132, N = 3SE +/- 0.405, N = 3SE +/- 0.486, N = 10SE +/- 0.512, N = 15SE +/- 124.904, N = 154.4974.5206.275142.858149.853153.493156.2673224.4744.5024.5176.273139.647147.151149.216150.3523817.4294.5934.6066.37655.52759.03161.55062.0133015.6461. (CXX) g++ options: -fno-exceptions -fno-rtti -O3 -lgmock -lgtest -lsnappy

Benchmark Comparison

rk1-mainline-nvme: Hot Read: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result. E: ./leveldb: 3: ./db_bench: not found

rk1-mainline-nvme: Fill Sync: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result. E: ./leveldb: 3: ./db_bench: not found

rk1-mainline-nvme: Overwrite: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result. E: ./leveldb: 3: ./db_bench: not found

rk1-mainline-nvme: Random Fill: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result. E: ./leveldb: 3: ./db_bench: not found

rk1-mainline-nvme: Random Read: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result. E: ./leveldb: 3: ./db_bench: not found

rk1-mainline-nvme: Seek Random: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result. E: ./leveldb: 3: ./db_bench: not found

rk1-mainline-nvme: Random Delete: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result. E: ./leveldb: 3: ./db_bench: not found

rk1-mainline-nvme: Sequential Fill: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result. E: ./leveldb: 3: ./db_bench: not found

rk1-mainline-emmcrk1-rok-nvmerk1-rok-emmcOpenBenchmarking.orgMB/s, More Is BetterLevelDB 1.23Benchmark ComparisonSequential FillRandom FillOverwriteFill Sync48121620SE +/- 0.12, N = 3SE +/- 0.11, N = 10SE +/- 0.11, N = 15SE +/- 0.01, N = 15SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 5SE +/- 0.01, N = 1515.014.314.20.36.05.85.80.25.85.65.50.31. (CXX) g++ options: -fno-exceptions -fno-rtti -O3 -lgmock -lgtest -lsnappy

SQLite

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies Comparison1816243240SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.28, N = 15SE +/- 0.35, N = 331.2833.2736.0736.301. (CC) gcc options: -O2 -lreadline -ltermcap -lz -lm

etcd

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 50 - Clients: 100)PUTRANGE4K8K12K16K20KSE +/- 103.48, N = 3SE +/- 149.49, N = 3SE +/- 170.29, N = 6SE +/- 13.84, N = 3SE +/- 580.79, N = 9SE +/- 213.67, N = 9SE +/- 548.13, N = 9SE +/- 162.99, N = 917919.7417702.5917733.5817625.649143.018026.129019.798177.71

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Connections Comparison (Test: PUT - - Clients: 100)505001004K8K12K16K20KSE +/- 103.48, N = 3SE +/- 210.10, N = 3SE +/- 121.87, N = 3SE +/- 13.84, N = 3SE +/- 107.83, N = 3SE +/- 230.09, N = 3SE +/- 580.79, N = 9SE +/- 162.97, N = 9SE +/- 59.42, N = 3SE +/- 548.13, N = 9SE +/- 154.99, N = 9SE +/- 78.80, N = 317919.7416740.4516623.4017625.6416067.2716034.339143.017555.487417.329019.797773.687525.00

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 50)10001007K14K21K28K35KSE +/- 166.43, N = 3SE +/- 103.48, N = 3SE +/- 97.60, N = 3SE +/- 13.84, N = 3SE +/- 523.12, N = 12SE +/- 580.79, N = 9SE +/- 452.84, N = 9SE +/- 548.13, N = 932076.4117919.7430813.7717625.6419495.979143.0116573.199019.79

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 50 - Clients: 100 - Average Latency)PUTRANGE3691215SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.00, N = 3SE +/- 0.05, N = 6SE +/- 0.55, N = 9SE +/- 0.31, N = 9SE +/- 0.57, N = 9SE +/- 0.23, N = 95.55.65.65.611.112.411.312.2

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Connections Comparison (Test: PUT - - Clients: 100 - Average Latency)501005003691215SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.00, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.55, N = 9SE +/- 0.26, N = 9SE +/- 0.12, N = 3SE +/- 0.57, N = 9SE +/- 0.25, N = 9SE +/- 0.15, N = 35.55.95.95.66.16.211.113.213.411.312.813.2

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 50 - - Average Latency)10010001326395265SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.00, N = 3SE +/- 0.12, N = 3SE +/- 0.55, N = 9SE +/- 1.66, N = 12SE +/- 0.57, N = 9SE +/- 1.79, N = 95.529.95.630.911.150.311.359.0

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 50 - Clients: 100)Average Latency3691215SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.55, N = 9SE +/- 0.57, N = 95.55.611.111.3

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 100 - Clients: 100)RANGEPUT4K8K12K16K20KSE +/- 92.45, N = 3SE +/- 121.87, N = 3SE +/- 230.09, N = 3SE +/- 51.41, N = 3SE +/- 78.80, N = 3SE +/- 43.16, N = 3SE +/- 59.42, N = 3SE +/- 90.88, N = 316784.8316623.4016034.3315796.447525.007344.587417.327054.62

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 100)10001006K12K18K24K30KSE +/- 119.58, N = 3SE +/- 121.87, N = 3SE +/- 97.95, N = 3SE +/- 230.09, N = 3SE +/- 530.09, N = 12SE +/- 59.42, N = 3SE +/- 392.03, N = 9SE +/- 78.80, N = 330106.8416623.4028950.5716034.3319163.357417.3215482.137525.00

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 100 - Clients: 100 - Average Latency)PUTRANGE48121620SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.15, N = 3SE +/- 0.09, N = 3SE +/- 0.12, N = 3SE +/- 0.15, N = 35.95.96.26.213.213.513.414.0

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 100 - - Average Latency)10010001428425670SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 1.82, N = 9SE +/- 0.12, N = 3SE +/- 1.74, N = 125.931.76.232.613.263.013.450.9

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 100 - Clients: 100)Average Latency3691215SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.15, N = 3SE +/- 0.12, N = 35.96.213.213.4

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 50 - Clients: 1000)RANGEPUT7K14K21K28K35KSE +/- 208.41, N = 3SE +/- 166.43, N = 3SE +/- 97.60, N = 3SE +/- 55.90, N = 3SE +/- 523.12, N = 12SE +/- 466.92, N = 12SE +/- 452.84, N = 9SE +/- 428.03, N = 932275.1532076.4130813.7730789.2119495.9718635.5016573.1915862.12

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Connections Comparison (Test: PUT - - Clients: 1000)501005007K14K21K28K35KSE +/- 166.43, N = 3SE +/- 119.58, N = 3SE +/- 6.47, N = 3SE +/- 97.60, N = 3SE +/- 97.95, N = 3SE +/- 76.06, N = 3SE +/- 523.12, N = 12SE +/- 530.09, N = 12SE +/- 178.58, N = 3SE +/- 452.84, N = 9SE +/- 392.03, N = 9SE +/- 131.09, N = 332076.4130106.8422994.3830813.7728950.5721936.5419495.9719163.3516043.0016573.1915482.1313947.87

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 50 - Clients: 1000 - Average Latency)RANGEPUT1428425670SE +/- 0.22, N = 3SE +/- 0.18, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 1.66, N = 12SE +/- 1.59, N = 12SE +/- 1.79, N = 9SE +/- 1.90, N = 929.729.930.931.050.352.659.061.8

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Connections Comparison (Test: PUT - - Clients: 1000 - Average Latency)501005001530456075SE +/- 0.18, N = 3SE +/- 0.12, N = 3SE +/- 0.00, N = 3SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 0.21, N = 3SE +/- 1.66, N = 12SE +/- 1.74, N = 12SE +/- 0.73, N = 3SE +/- 1.79, N = 9SE +/- 1.82, N = 9SE +/- 0.71, N = 329.931.740.630.932.641.950.350.958.759.063.067.8

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 50 - Clients: 1000)Average Latency1326395265SE +/- 0.18, N = 3SE +/- 0.12, N = 3SE +/- 1.66, N = 12SE +/- 1.79, N = 929.930.950.359.0

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 500 - Clients: 100)PUTRANGE4K8K12K16K20KSE +/- 210.10, N = 3SE +/- 32.79, N = 3SE +/- 107.83, N = 3SE +/- 51.80, N = 3SE +/- 186.80, N = 6SE +/- 154.99, N = 9SE +/- 162.97, N = 9SE +/- 157.07, N = 916740.4516375.1916067.2715844.217871.697773.687555.487311.14

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 500)10001005K10K15K20K25KSE +/- 6.47, N = 3SE +/- 210.10, N = 3SE +/- 76.06, N = 3SE +/- 107.83, N = 3SE +/- 178.58, N = 3SE +/- 162.97, N = 9SE +/- 131.09, N = 3SE +/- 154.99, N = 922994.3816740.4521936.5416067.2716043.007555.4813947.877773.68

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 500 - Clients: 100 - Average Latency)PUTRANGE3691215SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.00, N = 3SE +/- 0.31, N = 6SE +/- 0.25, N = 9SE +/- 0.26, N = 9SE +/- 0.26, N = 95.96.06.16.212.612.813.213.6

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 500 - - Average Latency)10010001530456075SE +/- 0.06, N = 3SE +/- 0.00, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 3SE +/- 0.25, N = 9SE +/- 0.71, N = 3SE +/- 0.26, N = 9SE +/- 0.73, N = 35.940.66.141.912.867.813.258.7

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 500 - Clients: 100)Average Latency3691215SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.25, N = 9SE +/- 0.26, N = 95.96.112.813.2

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 100 - Clients: 1000)RANGEPUT6K12K18K24K30KSE +/- 136.35, N = 3SE +/- 119.58, N = 3SE +/- 97.95, N = 3SE +/- 123.00, N = 3SE +/- 530.09, N = 12SE +/- 414.34, N = 12SE +/- 392.03, N = 9SE +/- 438.82, N = 930214.1030106.8428950.5728883.9519163.3518202.3615482.1315177.05

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 100 - Clients: 1000 - Average Latency)RANGEPUT1428425670SE +/- 0.15, N = 3SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 0.18, N = 3SE +/- 1.74, N = 12SE +/- 1.57, N = 12SE +/- 1.82, N = 9SE +/- 2.12, N = 931.631.732.632.750.953.563.064.4

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 100 - Clients: 1000)Average Latency1428425670SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 1.74, N = 12SE +/- 1.82, N = 931.732.650.963.0

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 500 - Clients: 1000)PUTRANGE5K10K15K20K25KSE +/- 6.47, N = 3SE +/- 44.26, N = 3SE +/- 76.06, N = 3SE +/- 41.44, N = 3SE +/- 178.58, N = 3SE +/- 379.06, N = 6SE +/- 131.09, N = 3SE +/- 181.75, N = 322994.3822948.3421936.5421829.1116043.0015827.1213947.8713685.59

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 500 - Clients: 1000 - Average Latency)PUTRANGE1530456075SE +/- 0.00, N = 3SE +/- 0.12, N = 3SE +/- 0.21, N = 3SE +/- 0.06, N = 3SE +/- 0.73, N = 3SE +/- 1.51, N = 6SE +/- 0.71, N = 3SE +/- 0.98, N = 340.640.741.942.258.759.867.869.2

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 500 - Clients: 1000)Average Latency1530456075SE +/- 0.00, N = 3SE +/- 0.21, N = 3SE +/- 0.73, N = 3SE +/- 0.71, N = 340.641.958.767.8

rk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Connections Comparison (Test: RANGE - - Clients: 100)501005004K8K12K16K20KSE +/- 170.29, N = 6SE +/- 51.80, N = 3SE +/- 51.41, N = 3SE +/- 149.49, N = 3SE +/- 92.45, N = 3SE +/- 32.79, N = 3SE +/- 162.99, N = 9SE +/- 186.80, N = 6SE +/- 43.16, N = 3SE +/- 213.67, N = 9SE +/- 157.07, N = 9SE +/- 90.88, N = 317733.5815844.2115796.4417702.5916784.8316375.198177.717871.697344.588026.127311.147054.62

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 50)10001007K14K21K28K35KSE +/- 208.41, N = 3SE +/- 149.49, N = 3SE +/- 55.90, N = 3SE +/- 170.29, N = 6SE +/- 466.92, N = 12SE +/- 213.67, N = 9SE +/- 428.03, N = 9SE +/- 162.99, N = 932275.1517702.5930789.2117733.5818635.508026.1215862.128177.71

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Connections Comparison (Test: RANGE - - Clients: 100 - Average Latency)5010050048121620SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 6SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.23, N = 9SE +/- 0.31, N = 6SE +/- 0.09, N = 3SE +/- 0.31, N = 9SE +/- 0.26, N = 9SE +/- 0.15, N = 35.65.96.05.66.26.212.212.613.512.413.614.0

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 50 - - Average Latency)10010001428425670SE +/- 0.06, N = 3SE +/- 0.22, N = 3SE +/- 0.05, N = 6SE +/- 0.07, N = 3SE +/- 0.23, N = 9SE +/- 1.90, N = 9SE +/- 0.31, N = 9SE +/- 1.59, N = 125.629.75.631.012.261.812.452.6

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 50 - Clients: 100)Average Latency3691215SE +/- 0.06, N = 3SE +/- 0.05, N = 6SE +/- 0.23, N = 9SE +/- 0.31, N = 95.65.612.212.4

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 100)10001006K12K18K24K30KSE +/- 136.35, N = 3SE +/- 92.45, N = 3SE +/- 123.00, N = 3SE +/- 51.41, N = 3SE +/- 414.34, N = 12SE +/- 90.88, N = 3SE +/- 438.82, N = 9SE +/- 43.16, N = 330214.1016784.8328883.9515796.4418202.367054.6215177.057344.58

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 100 - - Average Latency)10010001428425670SE +/- 0.03, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.09, N = 3SE +/- 2.12, N = 9SE +/- 0.15, N = 3SE +/- 1.57, N = 125.931.66.232.713.564.414.053.5

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 100 - Clients: 100)Average Latency48121620SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.15, N = 35.96.213.514.0

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Connections Comparison (Test: RANGE - - Clients: 1000)501005007K14K21K28K35KSE +/- 208.41, N = 3SE +/- 136.35, N = 3SE +/- 44.26, N = 3SE +/- 55.90, N = 3SE +/- 123.00, N = 3SE +/- 41.44, N = 3SE +/- 466.92, N = 12SE +/- 414.34, N = 12SE +/- 379.06, N = 6SE +/- 428.03, N = 9SE +/- 438.82, N = 9SE +/- 181.75, N = 332275.1530214.1022948.3430789.2128883.9521829.1118635.5018202.3615827.1215862.1215177.0513685.59

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Connections Comparison (Test: RANGE - - Clients: 1000 - Average Latency)501005001530456075SE +/- 0.22, N = 3SE +/- 0.15, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.18, N = 3SE +/- 0.06, N = 3SE +/- 1.59, N = 12SE +/- 1.57, N = 12SE +/- 1.51, N = 6SE +/- 1.90, N = 9SE +/- 2.12, N = 9SE +/- 0.98, N = 329.731.640.731.032.742.252.653.559.861.864.469.2

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 50 - Clients: 1000)Average Latency1428425670SE +/- 0.22, N = 3SE +/- 0.07, N = 3SE +/- 1.59, N = 12SE +/- 1.90, N = 929.731.052.661.8

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 500)10001005K10K15K20K25KSE +/- 44.26, N = 3SE +/- 32.79, N = 3SE +/- 41.44, N = 3SE +/- 51.80, N = 3SE +/- 379.06, N = 6SE +/- 157.07, N = 9SE +/- 181.75, N = 3SE +/- 186.80, N = 622948.3416375.1921829.1115844.2115827.127311.1413685.597871.69

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 500 - - Average Latency)10010001530456075SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.00, N = 3SE +/- 0.06, N = 3SE +/- 0.31, N = 6SE +/- 0.98, N = 3SE +/- 0.26, N = 9SE +/- 1.51, N = 66.040.76.242.212.669.213.659.8

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 500 - Clients: 100)Average Latency3691215SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.31, N = 6SE +/- 0.26, N = 96.06.212.613.6

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 100 - Clients: 1000)Average Latency1428425670SE +/- 0.15, N = 3SE +/- 0.18, N = 3SE +/- 1.57, N = 12SE +/- 2.12, N = 931.632.753.564.4

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 500 - Clients: 1000)Average Latency1530456075SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 1.51, N = 6SE +/- 0.98, N = 340.742.259.869.2

Apache CouchDB

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Bulk Size Comparison (Inserts: 1000 - Rounds: 30)100300500150300450600750SE +/- 2.31, N = 3SE +/- 3.79, N = 3SE +/- 0.51, N = 3SE +/- 2.59, N = 6SE +/- 0.91, N = 3SE +/- 2.58, N = 3SE +/- 3.82, N = 9SE +/- 2.78, N = 3SE +/- 0.74, N = 3SE +/- 2.80, N = 9SE +/- 1.83, N = 3SE +/- 3.77, N = 3247.76366.67438.30258.52394.74679.40262.44377.97464.69266.25384.07676.091. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Inserts Comparison (Bulk Size: 100 - - Rounds: 30)100030002004006008001000SE +/- 2.31, N = 3SE +/- 0.84, N = 3SE +/- 2.59, N = 6SE +/- 10.18, N = 3SE +/- 3.82, N = 9SE +/- 1.11, N = 3SE +/- 2.80, N = 9SE +/- 1.88, N = 3247.76860.53258.52871.54262.44887.89266.25855.611. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 100 - Inserts: 1000)3060120180240300SE +/- 2.31, N = 3SE +/- 2.59, N = 6SE +/- 3.82, N = 9SE +/- 2.80, N = 9247.76258.52262.44266.251. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Bulk Size Comparison (Inserts: 3000 - Rounds: 30)1003005005001000150020002500SE +/- 1.88, N = 3SE +/- 31.00, N = 9SE +/- 11.33, N = 3SE +/- 0.84, N = 3SE +/- 2.19, N = 3SE +/- 1.95, N = 3SE +/- 10.18, N = 3SE +/- 2.59, N = 3SE +/- 13.77, N = 3SE +/- 1.11, N = 3SE +/- 14.88, N = 5SE +/- 0.87, N = 3855.611492.532083.07860.531314.732158.52871.541444.002140.74887.891412.822261.831. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 100 - Inserts: 3000)302004006008001000SE +/- 1.88, N = 3SE +/- 0.84, N = 3SE +/- 10.18, N = 3SE +/- 1.11, N = 3855.61860.53871.54887.891. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

rk1-mainline-nvmerk1-mainline-emmcrk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Inserts Comparison (Bulk Size: 300 - - Rounds: 30)1000300030060090012001500SE +/- 3.79, N = 3SE +/- 2.19, N = 3SE +/- 2.78, N = 3SE +/- 14.88, N = 5SE +/- 1.83, N = 3SE +/- 31.00, N = 9SE +/- 0.91, N = 3SE +/- 2.59, N = 3366.671314.73377.971412.82384.071492.53394.741444.001. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

rk1-mainline-nvmerk1-mainline-emmcrk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 300 - Inserts: 1000)3090180270360450SE +/- 3.79, N = 3SE +/- 2.78, N = 3SE +/- 1.83, N = 3SE +/- 0.91, N = 3366.67377.97384.07394.741. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

rk1-mainline-nvmerk1-mainline-emmcrk1-rok-nvmerk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 300 - Inserts: 3000)3030060090012001500SE +/- 2.19, N = 3SE +/- 14.88, N = 5SE +/- 2.59, N = 3SE +/- 31.00, N = 91314.731412.821444.001492.531. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

rk1-mainline-nvmerk1-mainline-emmcrk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Inserts Comparison (Bulk Size: 500 - - Rounds: 30)100030005001000150020002500SE +/- 0.51, N = 3SE +/- 1.95, N = 3SE +/- 0.74, N = 3SE +/- 0.87, N = 3SE +/- 3.77, N = 3SE +/- 11.33, N = 3SE +/- 2.58, N = 3SE +/- 13.77, N = 3438.302158.52464.692261.83676.092083.07679.402140.741. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

rk1-mainline-nvmerk1-mainline-emmcrk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 500 - Inserts: 1000)30150300450600750SE +/- 0.51, N = 3SE +/- 0.74, N = 3SE +/- 3.77, N = 3SE +/- 2.58, N = 3438.30464.69676.09679.401. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 500 - Inserts: 3000)305001000150020002500SE +/- 11.33, N = 3SE +/- 13.77, N = 3SE +/- 1.95, N = 3SE +/- 0.87, N = 32083.072140.742158.522261.831. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache Spark

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - SHA-512 Benchmark Time)10000001000000020000000400000004080120160200SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.12, N = 3SE +/- 0.58, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.34, N = 3SE +/- 0.84, N = 3SE +/- 0.10, N = 5SE +/- 0.39, N = 3SE +/- 0.67, N = 3SE +/- 0.82, N = 3SE +/- 0.11, N = 4SE +/- 0.32, N = 3SE +/- 0.22, N = 3SE +/- 0.34, N = 39.3452.6988.81177.819.5055.2893.79190.039.5652.8889.48178.8910.0157.0596.68195.45

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - SHA-512 Benchmark Time)100500100020003691215SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 4SE +/- 0.12, N = 9SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 5SE +/- 0.11, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.11, N = 4SE +/- 0.08, N = 3SE +/- 0.14, N = 3SE +/- 0.14, N = 39.349.8910.7812.639.5010.4311.1812.559.5610.4811.1412.8810.0111.2311.3812.96

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 1000000 - Partitions: 100)Broadcast Inner Join Test TimeInner Join Test TimeRepartition Test TimeGroup By Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark Using DataframeCalculate Pi Benchmark160320480640800SE +/- 0.069228259, N = 5SE +/- 0.044993077, N = 5SE +/- 0.034264151, N = 5SE +/- 0.081615689, N = 5SE +/- 0.101368246, N = 5SE +/- 0.089037280, N = 5SE +/- 0.461842438, N = 5SE +/- 0.076264083, N = 3SE +/- 0.294062371, N = 3SE +/- 0.070931558, N = 3SE +/- 0.130013375, N = 3SE +/- 0.093919752, N = 3SE +/- 0.039099097, N = 3SE +/- 1.541717417, N = 3SE +/- 0.102452612, N = 3SE +/- 0.004165140, N = 3SE +/- 0.084920457, N = 3SE +/- 0.129389851, N = 3SE +/- 0.038555282, N = 3SE +/- 0.257940983, N = 3SE +/- 1.768265132, N = 3SE +/- 0.085253143, N = 4SE +/- 0.134671456, N = 4SE +/- 0.023541873, N = 4SE +/- 0.025356347, N = 4SE +/- 0.113137090, N = 4SE +/- 0.122562063, N = 4SE +/- 9.681628257, N = 45.4500000006.0400000008.7500000009.0900000009.56000000031.630000000581.8522107855.5000000006.5400000008.6200000008.7500000009.34000000031.840000000581.4500000005.6900000006.2500000008.7900000008.8100000009.50000000032.140000000694.4100000005.7200000006.5900000009.0700000009.08000000010.01000000033.760000000727.520000000

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark)4000000010000000200000001000000160320480640800SE +/- 0.87, N = 3SE +/- 1.38, N = 3SE +/- 1.54, N = 3SE +/- 1.47, N = 3SE +/- 0.70, N = 3SE +/- 0.68, N = 3SE +/- 0.46, N = 5SE +/- 3.74, N = 3SE +/- 7.97, N = 3SE +/- 1.77, N = 3SE +/- 8.48, N = 3SE +/- 1.80, N = 3SE +/- 8.94, N = 3SE +/- 3.83, N = 3SE +/- 8.88, N = 3SE +/- 9.68, N = 4579.98580.52581.45581.85580.29581.19581.85582.87681.48694.41694.61694.62713.91722.90724.99727.52

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark)50010002000100160320480640800SE +/- 1.70, N = 3SE +/- 0.46, N = 5SE +/- 0.55, N = 3SE +/- 2.32, N = 3SE +/- 0.54, N = 4SE +/- 0.47, N = 9SE +/- 0.64, N = 3SE +/- 1.54, N = 3SE +/- 3.62, N = 3SE +/- 8.22, N = 3SE +/- 1.77, N = 3SE +/- 1.43, N = 3SE +/- 1.88, N = 3SE +/- 9.68, N = 4SE +/- 5.14, N = 3SE +/- 10.10, N = 3579.16581.85582.61583.50580.24580.68580.99581.45685.12690.63694.41695.32717.10727.52733.77733.90

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark Using Dataframe)1000000040000000200000001000000816243240SE +/- 0.29, N = 3SE +/- 0.38, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.18, N = 3SE +/- 0.09, N = 5SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.23, N = 3SE +/- 0.26, N = 3SE +/- 0.23, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.32, N = 3SE +/- 0.12, N = 4SE +/- 0.10, N = 331.4931.5731.8131.8431.6231.6331.7931.9732.0832.1432.2432.3533.6333.7333.7634.02

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark Using Dataframe)10002000100500816243240SE +/- 0.08, N = 3SE +/- 0.09, N = 5SE +/- 0.12, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 9SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 4SE +/- 0.23, N = 3SE +/- 0.26, N = 3SE +/- 0.16, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.12, N = 4SE +/- 0.16, N = 3SE +/- 0.01, N = 331.5431.6331.6831.7231.5631.7931.8431.8832.0332.1432.2732.3633.3933.7633.7633.79

rk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Group By Test Time)100000010000000200000004000000020406080100SE +/- 0.13, N = 3SE +/- 3.06, N = 3SE +/- 0.73, N = 3SE +/- 0.13, N = 3SE +/- 0.25, N = 3SE +/- 0.32, N = 3SE +/- 2.29, N = 3SE +/- 0.02, N = 4SE +/- 0.30, N = 3SE +/- 0.45, N = 3SE +/- 0.08, N = 5SE +/- 0.24, N = 3SE +/- 0.47, N = 3SE +/- 3.33, N = 38.7526.6234.668.8123.5035.5187.329.0725.0537.119.0923.9034.4188.01

rk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Group By Test Time)100500100020003691215SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 4SE +/- 0.13, N = 9SE +/- 0.13, N = 3SE +/- 0.19, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.02, N = 4SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 5SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.23, N = 38.759.8410.9312.838.819.9511.1012.869.0710.1311.3913.029.0910.0311.1813.31

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Repartition Test Time)1000000100000002000000040000000306090120150SE +/- 0.07, N = 3SE +/- 0.76, N = 3SE +/- 2.01, N = 3SE +/- 0.03, N = 5SE +/- 0.43, N = 3SE +/- 0.15, N = 3SE +/- 0.42, N = 3SE +/- 0.08, N = 3SE +/- 0.18, N = 3SE +/- 0.33, N = 3SE +/- 1.31, N = 3SE +/- 0.03, N = 4SE +/- 0.56, N = 3SE +/- 0.55, N = 38.6238.5872.358.7537.0768.12131.388.7938.2971.59137.289.0841.2874.32

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Repartition Test Time)100500100020003691215SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 4SE +/- 0.04, N = 9SE +/- 0.03, N = 5SE +/- 0.07, N = 3SE +/- 0.18, N = 3SE +/- 0.16, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 4SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.18, N = 38.629.009.7410.578.759.219.9510.858.799.1010.0510.719.089.4610.0611.01

rk1-rok-nvmerk1-mainline-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Inner Join Test Time)1000000100000002000000040000000306090120150SE +/- 0.044993077, N = 5SE +/- 1.372283254, N = 3SE +/- 0.475686548, N = 3SE +/- 1.445788055, N = 3SE +/- 0.004165140, N = 3SE +/- 0.120293064, N = 3SE +/- 0.323667212, N = 3SE +/- 1.752337079, N = 3SE +/- 0.294062371, N = 3SE +/- 1.642152192, N = 3SE +/- 1.129567495, N = 3SE +/- 0.134671456, N = 4SE +/- 0.257232291, N = 3SE +/- 0.574015178, N = 36.04000000043.71000000076.870000000152.8725572196.25000000043.58000000080.900000000157.8800000006.54000000043.88000000075.6800000006.59000000047.52000000083.980000000

rk1-rok-nvmerk1-mainline-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Inner Join Test Time)100500100020003691215SE +/- 0.04, N = 5SE +/- 0.04, N = 3SE +/- 0.11, N = 3SE +/- 0.40, N = 3SE +/- 0.00, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.29, N = 3SE +/- 0.52, N = 3SE +/- 0.63, N = 4SE +/- 0.50, N = 9SE +/- 0.13, N = 4SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 36.047.037.8110.896.257.018.0110.686.547.538.6311.066.597.268.3310.69

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Broadcast Inner Join Test Time)10000001000000020000000400000004080120160200SE +/- 0.07, N = 5SE +/- 0.21, N = 3SE +/- 0.55, N = 3SE +/- 0.60, N = 3SE +/- 0.08, N = 3SE +/- 0.62, N = 3SE +/- 0.59, N = 3SE +/- 0.10, N = 3SE +/- 0.71, N = 3SE +/- 0.43, N = 3SE +/- 2.32, N = 3SE +/- 0.09, N = 4SE +/- 0.25, N = 3SE +/- 0.19, N = 35.4542.8574.60150.055.5043.1973.605.6944.2679.21159.015.7247.1082.03

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Broadcast Inner Join Test Time)10050010002000246810SE +/- 0.07, N = 5SE +/- 0.49, N = 3SE +/- 0.06, N = 3SE +/- 0.27, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 4SE +/- 0.13, N = 9SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.12, N = 3SE +/- 0.01, N = 3SE +/- 0.09, N = 4SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.18, N = 35.456.517.058.415.506.126.908.375.696.296.998.045.726.627.298.58

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - SHA-512 Benchmark Time)10000001000000020000000400000004080120160200SE +/- 0.026873455, N = 3SE +/- 0.112654588, N = 3SE +/- 0.160687224, N = 3SE +/- 0.477080995, N = 3SE +/- 0.073904401, N = 3SE +/- 0.088475323, N = 3SE +/- 0.105154004, N = 3SE +/- 0.553867494, N = 3SE +/- 0.114204323, N = 3SE +/- 0.195921788, N = 3SE +/- 0.331996595, N = 3SE +/- 1.561648800, N = 3SE +/- 0.075456756, N = 3SE +/- 0.109148903, N = 3SE +/- 0.307771793, N = 3SE +/- 0.260000987, N = 39.89000000047.87000000090.560000000172.06000000010.43000000050.73000000096.850000000183.20000000010.48000000048.84000000091.240000000172.69004833111.23000000052.62000000099.640000000189.390000000

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 1000000 - Partitions: 500)Broadcast Inner Join Test TimeInner Join Test TimeRepartition Test TimeGroup By Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark Using DataframeCalculate Pi Benchmark160320480640800SE +/- 0.063047733, N = 3SE +/- 0.517942458, N = 3SE +/- 0.101989022, N = 3SE +/- 0.152630685, N = 3SE +/- 0.026873455, N = 3SE +/- 0.017302603, N = 3SE +/- 0.635610275, N = 3SE +/- 0.103211248, N = 3SE +/- 0.103943425, N = 3SE +/- 0.076523207, N = 3SE +/- 0.188967987, N = 3SE +/- 0.073904401, N = 3SE +/- 0.155432056, N = 3SE +/- 3.616590948, N = 3SE +/- 0.486110869, N = 3SE +/- 0.043852959, N = 3SE +/- 0.069154351, N = 3SE +/- 0.086808001, N = 3SE +/- 0.114204323, N = 3SE +/- 0.016927629, N = 3SE +/- 1.696546131, N = 3SE +/- 0.094366471, N = 3SE +/- 0.056766652, N = 3SE +/- 0.037643391, N = 3SE +/- 0.085288962, N = 3SE +/- 0.075456756, N = 3SE +/- 0.158253119, N = 3SE +/- 10.096513371, N = 36.1200000007.5300000009.0000000009.8400000009.89000000031.790000000580.9900000006.2900000007.0100000009.1000000009.95000000010.43000000032.270000000685.1200000006.5100000007.0300000009.21000000010.03000000010.48000000031.720000000579.1606672406.6200000007.2600000009.46000000010.13000000011.23000000033.760000000733.900000000

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark)4000000010000001000000020000000160320480640800SE +/- 0.55, N = 3SE +/- 1.70, N = 3SE +/- 0.62, N = 3SE +/- 0.67, N = 3SE +/- 1.02, N = 3SE +/- 0.86, N = 3SE +/- 0.64, N = 3SE +/- 0.79, N = 3SE +/- 4.56, N = 3SE +/- 3.78, N = 3SE +/- 3.62, N = 3SE +/- 4.60, N = 3SE +/- 3.66, N = 3SE +/- 17.41, N = 3SE +/- 6.99, N = 3SE +/- 10.10, N = 3579.01579.16581.78583.11579.55580.30580.99581.12683.57684.23685.12690.62692.06714.05728.26733.90

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark Using Dataframe)4000000010000002000000010000000816243240SE +/- 0.11, N = 3SE +/- 0.15, N = 3SE +/- 0.02, N = 3SE +/- 0.11, N = 3SE +/- 0.09, N = 3SE +/- 0.02, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.22, N = 3SE +/- 0.36, N = 3SE +/- 0.05, N = 3SE +/- 0.16, N = 3SE +/- 0.25, N = 3SE +/- 0.16, N = 3SE +/- 0.10, N = 3SE +/- 0.13, N = 331.5131.7631.7931.7931.7131.7231.7431.8131.8431.9632.1732.2733.7233.7633.7733.89

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Group By Test Time)100000010000000200000004000000020406080100SE +/- 0.15, N = 3SE +/- 1.78, N = 3SE +/- 4.59, N = 3SE +/- 0.19, N = 3SE +/- 0.51, N = 3SE +/- 0.72, N = 3SE +/- 4.05, N = 3SE +/- 0.09, N = 3SE +/- 0.17, N = 3SE +/- 0.13, N = 3SE +/- 1.17, N = 3SE +/- 0.09, N = 3SE +/- 0.42, N = 3SE +/- 0.10, N = 39.8423.8239.269.9522.3736.3789.2310.0322.3835.9982.3510.1323.2837.00

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Repartition Test Time)1000000100000002000000040000000306090120150SE +/- 0.101989022, N = 3SE +/- 1.074726167, N = 3SE +/- 0.840434214, N = 3SE +/- 0.076523207, N = 3SE +/- 0.263873750, N = 3SE +/- 0.119615928, N = 3SE +/- 0.575990239, N = 3SE +/- 0.069154351, N = 3SE +/- 0.254871419, N = 3SE +/- 0.310887433, N = 3SE +/- 0.835252655, N = 3SE +/- 0.037643391, N = 3SE +/- 0.579061882, N = 3SE +/- 0.150029474, N = 39.00000000038.92000000070.9000000009.10000000038.21000000071.300000000138.0400000009.21000000036.44000000067.860000000131.5311326779.46000000040.16000000073.220000000

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Inner Join Test Time)1000000100000002000000040000000306090120150SE +/- 0.103943425, N = 3SE +/- 0.391685283, N = 3SE +/- 0.747944666, N = 3SE +/- 0.391834664, N = 3SE +/- 0.043852959, N = 3SE +/- 0.324188438, N = 3SE +/- 0.097366593, N = 3SE +/- 1.021947894, N = 3SE +/- 0.056766652, N = 3SE +/- 0.422261678, N = 3SE +/- 0.562607380, N = 3SE +/- 0.517942458, N = 3SE +/- 0.798930107, N = 3SE +/- 0.488163973, N = 37.01000000042.54000000080.990000000158.1100000007.03000000040.24000000077.630000000152.2074853977.26000000044.68000000083.8400000007.53000000042.43000000078.030000000

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Broadcast Inner Join Test Time)1000000100000002000000040000000306090120150SE +/- 0.063047733, N = 3SE +/- 0.416062930, N = 3SE +/- 0.043071403, N = 3SE +/- 0.103211248, N = 3SE +/- 0.236232308, N = 3SE +/- 0.489603948, N = 3SE +/- 0.852271154, N = 3SE +/- 0.486110869, N = 3SE +/- 0.448087864, N = 3SE +/- 0.730826056, N = 3SE +/- 0.764058299, N = 3SE +/- 0.094366471, N = 3SE +/- 0.236866720, N = 3SE +/- 0.300364443, N = 36.12000000039.16000000075.2300000006.29000000040.95000000080.770000000157.0800000006.51000000038.35000000076.270000000147.5485311946.62000000042.68000000083.530000000

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - SHA-512 Benchmark Time)10000001000000020000000400000004080120160200SE +/- 0.12, N = 4SE +/- 0.15, N = 3SE +/- 0.29, N = 3SE +/- 0.77, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.48, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.20, N = 3SE +/- 0.13, N = 3SE +/- 0.14, N = 3SE +/- 0.22, N = 3SE +/- 0.20, N = 3SE +/- 0.54, N = 310.7849.2191.39172.4511.1449.4592.42172.1911.1851.6495.92183.3511.3853.52100.73189.73

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 1000000 - Partitions: 1000)Broadcast Inner Join Test TimeInner Join Test TimeRepartition Test TimeSHA-512 Benchmark TimeGroup By Test TimeCalculate Pi Benchmark Using DataframeCalculate Pi Benchmark150300450600750SE +/- 0.06, N = 4SE +/- 0.63, N = 4SE +/- 0.07, N = 4SE +/- 0.12, N = 4SE +/- 0.08, N = 4SE +/- 0.05, N = 4SE +/- 0.54, N = 4SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 1.43, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.18, N = 3SE +/- 0.01, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 2.32, N = 3SE +/- 0.04, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 1.88, N = 36.908.639.7410.7810.9331.88580.246.998.0110.0511.1011.1832.36695.327.057.819.9511.1411.1831.54583.507.298.3310.0611.3811.3933.39717.10

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark)2000000010000001000000040000000160320480640800SE +/- 0.66, N = 3SE +/- 0.54, N = 4SE +/- 1.40, N = 3SE +/- 0.56, N = 3SE +/- 1.10, N = 3SE +/- 0.29, N = 3SE +/- 1.66, N = 3SE +/- 2.32, N = 3SE +/- 2.66, N = 3SE +/- 4.78, N = 3SE +/- 1.43, N = 3SE +/- 6.51, N = 3SE +/- 1.88, N = 3SE +/- 14.94, N = 3SE +/- 5.58, N = 3SE +/- 11.19, N = 3579.19580.24580.37581.69580.24580.46581.60583.50687.06690.24695.32697.90717.10721.00722.36722.93

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark Using Dataframe)2000000010000000100000040000000816243240SE +/- 0.32, N = 3SE +/- 0.26, N = 3SE +/- 0.08, N = 3SE +/- 0.10, N = 3SE +/- 0.16, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 4SE +/- 0.15, N = 3SE +/- 0.32, N = 3SE +/- 0.10, N = 3SE +/- 0.16, N = 3SE +/- 0.08, N = 3SE +/- 0.22, N = 3SE +/- 0.19, N = 3SE +/- 0.18, N = 331.2231.3631.5431.6131.5431.6631.7531.8832.0532.2432.3632.4033.3933.5133.8134.00

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Group By Test Time)100000010000000200000004000000020406080100SE +/- 0.08, N = 4SE +/- 0.36, N = 3SE +/- 2.03, N = 3SE +/- 0.02, N = 3SE +/- 0.28, N = 3SE +/- 0.15, N = 3SE +/- 2.33, N = 3SE +/- 0.09, N = 3SE +/- 0.20, N = 3SE +/- 0.44, N = 3SE +/- 0.85, N = 3SE +/- 0.03, N = 3SE +/- 0.35, N = 3SE +/- 0.79, N = 310.9322.4435.8311.1022.2935.2788.0211.1822.6234.7079.6011.3923.8937.31

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Repartition Test Time)1000000100000002000000040000000306090120150SE +/- 0.07, N = 4SE +/- 0.54, N = 3SE +/- 1.03, N = 3SE +/- 0.18, N = 3SE +/- 0.31, N = 3SE +/- 0.20, N = 3SE +/- 0.93, N = 3SE +/- 0.07, N = 3SE +/- 0.22, N = 3SE +/- 0.23, N = 3SE +/- 0.83, N = 3SE +/- 0.02, N = 3SE +/- 0.23, N = 3SE +/- 0.23, N = 39.7439.3172.989.9536.7268.54131.4310.0538.6171.70138.8710.0639.9675.18

rk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Inner Join Test Time)10000001000000020000000400000004080120160200SE +/- 0.108422107, N = 3SE +/- 0.211182878, N = 3SE +/- 0.524371080, N = 3SE +/- 1.834767926, N = 3SE +/- 0.035374915, N = 3SE +/- 0.136942862, N = 3SE +/- 0.420756743, N = 3SE +/- 1.923212084, N = 3SE +/- 0.105150363, N = 3SE +/- 0.399790551, N = 3SE +/- 0.315382741, N = 3SE +/- 0.633875719, N = 4SE +/- 0.557375853, N = 3SE +/- 0.855084002, N = 37.81000000041.49000000079.290000000151.5438619978.01000000044.00000000081.350000000162.0100000008.33000000045.60000000085.1200000008.63000000043.30000000078.420000000

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Broadcast Inner Join Test Time)1000000100000002000000040000000306090120150SE +/- 0.06, N = 4SE +/- 1.25, N = 3SE +/- 0.83, N = 3SE +/- 0.12, N = 3SE +/- 0.16, N = 3SE +/- 0.09, N = 3SE +/- 0.25, N = 3SE +/- 0.06, N = 3SE +/- 0.36, N = 3SE +/- 0.20, N = 3SE +/- 1.46, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.51, N = 36.9040.9075.966.9941.9880.64158.247.0539.2276.66147.557.2943.4784.01

rk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - SHA-512 Benchmark Time)10000001000000020000000400000004080120160200SE +/- 0.11, N = 3SE +/- 0.34, N = 3SE +/- 0.37, N = 3SE +/- 0.21, N = 3SE +/- 0.12, N = 9SE +/- 0.36, N = 3SE +/- 0.02, N = 3SE +/- 0.42, N = 3SE +/- 0.11, N = 3SE +/- 0.24, N = 3SE +/- 0.11, N = 3SE +/- 0.47, N = 3SE +/- 0.14, N = 3SE +/- 0.39, N = 3SE +/- 0.14, N = 3SE +/- 0.40, N = 312.5553.0497.65185.5112.6350.8091.96175.8412.8851.0992.19175.2412.9655.17101.15192.81

rk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 1000000 - Partitions: 2000)Broadcast Inner Join Test TimeRepartition Test TimeInner Join Test TimeSHA-512 Benchmark TimeGroup By Test TimeCalculate Pi Benchmark Using DataframeCalculate Pi Benchmark160320480640800SE +/- 0.011049874, N = 3SE +/- 0.094249006, N = 3SE +/- 0.042552140, N = 3SE +/- 0.112867497, N = 3SE +/- 0.090717982, N = 3SE +/- 0.230080533, N = 3SE +/- 8.221686317, N = 3SE +/- 0.128969955, N = 9SE +/- 0.039688685, N = 9SE +/- 0.501143304, N = 9SE +/- 0.121232499, N = 9SE +/- 0.134671941, N = 9SE +/- 0.090240232, N = 9SE +/- 0.468273880, N = 9SE +/- 0.269877699, N = 3SE +/- 0.155773144, N = 3SE +/- 0.401879123, N = 3SE +/- 0.113414449, N = 3SE +/- 0.230601906, N = 3SE +/- 0.123827132, N = 3SE +/- 0.548006604, N = 3SE +/- 0.177939327, N = 3SE +/- 0.098619535, N = 3SE +/- 0.181687585, N = 3SE +/- 0.139768323, N = 3SE +/- 0.146972816, N = 3SE +/- 0.013599313, N = 3SE +/- 5.138863712, N = 38.04000000010.68000000010.71000000012.55000000012.86000000032.030000000690.6300000008.37000000010.57000000011.06000000012.63000000012.83000000031.560000000580.6800000008.41000000010.85000000010.89000000012.88000000013.31000000031.680000000582.6148947078.58000000010.69000000011.01000000012.96000000013.02000000033.790000000733.770000000

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark)1000000040000000200000001000000160320480640800SE +/- 0.51, N = 3SE +/- 1.28, N = 3SE +/- 0.28, N = 3SE +/- 0.55, N = 3SE +/- 1.08, N = 3SE +/- 0.47, N = 9SE +/- 0.49, N = 3SE +/- 0.41, N = 3SE +/- 2.10, N = 3SE +/- 8.22, N = 3SE +/- 8.50, N = 3SE +/- 6.18, N = 3SE +/- 16.56, N = 3SE +/- 13.31, N = 3SE +/- 22.40, N = 3SE +/- 5.14, N = 3577.92579.55581.10582.61579.87580.68580.86581.17681.91690.63695.17699.96710.71711.60723.32733.77

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark Using Dataframe)4000000010000001000000020000000816243240SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.15, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 9SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.14, N = 3SE +/- 0.06, N = 3SE +/- 0.23, N = 3SE +/- 0.31, N = 3SE +/- 0.09, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.14, N = 331.3231.5831.6631.6831.5631.6131.6531.6631.9232.0332.2032.2133.7933.7933.9133.96

rk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Group By Test Time)100000010000000200000004000000020406080100SE +/- 0.13, N = 9SE +/- 0.22, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.46, N = 3SE +/- 4.77, N = 3SE +/- 0.15, N = 3SE +/- 0.28, N = 3SE +/- 0.10, N = 3SE +/- 0.23, N = 3SE +/- 0.39, N = 3SE +/- 0.41, N = 3SE +/- 3.36, N = 312.8324.1012.8624.0936.7283.8713.0224.8537.3513.3124.1337.1681.61

rk1-rok-emmcrk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Repartition Test Time)1000000100000002000000040000000306090120150SE +/- 0.04, N = 9SE +/- 0.66, N = 3SE +/- 0.04, N = 3SE +/- 0.21, N = 3SE +/- 0.20, N = 3SE +/- 0.91, N = 3SE +/- 0.16, N = 3SE +/- 0.08, N = 3SE +/- 0.14, N = 3SE +/- 0.77, N = 3SE +/- 0.18, N = 3SE +/- 0.03, N = 3SE +/- 0.46, N = 310.5739.3310.7139.2272.28137.4510.8537.9469.09131.3911.0140.5075.44

rk1-mainline-nvmerk1-mainline-emmcrk1-rok-nvmerk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Inner Join Test Time)10000001000000020000000400000004080120160200SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.31, N = 3SE +/- 1.46, N = 3SE +/- 0.10, N = 3SE +/- 0.21, N = 3SE +/- 0.28, N = 3SE +/- 0.40, N = 3SE +/- 0.15, N = 3SE +/- 0.05, N = 3SE +/- 1.01, N = 3SE +/- 0.50, N = 9SE +/- 1.45, N = 310.6845.7483.64159.1210.6947.6786.4310.8944.2380.41151.6011.0647.61

rk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Broadcast Inner Join Test Time)1000000100000002000000040000000306090120150SE +/- 0.01, N = 3SE +/- 0.28, N = 3SE +/- 0.08, N = 3SE +/- 1.89, N = 3SE +/- 0.13, N = 9SE +/- 0.24, N = 3SE +/- 0.27, N = 3SE +/- 0.13, N = 3SE +/- 0.89, N = 3SE +/- 0.50, N = 3SE +/- 0.18, N = 3SE +/- 0.27, N = 3SE +/- 0.57, N = 38.0442.9081.25157.258.3740.938.4141.1677.56148.668.5844.5983.94

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - SHA-512 Benchmark Time)500100020001001326395265SE +/- 0.11, N = 3SE +/- 0.15, N = 3SE +/- 0.36, N = 3SE +/- 0.05, N = 3SE +/- 0.20, N = 3SE +/- 0.05, N = 3SE +/- 0.24, N = 3SE +/- 0.39, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.34, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 3SE +/- 0.22, N = 3SE +/- 0.39, N = 3SE +/- 0.32, N = 347.8749.2150.8052.6948.8449.4551.0952.8850.7351.6453.0455.2852.6253.5255.1757.05

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 10000000 - Partitions: 100)Group By Test TimeCalculate Pi Benchmark Using DataframeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark160320480640800SE +/- 0.25, N = 3SE +/- 0.09, N = 3SE +/- 0.18, N = 3SE +/- 0.12, N = 3SE +/- 0.71, N = 3SE +/- 0.14, N = 3SE +/- 7.97, N = 3SE +/- 0.24, N = 3SE +/- 0.06, N = 3SE +/- 0.43, N = 3SE +/- 0.21, N = 3SE +/- 1.37, N = 3SE +/- 0.39, N = 3SE +/- 0.70, N = 3SE +/- 0.30, N = 3SE +/- 0.10, N = 3SE +/- 0.56, N = 3SE +/- 0.25, N = 3SE +/- 0.26, N = 3SE +/- 0.32, N = 3SE +/- 3.83, N = 3SE +/- 3.06, N = 3SE +/- 0.29, N = 3SE +/- 0.76, N = 3SE +/- 0.62, N = 3SE +/- 1.64, N = 3SE +/- 0.05, N = 3SE +/- 1.47, N = 323.5032.3538.2943.5844.2655.28681.4823.9031.9737.0742.8543.7152.88580.2925.0534.0241.2847.1047.5257.05722.9026.6231.4938.5843.1943.8852.69581.85

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark)20005001001000160320480640800SE +/- 0.51, N = 3SE +/- 0.70, N = 3SE +/- 0.29, N = 3SE +/- 0.62, N = 3SE +/- 1.02, N = 3SE +/- 1.40, N = 3SE +/- 0.41, N = 3SE +/- 1.47, N = 3SE +/- 7.97, N = 3SE +/- 3.78, N = 3SE +/- 4.78, N = 3SE +/- 6.18, N = 3SE +/- 3.66, N = 3SE +/- 13.31, N = 3SE +/- 5.58, N = 3SE +/- 3.83, N = 3577.92580.29580.46581.78579.55580.37581.17581.85681.48684.23690.24699.96692.06711.60722.36722.90

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark Using Dataframe)10001002000500816243240SE +/- 0.26, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.29, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.32, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.14, N = 3SE +/- 0.18, N = 3SE +/- 0.10, N = 331.3631.5831.8131.9731.4931.6631.6631.7931.9232.1732.2432.3533.8933.9634.0034.02

rk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Group By Test Time)10005001002000612182430SE +/- 0.28, N = 3SE +/- 0.51, N = 3SE +/- 0.25, N = 3SE +/- 0.13, N = 3SE +/- 0.17, N = 3SE +/- 0.20, N = 3SE +/- 0.24, N = 3SE +/- 0.39, N = 3SE +/- 0.36, N = 3SE +/- 1.78, N = 3SE +/- 0.22, N = 3SE +/- 3.06, N = 3SE +/- 0.42, N = 3SE +/- 0.35, N = 3SE +/- 0.28, N = 3SE +/- 0.30, N = 322.2922.3723.5024.0922.3822.6223.9024.1322.4423.8224.1026.6223.2823.8924.8525.05

rk1-rok-nvmerk1-mainline-nvmerk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Repartition Test Time)50010001002000918273645SE +/- 0.25, N = 3SE +/- 0.31, N = 3SE +/- 0.43, N = 3SE +/- 0.08, N = 3SE +/- 0.26, N = 3SE +/- 0.18, N = 3SE +/- 0.22, N = 3SE +/- 0.21, N = 3SE +/- 0.76, N = 3SE +/- 1.07, N = 3SE +/- 0.54, N = 3SE +/- 0.66, N = 3SE +/- 0.23, N = 3SE +/- 0.58, N = 3SE +/- 0.03, N = 3SE +/- 0.56, N = 336.4436.7237.0737.9438.2138.2938.6139.2238.5838.9239.3139.3339.9640.1640.5041.28

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Inner Join Test Time)500100010020001122334455SE +/- 0.32, N = 3SE +/- 0.21, N = 3SE +/- 1.37, N = 3SE +/- 0.15, N = 3SE +/- 0.80, N = 3SE +/- 0.56, N = 3SE +/- 1.64, N = 3SE +/- 1.45, N = 3SE +/- 0.39, N = 3SE +/- 0.12, N = 3SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.42, N = 3SE +/- 0.40, N = 3SE +/- 0.26, N = 3SE +/- 0.21, N = 340.2441.4943.7144.2342.4343.3043.8847.6142.5443.5844.0045.7444.6845.6047.5247.67

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Broadcast Inner Join Test Time)500100020001001122334455SE +/- 0.45, N = 3SE +/- 0.36, N = 3SE +/- 0.13, N = 3SE +/- 0.21, N = 3SE +/- 0.42, N = 3SE +/- 1.25, N = 3SE +/- 0.24, N = 3SE +/- 0.62, N = 3SE +/- 0.24, N = 3SE +/- 0.16, N = 3SE +/- 0.28, N = 3SE +/- 0.71, N = 3SE +/- 0.24, N = 3SE +/- 0.09, N = 3SE +/- 0.27, N = 3SE +/- 0.25, N = 338.3539.2241.1642.8539.1640.9040.9343.1940.9541.9842.9044.2642.6843.4744.5947.10

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 10000000 - Partitions: 500)Group By Test TimeCalculate Pi Benchmark Using DataframeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark150300450600750SE +/- 0.51, N = 3SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.24, N = 3SE +/- 0.39, N = 3SE +/- 0.09, N = 3SE +/- 3.78, N = 3SE +/- 0.17, N = 3SE +/- 0.05, N = 3SE +/- 0.25, N = 3SE +/- 0.45, N = 3SE +/- 0.32, N = 3SE +/- 0.20, N = 3SE +/- 0.62, N = 3SE +/- 0.42, N = 3SE +/- 0.13, N = 3SE +/- 0.58, N = 3SE +/- 0.24, N = 3SE +/- 0.42, N = 3SE +/- 0.11, N = 3SE +/- 3.66, N = 3SE +/- 1.78, N = 3SE +/- 0.11, N = 3SE +/- 1.07, N = 3SE +/- 0.42, N = 3SE +/- 0.80, N = 3SE +/- 0.11, N = 3SE +/- 1.02, N = 322.3732.1738.2140.9542.5450.73684.2322.3831.8136.4438.3540.2448.84581.7823.2833.8940.1642.6844.6852.62692.0623.8231.7938.9239.1642.4347.87579.55

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - SHA-512 Benchmark Time)1005001000200020406080100SE +/- 0.12, N = 3SE +/- 0.16, N = 3SE +/- 0.29, N = 3SE +/- 0.02, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.34, N = 3SE +/- 0.20, N = 3SE +/- 0.11, N = 3SE +/- 0.37, N = 3SE +/- 0.22, N = 3SE +/- 0.31, N = 3SE +/- 0.20, N = 3SE +/- 0.14, N = 388.8190.5691.3991.9689.4891.2492.1992.4293.7995.9296.8597.6596.6899.64100.73101.15

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 20000000 - Partitions: 100)Calculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark150300450600750SE +/- 0.18, N = 3SE +/- 0.47, N = 3SE +/- 0.15, N = 3SE +/- 0.55, N = 3SE +/- 0.48, N = 3SE +/- 0.67, N = 3SE +/- 3.74, N = 3SE +/- 0.07, N = 3SE +/- 0.73, N = 3SE +/- 2.01, N = 3SE +/- 0.59, N = 3SE +/- 1.13, N = 3SE +/- 0.12, N = 3SE +/- 1.38, N = 3SE +/- 0.23, N = 3SE +/- 0.32, N = 3SE +/- 0.33, N = 3SE +/- 0.43, N = 3SE +/- 0.32, N = 3SE +/- 0.34, N = 3SE +/- 8.48, N = 3SE +/- 0.32, N = 3SE +/- 0.45, N = 3SE +/- 0.55, N = 3SE +/- 0.19, N = 3SE +/- 0.57, N = 3SE +/- 0.22, N = 3SE +/- 8.94, N = 331.6234.4168.1274.6076.8789.48582.8731.8134.6672.3573.6075.6888.81580.5232.2435.5171.5979.2180.9093.79694.6133.7337.1174.3282.0383.9896.68713.91

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark)10002000100500160320480640800SE +/- 0.66, N = 3SE +/- 1.08, N = 3SE +/- 1.38, N = 3SE +/- 0.79, N = 3SE +/- 1.10, N = 3SE +/- 0.28, N = 3SE +/- 3.74, N = 3SE +/- 0.67, N = 3SE +/- 2.10, N = 3SE +/- 4.56, N = 3SE +/- 2.66, N = 3SE +/- 8.48, N = 3SE +/- 8.94, N = 3SE +/- 17.41, N = 3SE +/- 11.19, N = 3SE +/- 22.40, N = 3579.19579.87580.52581.12580.24581.10582.87583.11681.91683.57687.06694.61713.91714.05722.93723.32

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark Using Dataframe)10002000100500816243240SE +/- 0.32, N = 3SE +/- 0.18, N = 3SE +/- 0.15, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.14, N = 3SE +/- 0.15, N = 3SE +/- 0.07, N = 3SE +/- 0.22, N = 3SE +/- 0.15, N = 3SE +/- 0.09, N = 3SE +/- 0.23, N = 3SE +/- 0.25, N = 3SE +/- 0.32, N = 3SE +/- 0.19, N = 3SE +/- 0.11, N = 331.2231.6231.6631.7431.6131.7531.7631.8131.8432.0532.2132.2433.7233.7333.8133.91

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Group By Test Time)10010005002000918273645SE +/- 0.47, N = 3SE +/- 0.44, N = 3SE +/- 0.13, N = 3SE +/- 0.41, N = 3SE +/- 0.73, N = 3SE +/- 2.03, N = 3SE +/- 4.59, N = 3SE +/- 0.15, N = 3SE +/- 0.32, N = 3SE +/- 0.72, N = 3SE +/- 0.46, N = 3SE +/- 0.10, N = 3SE +/- 0.45, N = 3SE +/- 0.79, N = 3SE +/- 0.10, N = 334.4134.7035.9937.1634.6635.8339.2635.2735.5136.3736.7237.0037.1137.3137.35

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Repartition Test Time)5001001000200020406080100SE +/- 0.31, N = 3SE +/- 0.15, N = 3SE +/- 0.20, N = 3SE +/- 0.14, N = 3SE +/- 0.84, N = 3SE +/- 2.01, N = 3SE +/- 1.03, N = 3SE +/- 0.12, N = 3SE +/- 0.33, N = 3SE +/- 0.23, N = 3SE +/- 0.20, N = 3SE +/- 0.15, N = 3SE +/- 0.55, N = 3SE +/- 0.23, N = 3SE +/- 0.46, N = 367.8668.1268.5469.0970.9072.3572.9871.3071.5971.7072.2873.2274.3275.1875.44

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Inner Join Test Time)1005001000200020406080100SE +/- 1.13, N = 3SE +/- 0.49, N = 3SE +/- 0.86, N = 3SE +/- 0.48, N = 3SE +/- 0.10, N = 3SE +/- 0.52, N = 3SE +/- 0.05, N = 3SE +/- 0.32, N = 3SE +/- 0.75, N = 3SE +/- 0.42, N = 3SE +/- 0.31, N = 3SE +/- 0.56, N = 3SE +/- 0.57, N = 3SE +/- 0.32, N = 3SE +/- 0.28, N = 375.6878.0378.4276.8777.6379.2980.4180.9080.9981.3583.6483.8483.9885.1286.43

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Broadcast Inner Join Test Time)1005001000200020406080100SE +/- 0.59, N = 3SE +/- 0.04, N = 3SE +/- 0.83, N = 3SE +/- 0.55, N = 3SE +/- 0.73, N = 3SE +/- 0.20, N = 3SE +/- 0.89, N = 3SE +/- 0.43, N = 3SE +/- 0.09, N = 3SE +/- 0.49, N = 3SE +/- 0.08, N = 3SE +/- 0.19, N = 3SE +/- 0.30, N = 3SE +/- 0.57, N = 3SE +/- 0.51, N = 373.6075.2375.9674.6076.2776.6677.5679.2180.6480.7781.2582.0383.5383.9484.01

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 20000000 - Partitions: 500)Calculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark150300450600750SE +/- 0.10, N = 3SE +/- 0.13, N = 3SE +/- 0.31, N = 3SE +/- 0.73, N = 3SE +/- 0.10, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.15, N = 3SE +/- 4.59, N = 3SE +/- 0.84, N = 3SE +/- 0.04, N = 3SE +/- 0.49, N = 3SE +/- 0.16, N = 3SE +/- 0.79, N = 3SE +/- 0.22, N = 3SE +/- 0.72, N = 3SE +/- 0.12, N = 3SE +/- 0.49, N = 3SE +/- 0.75, N = 3SE +/- 0.11, N = 3SE +/- 4.56, N = 3SE +/- 0.25, N = 3SE +/- 0.10, N = 3SE +/- 0.15, N = 3SE +/- 0.30, N = 3SE +/- 0.56, N = 3SE +/- 0.31, N = 3SE +/- 17.41, N = 331.7435.9967.8676.2777.6391.24583.1131.7639.2670.9075.2378.0390.56581.1231.8436.3771.3080.7780.9996.85683.5733.7237.0073.2283.5383.8499.64714.05

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - SHA-512 Benchmark Time)500100020001004080120160200SE +/- 0.48, N = 3SE +/- 0.77, N = 3SE +/- 0.42, N = 3SE +/- 0.58, N = 3SE +/- 0.48, N = 3SE +/- 1.56, N = 3SE +/- 0.47, N = 3SE +/- 0.82, N = 3SE +/- 0.55, N = 3SE +/- 0.13, N = 3SE +/- 0.21, N = 3SE +/- 0.84, N = 3SE +/- 0.26, N = 3SE +/- 0.54, N = 3SE +/- 0.40, N = 3SE +/- 0.34, N = 3172.06172.45175.84177.81172.19172.69175.24178.89183.20183.35185.51190.03189.39189.73192.81195.45

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 40000000 - Partitions: 100)Calculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark160320480640800SE +/- 0.38, N = 3SE +/- 0.58, N = 3SE +/- 0.87, N = 3SE +/- 0.10, N = 3SE +/- 3.33, N = 3SE +/- 0.42, N = 3SE +/- 0.60, N = 3SE +/- 1.45, N = 3SE +/- 0.82, N = 3SE +/- 0.68, N = 3SE +/- 0.23, N = 3SE +/- 2.29, N = 3SE +/- 1.31, N = 3SE +/- 1.75, N = 3SE +/- 2.32, N = 3SE +/- 0.84, N = 3SE +/- 1.80, N = 3SE +/- 0.05, N = 3SE +/- 0.34, N = 3SE +/- 8.88, N = 331.57177.81579.9831.7988.01131.38150.05152.87178.89581.1932.0887.32137.28157.88159.01190.03694.6233.63195.45724.99

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark)50020001001000160320480640800SE +/- 0.55, N = 3SE +/- 1.28, N = 3SE +/- 0.68, N = 3SE +/- 1.66, N = 3SE +/- 0.87, N = 3SE +/- 0.86, N = 3SE +/- 0.49, N = 3SE +/- 0.56, N = 3SE +/- 4.60, N = 3SE +/- 1.80, N = 3SE +/- 8.50, N = 3SE +/- 6.51, N = 3SE +/- 16.56, N = 3SE +/- 14.94, N = 3SE +/- 8.88, N = 3SE +/- 6.99, N = 3579.01579.55581.19581.60579.98580.30580.86581.69690.62694.62695.17697.90710.71721.00724.99728.26

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark Using Dataframe)20005001000100816243240SE +/- 0.14, N = 3SE +/- 0.10, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.16, N = 3SE +/- 0.38, N = 3SE +/- 0.10, N = 3SE +/- 0.36, N = 3SE +/- 0.23, N = 3SE +/- 0.31, N = 3SE +/- 0.16, N = 3SE +/- 0.22, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 331.3231.6131.7131.7931.5131.5431.5731.6531.9632.0832.2032.4033.5133.6333.7733.79

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 40000000 - Partitions: 500)Calculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark160320480640800SE +/- 0.11, N = 3SE +/- 0.48, N = 3SE +/- 0.86, N = 3SE +/- 0.09, N = 3SE +/- 1.17, N = 3SE +/- 0.84, N = 3SE +/- 0.76, N = 3SE +/- 1.02, N = 3SE +/- 1.56, N = 3SE +/- 0.55, N = 3SE +/- 0.36, N = 3SE +/- 4.05, N = 3SE +/- 0.58, N = 3SE +/- 0.85, N = 3SE +/- 0.39, N = 3SE +/- 0.55, N = 3SE +/- 4.60, N = 3SE +/- 0.10, N = 3SE +/- 0.26, N = 3SE +/- 6.99, N = 331.51172.06580.3031.7182.35131.53147.55152.21172.69579.0131.9689.23138.04157.08158.11183.20690.6233.77189.39728.26

rk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 10000000 - Partitions: 1000)Group By Test TimeCalculate Pi Benchmark Using DataframeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark160320480640800SE +/- 0.28, N = 3SE +/- 0.32, N = 3SE +/- 0.22, N = 3SE +/- 0.16, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 3SE +/- 4.78, N = 3SE +/- 0.36, N = 3SE +/- 0.04, N = 3SE +/- 0.54, N = 3SE +/- 1.25, N = 3SE +/- 0.56, N = 3SE +/- 0.15, N = 3SE +/- 1.40, N = 3SE +/- 0.20, N = 3SE +/- 0.26, N = 3SE +/- 0.31, N = 3SE +/- 0.36, N = 3SE +/- 0.21, N = 3SE +/- 0.05, N = 3SE +/- 0.29, N = 3SE +/- 0.35, N = 3SE +/- 0.18, N = 3SE +/- 0.23, N = 3SE +/- 0.09, N = 3SE +/- 0.40, N = 3SE +/- 0.22, N = 3SE +/- 5.58, N = 322.2932.2438.6141.9844.0051.64690.2422.4431.6639.3140.9043.3049.21580.3722.6231.3636.7239.2241.4949.45580.4623.8934.0039.9643.4745.6053.52722.36

rk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 10000000 - Partitions: 2000)Group By Test TimeCalculate Pi Benchmark Using DataframeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark150300450600750SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 3SE +/- 0.28, N = 3SE +/- 0.04, N = 3SE +/- 0.34, N = 3SE +/- 6.18, N = 3SE +/- 0.22, N = 3SE +/- 0.14, N = 3SE +/- 0.66, N = 3SE +/- 0.24, N = 3SE +/- 1.45, N = 3SE +/- 0.36, N = 3SE +/- 0.41, N = 3SE +/- 0.39, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 0.24, N = 3SE +/- 0.51, N = 3SE +/- 0.28, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.27, N = 3SE +/- 0.21, N = 3SE +/- 0.39, N = 3SE +/- 13.31, N = 324.0931.9239.2242.9045.7453.04699.9624.1031.6639.3340.9347.6150.80581.1724.1331.5837.9441.1644.2351.09577.9224.8533.9640.5044.5947.6755.17711.60

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 20000000 - Partitions: 1000)Calculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark160320480640800SE +/- 0.32, N = 3SE +/- 0.44, N = 3SE +/- 0.20, N = 3SE +/- 0.20, N = 3SE +/- 0.52, N = 3SE +/- 0.10, N = 3SE +/- 1.10, N = 3SE +/- 0.14, N = 3SE +/- 2.03, N = 3SE +/- 1.03, N = 3SE +/- 0.83, N = 3SE +/- 0.86, N = 3SE +/- 0.29, N = 3SE +/- 0.66, N = 3SE +/- 0.15, N = 3SE +/- 0.15, N = 3SE +/- 0.23, N = 3SE +/- 0.09, N = 3SE +/- 0.42, N = 3SE +/- 0.20, N = 3SE +/- 2.66, N = 3SE +/- 0.19, N = 3SE +/- 0.79, N = 3SE +/- 0.23, N = 3SE +/- 0.51, N = 3SE +/- 0.32, N = 3SE +/- 0.20, N = 3SE +/- 11.19, N = 331.2234.7068.5476.6679.2992.42580.2431.7535.8372.9875.9678.4291.39579.1932.0535.2771.7080.6481.3595.92687.0633.8137.3175.1884.0185.12100.73722.93

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 20000000 - Partitions: 2000)Calculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark160320480640800SE +/- 0.10, N = 3SE +/- 0.02, N = 3SE +/- 1.08, N = 3SE +/- 0.15, N = 3SE +/- 0.41, N = 3SE +/- 0.14, N = 3SE +/- 0.89, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 3SE +/- 0.28, N = 3SE +/- 0.09, N = 3SE +/- 0.46, N = 3SE +/- 0.20, N = 3SE +/- 0.08, N = 3SE +/- 0.31, N = 3SE +/- 0.37, N = 3SE +/- 2.10, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.46, N = 3SE +/- 0.57, N = 3SE +/- 0.28, N = 3SE +/- 0.14, N = 3SE +/- 22.40, N = 331.6191.96579.8731.6637.1669.0977.5680.4192.19581.1032.2136.7272.2881.2583.6497.65681.9133.9137.3575.4483.9486.43101.15723.32

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 40000000 - Partitions: 1000)Calculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark160320480640800SE +/- 0.16, N = 3SE +/- 0.77, N = 3SE +/- 0.56, N = 3SE +/- 0.10, N = 3SE +/- 0.85, N = 3SE +/- 0.93, N = 3SE +/- 1.46, N = 3SE +/- 1.83, N = 3SE +/- 0.48, N = 3SE +/- 1.66, N = 3SE +/- 0.16, N = 3SE +/- 2.33, N = 3SE +/- 0.83, N = 3SE +/- 0.25, N = 3SE +/- 1.92, N = 3SE +/- 0.13, N = 3SE +/- 6.51, N = 3SE +/- 0.22, N = 3SE +/- 0.54, N = 3SE +/- 14.94, N = 331.54172.45581.6931.6179.60131.43147.55151.54172.19581.6032.4088.02138.87158.24162.01183.35697.9033.51189.73721.00

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 40000000 - Partitions: 2000)Calculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeBroadcast Inner Join Test TimeInner Join Test TimeSHA-512 Benchmark TimeCalculate Pi Benchmark150300450600750SE +/- 0.14, N = 3SE +/- 3.36, N = 3SE +/- 0.77, N = 3SE +/- 0.50, N = 3SE +/- 1.01, N = 3SE +/- 0.47, N = 3SE +/- 1.28, N = 3SE +/- 0.10, N = 3SE +/- 0.42, N = 3SE +/- 0.49, N = 3SE +/- 0.31, N = 3SE +/- 4.77, N = 3SE +/- 0.91, N = 3SE +/- 1.89, N = 3SE +/- 1.46, N = 3SE +/- 0.21, N = 3SE +/- 8.50, N = 3SE +/- 0.06, N = 3SE +/- 0.40, N = 3SE +/- 16.56, N = 331.3281.61131.39148.66151.60175.24579.5531.65175.84580.8632.2083.87137.45157.25159.12185.51695.1733.79192.81710.71

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Group By Test Time)1000200050010020406080100SE +/- 0.85, N = 3SE +/- 3.36, N = 3SE +/- 1.17, N = 3SE +/- 3.33, N = 3SE +/- 4.77, N = 3SE +/- 2.29, N = 3SE +/- 2.33, N = 3SE +/- 4.05, N = 379.6081.6182.3588.0183.8787.3288.0289.23

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Repartition Test Time)10020001000500306090120150SE +/- 0.42, N = 3SE +/- 0.77, N = 3SE +/- 0.93, N = 3SE +/- 0.84, N = 3SE +/- 1.31, N = 3SE +/- 0.91, N = 3SE +/- 0.58, N = 3SE +/- 0.83, N = 3131.38131.39131.43131.53137.28137.45138.04138.87

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Inner Join Test Time)100020005001004080120160200SE +/- 1.83, N = 3SE +/- 1.01, N = 3SE +/- 1.02, N = 3SE +/- 1.45, N = 3SE +/- 1.75, N = 3SE +/- 0.39, N = 3SE +/- 1.46, N = 3SE +/- 1.92, N = 3151.54151.60152.21152.87157.88158.11159.12162.01

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Broadcast Inner Join Test Time)500100020001004080120160200SE +/- 0.76, N = 3SE +/- 1.46, N = 3SE +/- 0.50, N = 3SE +/- 0.60, N = 3SE +/- 0.85, N = 3SE +/- 1.89, N = 3SE +/- 0.25, N = 3SE +/- 2.32, N = 3147.55147.55148.66150.05157.08157.25158.24159.01

Apache Spark TPC-H

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Geometric Mean Of All Queries)11.05842.11683.17524.23365.292SE +/- 0.03832583, N = 8SE +/- 0.02205715, N = 34.587961214.70394366

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Comparison (Scale Factor: 1)Q11Q16Q22Q06Q13Q19Q14Q15Q12Geometric Mean Of All QueriesQ20Q08Q02Q10Q07Q04Q03Q05Q17Q09Q18Q01Q2148121620SE +/- 0.00889576, N = 3SE +/- 0.04807800, N = 3SE +/- 0.05419067, N = 3SE +/- 0.06400088, N = 3SE +/- 0.05404231, N = 3SE +/- 0.08247514, N = 3SE +/- 0.09844103, N = 3SE +/- 0.01587727, N = 3SE +/- 0.07812445, N = 3SE +/- 0.02205715, N = 3SE +/- 0.16740673, N = 3SE +/- 0.06585723, N = 3SE +/- 0.07990249, N = 3SE +/- 0.12475642, N = 3SE +/- 0.01424190, N = 3SE +/- 0.17085945, N = 3SE +/- 0.15831346, N = 3SE +/- 0.08288138, N = 3SE +/- 0.11188602, N = 3SE +/- 0.03195754, N = 3SE +/- 0.02944973, N = 3SE +/- 0.17776740, N = 3SE +/- 0.45650715, N = 3SE +/- 0.02504461, N = 8SE +/- 0.04873253, N = 8SE +/- 0.02204410, N = 8SE +/- 0.02994103, N = 8SE +/- 0.40940044, N = 8SE +/- 0.04107179, N = 8SE +/- 0.08797017, N = 8SE +/- 0.02096419, N = 8SE +/- 0.07037349, N = 8SE +/- 0.03832583, N = 8SE +/- 0.02853109, N = 8SE +/- 0.01870892, N = 8SE +/- 0.10497115, N = 8SE +/- 0.08702141, N = 8SE +/- 0.12029949, N = 8SE +/- 0.15490647, N = 8SE +/- 0.07160103, N = 8SE +/- 0.06264325, N = 8SE +/- 0.05677966, N = 8SE +/- 0.06360940, N = 8SE +/- 0.15655408, N = 8SE +/- 0.10385415, N = 8SE +/- 0.09251555, N = 82.229465092.365291432.635502583.144960963.309991523.456161103.483763383.733936314.411468984.703943664.955533355.121564715.125953205.488646355.678459016.219260696.352845996.451014207.480081888.098931318.852170948.9911139818.002487182.230567372.378982932.872663113.002522233.256039713.266044203.417816823.521971974.261494314.587961214.598659945.013944215.176648265.450984965.712453195.946094636.013409676.250915597.148795847.734836888.634209878.8981046716.83148050

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q01)13691215SE +/- 0.10385415, N = 8SE +/- 0.17776740, N = 38.898104678.99111398

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q02)11.16472.32943.49414.65885.8235SE +/- 0.06585723, N = 3SE +/- 0.10497115, N = 85.121564715.17664826

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q03)1246810SE +/- 0.07160103, N = 8SE +/- 0.17085945, N = 36.013409676.21926069

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q04)1246810SE +/- 0.15490647, N = 8SE +/- 0.15831346, N = 35.946094636.35284599

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q05)1246810SE +/- 0.06264325, N = 8SE +/- 0.08288138, N = 36.250915596.45101420

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q06)10.70761.41522.12282.83043.538SE +/- 0.02204410, N = 8SE +/- 0.06400088, N = 32.872663113.14496096

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q07)11.28532.57063.85595.14126.4265SE +/- 0.01424190, N = 3SE +/- 0.12029949, N = 85.678459015.71245319

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q08)11.15332.30663.45994.61325.7665SE +/- 0.01870892, N = 8SE +/- 0.07990249, N = 35.013944215.12595320

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q09)1246810SE +/- 0.06360940, N = 8SE +/- 0.03195754, N = 37.734836888.09893131

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q10)11.23492.46983.70474.93966.1745SE +/- 0.08702141, N = 8SE +/- 0.12475642, N = 35.450984965.48864635

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q11)10.50191.00381.50572.00762.5095SE +/- 0.00889576, N = 3SE +/- 0.02504461, N = 82.229465092.23056737

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q12)10.99261.98522.97783.97044.963SE +/- 0.07037349, N = 8SE +/- 0.07812445, N = 34.261494314.41146898

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q13)10.74471.48942.23412.97883.7235SE +/- 0.02994103, N = 8SE +/- 0.05404231, N = 33.002522233.30999152

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q14)10.78381.56762.35143.13523.919SE +/- 0.08797017, N = 8SE +/- 0.09844103, N = 33.417816823.48376338

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q15)10.84011.68022.52033.36044.2005SE +/- 0.02096419, N = 8SE +/- 0.01587727, N = 33.521971973.73393631

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q16)10.53531.07061.60592.14122.6765SE +/- 0.04807800, N = 3SE +/- 0.04873253, N = 82.365291432.37898293

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q17)1246810SE +/- 0.05677966, N = 8SE +/- 0.11188602, N = 37.148795847.48008188

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q18)1246810SE +/- 0.15655408, N = 8SE +/- 0.02944973, N = 38.634209878.85217094

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q19)10.77761.55522.33283.11043.888SE +/- 0.04107179, N = 8SE +/- 0.08247514, N = 33.266044203.45616110

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q20)11.1152.233.3454.465.575SE +/- 0.02853109, N = 8SE +/- 0.16740673, N = 34.598659944.95553335

rk1-rok-emmcrk1-mainline-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q21)148121620SE +/- 0.09, N = 8SE +/- 0.46, N = 316.8318.00

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q22)10.73261.46522.19782.93043.663SE +/- 0.05419067, N = 3SE +/- 0.40940044, N = 82.635502583.25603971

Scale Factor Comparison

rk1-mainline-emmc: 10: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ./spark-tpch: line 6: echo: write error: No space left on device

rk1-rok-emmc: 10: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ./spark-tpch: line 6: echo: write error: No space left on device

rk1-mainline-emmc: 50: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ./spark-tpch: line 6: echo: write error: No space left on device

rk1-rok-emmc: 50: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ./spark-tpch: line 6: echo: write error: No space left on device

rk1-mainline-emmc: 100: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ./spark-tpch: line 6: echo: write error: No space left on device

rk1-rok-emmc: 100: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ./spark-tpch: line 6: echo: write error: No space left on device

Stargate Digital Audio Workstation

rk1-mainline-nvmerk1-rok-emmcrk1-mainline-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate Comparison (Buffer Size: 512)44100480000960001920000.17930.35860.53790.71720.8965SE +/- 0.000393, N = 3SE +/- 0.000207, N = 3SE +/- 0.000167, N = 3SE +/- 0.000291, N = 3SE +/- 0.006662, N = 12SE +/- 0.006668, N = 12SE +/- 0.000630, N = 3SE +/- 0.000095, N = 3SE +/- 0.000792, N = 3SE +/- 0.000670, N = 3SE +/- 0.000635, N = 3SE +/- 0.000865, N = 3SE +/- 0.010750, N = 3SE +/- 0.003804, N = 3SE +/- 0.000529, N = 3SE +/- 0.000288, N = 3SE +/- 0.000267, N = 3SE +/- 0.000305, N = 3SE +/- 0.000135, N = 3SE +/- 0.000076, N = 30.7970650.7642510.5633470.3732820.7762970.7477070.5912680.3928780.7757920.7437710.5491470.3643850.7705080.7620930.5902210.3917290.3355090.3218430.2255670.1451091. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

rk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Buffer Size Comparison (Sample Rate: 44100)10245120.18480.36960.55440.73920.924SE +/- 0.000098, N = 3SE +/- 0.000393, N = 3SE +/- 0.000730, N = 3SE +/- 0.006662, N = 12SE +/- 0.000258, N = 3SE +/- 0.010750, N = 3SE +/- 0.000604, N = 3SE +/- 0.000792, N = 3SE +/- 0.000223, N = 3SE +/- 0.000267, N = 30.8213730.7970650.8005280.7762970.8000440.7705080.7972600.7757920.3624480.3355091. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Buffer Size Comparison (Sample Rate: 96000)51210240.1330.2660.3990.5320.665SE +/- 0.000630, N = 3SE +/- 0.003479, N = 3SE +/- 0.000529, N = 3SE +/- 0.005146, N = 9SE +/- 0.000195, N = 3SE +/- 0.000167, N = 3SE +/- 0.000339, N = 3SE +/- 0.000635, N = 3SE +/- 0.000279, N = 3SE +/- 0.000135, N = 30.5912680.5586620.5902210.5763900.5852210.5633470.5708350.5491470.2521970.2255671. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Buffer Size Comparison (Sample Rate: 192000)10245120.08870.17740.26610.35480.4435SE +/- 0.000760, N = 3SE +/- 0.000288, N = 3SE +/- 0.000095, N = 3SE +/- 0.003917, N = 3SE +/- 0.000285, N = 3SE +/- 0.000291, N = 3SE +/- 0.000191, N = 3SE +/- 0.000865, N = 3SE +/- 0.000090, N = 3SE +/- 0.000076, N = 30.3942900.3917290.3928780.3911850.3907500.3732820.3815700.3643850.1666060.1451091. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

rk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate Comparison (Buffer Size: 1024)44100480000960001920000.18480.36960.55440.73920.924SE +/- 0.000098, N = 3SE +/- 0.001050, N = 3SE +/- 0.000195, N = 3SE +/- 0.000285, N = 3SE +/- 0.000730, N = 3SE +/- 0.000633, N = 3SE +/- 0.003479, N = 3SE +/- 0.003917, N = 3SE +/- 0.000258, N = 3SE +/- 0.000443, N = 3SE +/- 0.005146, N = 9SE +/- 0.000760, N = 3SE +/- 0.000604, N = 3SE +/- 0.000798, N = 3SE +/- 0.000339, N = 3SE +/- 0.000191, N = 3SE +/- 0.000223, N = 3SE +/- 0.000131, N = 3SE +/- 0.000279, N = 3SE +/- 0.000090, N = 30.8213730.7859610.5852210.3907500.8005280.7678290.5586620.3911850.8000440.7668230.5763900.3942900.7972600.7656160.5708350.3815700.3624480.3481210.2521970.1666061. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

rk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Buffer Size Comparison (Sample Rate: 480000)10245120.17680.35360.53040.70720.884SE +/- 0.001050, N = 3SE +/- 0.000207, N = 3SE +/- 0.000633, N = 3SE +/- 0.006668, N = 12SE +/- 0.000443, N = 3SE +/- 0.003804, N = 3SE +/- 0.000798, N = 3SE +/- 0.000670, N = 3SE +/- 0.000131, N = 3SE +/- 0.000305, N = 30.7859610.7642510.7678290.7477070.7668230.7620930.7656160.7437710.3481210.3218431. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Monkey Audio Encoding

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterMonkey Audio Encoding 3.99.6ComparisonWAV To APE1122334455SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.66, N = 2518.5718.6719.4820.2846.561. (CXX) g++ options: -O3 -pedantic -rdynamic -lrt

FLAC Audio Encoding

rk1-rok-nvmerk1-mainline-nvmerk1-rok-emmcrk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterFLAC Audio Encoding 1.4ComparisonWAV To FLAC20406080100SE +/- 0.02, N = 5SE +/- 0.14, N = 5SE +/- 0.55, N = 25SE +/- 0.33, N = 25SE +/- 0.45, N = 543.5145.3351.6054.3190.291. (CXX) g++ options: -O3 -fvisibility=hidden -logg -lm

LAME MP3 Encoding

rk1-rok-emmcrk1-rok-nvmerk1-mainline-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterLAME MP3 Encoding 3.100ComparisonWAV To MP3612182430SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 311.8911.9612.5013.0524.371. (CC) gcc options: -O3 -ffast-math -funroll-loops -fschedule-insns2 -fbranch-count-reg -fforce-addr -pipe -lncurses -lm

Opus Codec Encoding

rk1-rok-nvmerk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterOpus Codec Encoding 1.4ComparisonWAV To Opus Encode306090120150SE +/- 0.02, N = 5SE +/- 0.31, N = 5SE +/- 0.02, N = 5SE +/- 0.17, N = 5SE +/- 0.17, N = 564.4465.4567.6271.50129.791. (CXX) g++ options: -O3 -fvisibility=hidden -logg -lm

WavPack Audio Encoding

rk1-rok-emmcrk1-mainline-nvmerk1-mainline-emmcpi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterWavPack Audio Encoding 5.3ComparisonWAV To WavPack4080120160200SE +/- 0.05, N = 5SE +/- 0.13, N = 5SE +/- 0.07, N = 5SE +/- 0.08, N = 594.6299.62104.04188.001. (CXX) g++ options: -rdynamic

ClickHouse

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5Comparison100M Rows Hits Dataset, Second Run100M Rows Hits Dataset, Third Run100M Rows Hits Dataset, First Run / Cold Cache1020304050SE +/- 0.67, N = 3SE +/- 0.37, N = 3SE +/- 0.56, N = 3SE +/- 0.71, N = 3SE +/- 0.32, N = 3SE +/- 0.29, N = 346.1545.7243.4541.8141.3738.83

Apache Spark TPC-DS

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q01)11050100510152025SE +/- 0.10, N = 3SE +/- 0.14, N = 4SE +/- 0.04, N = 3SE +/- 0.10, N = 4SE +/- 0.02, N = 3SE +/- 0.20, N = 3SE +/- 0.05, N = 38.9311.2915.858.9811.2315.4120.131. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 1)Q24Q39Q98Q12Q20Q37Q96Q94Q41Q16Q61Q55Q90Q42Q52Q03Q84Q43Q95Q15Q45Q92Q99Q62Q48Q32Q93Q63Q26Q53Q09Q21Q40Q19Q86Q23Q91Q13Q73Q34Q79Q07Q68Q50Q44Q46Q89Q08Q81Q76Q36Q82Q01Q27Q71Q30Q14Q59Q06Q83Q02Q97Q56Q58Q33Q87Q38Q65Q60Q70Q22Q18Q57Q49Q54Q69Q28Q29Q25Q35Q77Q66Q88Q10Q17Q74Q05Q85Q31Q67Q47Q11Q51Q80Q78Q75Q04Q64Q72510152025SE +/- 0.05, N = 4SE +/- 0.12, N = 4SE +/- 0.02, N = 4SE +/- 0.02, N = 4SE +/- 0.02, N = 4SE +/- 0.09, N = 3SE +/- 0.03, N = 4SE +/- 0.03, N = 4SE +/- 0.05, N = 4SE +/- 0.10, N = 4SE +/- 0.01, N = 3SE +/- 0.06, N = 4SE +/- 0.06, N = 4SE +/- 0.03, N = 4SE +/- 0.02, N = 4SE +/- 0.07, N = 4SE +/- 0.09, N = 4SE +/- 0.04, N = 3SE +/- 0.05, N = 4SE +/- 0.02, N = 4SE +/- 0.03, N = 4SE +/- 0.02, N = 2SE +/- 0.07, N = 4SE +/- 0.04, N = 4SE +/- 0.04, N = 3SE +/- 0.08, N = 4SE +/- 0.06, N = 3SE +/- 0.14, N = 4SE +/- 0.05, N = 3SE +/- 0.05, N = 4SE +/- 0.07, N = 4SE +/- 0.08, N = 4SE +/- 0.04, N = 3SE +/- 0.05, N = 4SE +/- 0.11, N = 4SE +/- 0.23, N = 4SE +/- 0.06, N = 4SE +/- 0.05, N = 4SE +/- 0.11, N = 4SE +/- 0.06, N = 4SE +/- 0.04, N = 4SE +/- 0.07, N = 4SE +/- 0.13, N = 2SE +/- 0.03, N = 4SE +/- 0.06, N = 3SE +/- 0.14, N = 4SE +/- 0.10, N = 4SE +/- 0.01, N = 4SE +/- 0.10, N = 4SE +/- 0.12, N = 3SE +/- 0.07, N = 4SE +/- 0.08, N = 3SE +/- 0.10, N = 4SE +/- 0.05, N = 4SE +/- 0.11, N = 4SE +/- 0.10, N = 4SE +/- 0.04, N = 4SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 4SE +/- 0.06, N = 4SE +/- 0.06, N = 4SE +/- 0.05, N = 4SE +/- 0.05, N = 2SE +/- 0.09, N = 4SE +/- 0.05, N = 4SE +/- 0.05, N = 4SE +/- 0.10, N = 3SE +/- 0.06, N = 4SE +/- 0.15, N = 3SE +/- 0.18, N = 4SE +/- 0.08, N = 4SE +/- 0.07, N = 4SE +/- 0.08, N = 4SE +/- 0.10, N = 4SE +/- 0.18, N = 4SE +/- 0.12, N = 3SE +/- 0.04, N = 4SE +/- 0.11, N = 4SE +/- 0.13, N = 3SE +/- 0.05, N = 4SE +/- 0.12, N = 3SE +/- 0.08, N = 4SE +/- 0.16, N = 4SE +/- 0.11, N = 4SE +/- 0.19, N = 3SE +/- 0.05, N = 4SE +/- 0.12, N = 4SE +/- 0.13, N = 4SE +/- 0.14, N = 4SE +/- 0.16, N = 4SE +/- 0.05, N = 4SE +/- 0.19, N = 4SE +/- 0.10, N = 4SE +/- 0.13, N = 4SE +/- 0.07, N = 4SE +/- 0.10, N = 4SE +/- 0.19, N = 4SE +/- 0.25, N = 4SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 2SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.16, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 2SE +/- 0.05, N = 3SE +/- 0.22, N = 2SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.13, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.16, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 2SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.19, N = 3SE +/- 0.02, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.01, N = 2SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 2SE +/- 0.10, N = 2SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.33, N = 3SE +/- 0.15, N = 2SE +/- 0.03, N = 3SE +/- 0.14, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 2SE +/- 0.07, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 2SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.19, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.28, N = 3SE +/- 0.21, N = 3SE +/- 0.08, N = 2SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 0.17, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.17, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.14, N = 2SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.19, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.15, N = 3SE +/- 0.22, N = 3SE +/- 0.18, N = 3SE +/- 0.12, N = 32.683.724.854.904.945.095.736.096.226.296.496.576.636.726.736.797.157.267.307.497.607.627.657.707.757.797.837.887.887.907.907.918.008.028.048.078.198.318.408.448.468.538.618.618.698.758.788.808.818.838.868.878.988.999.039.049.119.249.269.339.699.839.879.9210.0410.0710.0810.1910.2710.3510.4210.5810.7610.7710.8910.9511.0211.1911.2711.2711.3911.3911.4811.5311.7911.8611.9511.9912.0812.2912.4312.7013.2213.5214.2614.3315.0417.1919.112.723.764.874.954.975.225.756.116.236.316.546.706.756.766.786.807.137.247.467.537.577.587.637.687.717.797.837.887.897.897.998.078.088.138.178.198.268.308.328.418.468.488.518.568.648.678.708.758.768.828.888.938.999.009.019.099.119.129.219.259.719.779.8810.0910.1010.1710.1810.2010.2510.2910.5910.6410.7511.0711.1411.1411.1611.2111.2211.2411.2711.4511.6311.7211.7211.8312.0012.0812.1112.3112.5912.7513.3013.4514.0314.4315.1617.1519.611. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q02)11050100500714212835SE +/- 0.06, N = 4SE +/- 0.36, N = 3SE +/- 0.09, N = 3SE +/- 0.29, N = 3SE +/- 0.07, N = 2SE +/- 0.14, N = 3SE +/- 0.25, N = 4SE +/- 0.12, N = 39.6911.6317.5827.5527.909.7711.3217.551. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q03)11050500100510152025SE +/- 0.03, N = 3SE +/- 0.03, N = 4SE +/- 0.08, N = 3SE +/- 0.07, N = 4SE +/- 0.17, N = 3SE +/- 0.28, N = 3SE +/- 0.21, N = 2SE +/- 0.20, N = 36.758.4814.186.799.0214.1219.4819.511. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q04)110501004080120160200SE +/- 0.10, N = 4SE +/- 0.31, N = 3SE +/- 0.72, N = 3SE +/- 1.16, N = 3SE +/- 0.22, N = 3SE +/- 0.36, N = 4SE +/- 0.56, N = 315.0448.88153.78192.4515.1650.14154.311. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q05)110501001530456075SE +/- 0.11, N = 4SE +/- 0.60, N = 3SE +/- 1.08, N = 3SE +/- 0.44, N = 3SE +/- 0.19, N = 3SE +/- 0.37, N = 4SE +/- 0.56, N = 311.7923.3843.7466.7412.1123.8543.171. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q06)110500100501122334455SE +/- 0.03, N = 3SE +/- 0.14, N = 4SE +/- 0.91, N = 3SE +/- 0.05, N = 4SE +/- 0.30, N = 3SE +/- 0.05, N = 2SE +/- 0.17, N = 3SE +/- 0.46, N = 39.1118.8149.099.3319.4023.6123.7447.671. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q07)11050500100714212835SE +/- 0.04, N = 4SE +/- 0.10, N = 3SE +/- 0.21, N = 3SE +/- 1.17, N = 2SE +/- 0.64, N = 3SE +/- 0.10, N = 3SE +/- 0.32, N = 4SE +/- 0.48, N = 38.4612.7620.7227.8329.328.4812.5821.521. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q08)11050100500510152025SE +/- 0.12, N = 3SE +/- 0.13, N = 4SE +/- 0.44, N = 3SE +/- 0.01, N = 4SE +/- 0.14, N = 3SE +/- 0.26, N = 3SE +/- 0.28, N = 3SE +/- 0.13, N = 28.7511.8317.208.8011.8417.2722.2422.661. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q09)11050500100918273645SE +/- 0.05, N = 4SE +/- 0.28, N = 3SE +/- 0.16, N = 3SE +/- 0.61, N = 2SE +/- 0.49, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 4SE +/- 0.25, N = 37.9011.8324.4639.8041.198.1912.0524.131. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q10)11050100500714212835SE +/- 0.17, N = 3SE +/- 0.12, N = 4SE +/- 0.37, N = 3SE +/- 0.16, N = 4SE +/- 0.09, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 3SE +/- 1.72, N = 211.4514.1420.1611.5314.3320.2427.5927.691. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q11)11050100306090120150SE +/- 0.05, N = 4SE +/- 0.37, N = 3SE +/- 0.53, N = 3SE +/- 0.56, N = 3SE +/- 0.10, N = 3SE +/- 0.27, N = 4SE +/- 0.28, N = 312.7035.90101.84121.6512.7535.77103.281. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q12)110501005001.18582.37163.55744.74325.929SE +/- 0.02, N = 4SE +/- 0.03, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 2SE +/- 0.02, N = 3SE +/- 0.04, N = 4SE +/- 0.08, N = 34.905.145.215.225.234.955.145.271. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q13)11050100500714212835SE +/- 0.16, N = 3SE +/- 0.16, N = 4SE +/- 0.11, N = 3SE +/- 0.11, N = 4SE +/- 0.10, N = 3SE +/- 0.17, N = 3SE +/- 0.50, N = 3SE +/- 0.38, N = 28.2611.8019.788.4011.4319.4528.1928.721. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q14)1105050010020406080100SE +/- 0.33, N = 3SE +/- 0.35, N = 4SE +/- 0.35, N = 3SE +/- 0.11, N = 4SE +/- 0.58, N = 3SE +/- 2.04, N = 3SE +/- 1.32, N = 3SE +/- 2.66, N = 39.0122.7675.669.0322.1977.16100.36101.621. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q15)11050500100612182430SE +/- 0.02, N = 4SE +/- 0.19, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.30, N = 3SE +/- 0.09, N = 3SE +/- 0.21, N = 4SE +/- 0.24, N = 37.4910.3317.5926.1126.197.5710.3917.771. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q16)1246810SE +/- 0.10, N = 4SE +/- 0.16, N = 36.296.311. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q17)11010050050306090120150SE +/- 0.10, N = 3SE +/- 0.36, N = 4SE +/- 1.40, N = 3SE +/- 0.12, N = 4SE +/- 0.15, N = 3SE +/- 0.40, N = 3SE +/- 0.71, N = 3SE +/- 0.43, N = 311.7235.11119.3511.9934.6842.9243.55119.311. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q18)11050500100714212835SE +/- 0.08, N = 4SE +/- 0.21, N = 3SE +/- 0.21, N = 3SE +/- 0.23, N = 3SE +/- 0.54, N = 3SE +/- 0.19, N = 3SE +/- 0.12, N = 4SE +/- 0.20, N = 310.5813.8121.4127.7327.8810.5913.7820.871. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q19)11050100500612182430SE +/- 0.05, N = 4SE +/- 0.22, N = 3SE +/- 0.37, N = 3SE +/- 0.67, N = 3SE +/- 0.52, N = 3SE +/- 0.09, N = 3SE +/- 0.21, N = 4SE +/- 0.18, N = 38.0211.1517.8925.5725.808.1711.8118.231. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q20)110505001001.1972.3943.5914.7885.985SE +/- 0.02, N = 4SE +/- 0.05, N = 3SE +/- 0.02, N = 2SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 4SE +/- 0.08, N = 34.945.055.225.275.324.975.095.211. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q21)11050100500510152025SE +/- 0.08, N = 4SE +/- 0.17, N = 3SE +/- 0.34, N = 3SE +/- 0.09, N = 3SE +/- 0.28, N = 3SE +/- 0.03, N = 3SE +/- 0.17, N = 4SE +/- 0.26, N = 37.9112.1015.8320.5721.027.9912.5415.801. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q22)110501005001428425670SE +/- 0.18, N = 4SE +/- 0.14, N = 3SE +/- 0.38, N = 3SE +/- 0.29, N = 3SE +/- 0.40, N = 3SE +/- 0.05, N = 3SE +/- 0.40, N = 4SE +/- 0.54, N = 310.4226.9436.6660.7561.5010.7526.5736.121. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q23)1105010050100150200250SE +/- 0.23, N = 4SE +/- 0.46, N = 3SE +/- 1.31, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.43, N = 4SE +/- 1.35, N = 38.0733.70173.15223.128.0833.00178.131. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q24)110100501326395265SE +/- 0.05, N = 4SE +/- 0.64, N = 3SE +/- 0.74, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.11, N = 4SE +/- 0.49, N = 32.6816.7939.9956.782.7217.4657.151. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q25)11050010050306090120150SE +/- 0.12, N = 3SE +/- 0.27, N = 4SE +/- 1.06, N = 3SE +/- 0.11, N = 4SE +/- 0.79, N = 3SE +/- 0.28, N = 3SE +/- 0.33, N = 3SE +/- 0.72, N = 311.2135.36112.6511.2735.4741.3041.97109.511. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q26)11050100500510152025SE +/- 0.14, N = 4SE +/- 0.29, N = 3SE +/- 0.30, N = 3SE +/- 0.57, N = 3SE +/- 0.61, N = 3SE +/- 0.06, N = 3SE +/- 0.27, N = 4SE +/- 0.12, N = 37.8810.4816.2320.4420.597.8910.3216.021. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q27)11050100500714212835SE +/- 0.05, N = 4SE +/- 0.27, N = 2SE +/- 0.39, N = 3SE +/- 0.26, N = 3SE +/- 0.46, N = 3SE +/- 0.14, N = 3SE +/- 0.20, N = 4SE +/- 0.47, N = 38.9913.4320.6928.4629.869.1212.9222.101. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q28)110505001001530456075SE +/- 0.12, N = 3SE +/- 0.51, N = 3SE +/- 0.66, N = 3SE +/- 0.64, N = 3SE +/- 2.08, N = 3SE +/- 0.21, N = 3SE +/- 0.21, N = 4SE +/- 0.48, N = 311.0217.5441.6267.0468.1711.1417.4642.771. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q29)11010050306090120150SE +/- 0.04, N = 4SE +/- 0.40, N = 3SE +/- 0.23, N = 3SE +/- 0.16, N = 3SE +/- 0.09, N = 3SE +/- 0.41, N = 4SE +/- 1.14, N = 311.1934.6947.47117.3411.6335.87118.411. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q30)11050500100510152025SE +/- 0.05, N = 3SE +/- 0.06, N = 4SE +/- 0.32, N = 3SE +/- 0.07, N = 3SE +/- 0.16, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.28, N = 39.0011.9115.989.2611.9016.0418.8919.511. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q31)110505001001224364860SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.17, N = 3SE +/- 0.14, N = 4SE +/- 0.63, N = 3SE +/- 0.41, N = 3SE +/- 0.67, N = 3SE +/- 0.70, N = 312.0818.6435.8012.2919.3333.5249.0051.491. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q32)11050500100510152025SE +/- 0.07, N = 3SE +/- 0.25, N = 4SE +/- 0.17, N = 3SE +/- 0.04, N = 4SE +/- 0.14, N = 3SE +/- 0.41, N = 3SE +/- 0.33, N = 3SE +/- 0.17, N = 37.689.7414.407.709.3815.2922.5922.651. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q33)11050500100714212835SE +/- 0.09, N = 4SE +/- 0.26, N = 3SE +/- 0.37, N = 3SE +/- 0.12, N = 3SE +/- 0.45, N = 3SE +/- 0.09, N = 3SE +/- 0.16, N = 4SE +/- 0.40, N = 310.0413.6022.0029.0429.1710.2014.1022.311. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q34)11050500100612182430SE +/- 0.02, N = 3SE +/- 0.22, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 2SE +/- 0.46, N = 3SE +/- 0.11, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 38.4111.9117.688.6112.0417.9122.8123.951. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q35)11050500100816243240SE +/- 0.17, N = 3SE +/- 0.12, N = 4SE +/- 0.27, N = 3SE +/- 0.08, N = 4SE +/- 0.93, N = 3SE +/- 0.22, N = 3SE +/- 0.28, N = 3SE +/- 0.17, N = 311.2215.9125.6011.4816.5725.0736.5036.601. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q36)11050500100714212835SE +/- 0.12, N = 3SE +/- 0.63, N = 3SE +/- 0.63, N = 3SE +/- 0.57, N = 3SE +/- 0.49, N = 3SE +/- 0.06, N = 2SE +/- 0.13, N = 4SE +/- 0.71, N = 38.8312.4822.3930.7331.049.2511.9222.141. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q37)11010050050510152025SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.24, N = 3SE +/- 0.33, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.27, N = 4SE +/- 0.18, N = 35.0913.3620.9921.4022.745.2213.8222.761. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q38)110501005001530456075SE +/- 0.05, N = 4SE +/- 0.11, N = 3SE +/- 0.89, N = 3SE +/- 0.66, N = 3SE +/- 0.18, N = 3SE +/- 0.07, N = 3SE +/- 0.28, N = 4SE +/- 0.66, N = 310.0817.4143.4867.3868.0810.1817.6943.191. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q39)11050100500612182430SE +/- 0.12, N = 4SE +/- 0.20, N = 3SE +/- 0.36, N = 3SE +/- 1.30, N = 3SE +/- 0.37, N = 3SE +/- 0.07, N = 3SE +/- 0.31, N = 4SE +/- 0.36, N = 33.7210.7515.1922.7724.993.7610.4215.191. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q40)110100501020304050SE +/- 0.04, N = 3SE +/- 0.26, N = 3SE +/- 0.17, N = 2SE +/- 0.37, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 4SE +/- 0.58, N = 38.0017.3824.0841.438.0717.6842.821. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q41)11050100500246810SE +/- 0.05, N = 4SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 4SE +/- 0.10, N = 36.227.097.287.297.326.237.177.371. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q42)1105050010048121620SE +/- 0.06, N = 3SE +/- 0.06, N = 4SE +/- 0.30, N = 3SE +/- 0.03, N = 4SE +/- 0.06, N = 3SE +/- 0.34, N = 3SE +/- 0.25, N = 3SE +/- 0.15, N = 36.708.6913.566.728.4413.2517.6117.721. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q43)11050100500510152025SE +/- 0.09, N = 4SE +/- 0.08, N = 3SE +/- 0.30, N = 3SE +/- 0.17, N = 2SE +/- 0.32, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 4SE +/- 0.34, N = 37.158.4213.7718.7119.237.248.5514.171. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q44)10501500100612182430SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 4SE +/- 0.23, N = 3SE +/- 0.66, N = 3SE +/- 0.04, N = 4SE +/- 0.06, N = 3SE +/- 0.13, N = 36.407.848.6125.0325.226.547.748.641. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q45)1105010050048121620SE +/- 0.01, N = 3SE +/- 0.13, N = 4SE +/- 0.13, N = 3SE +/- 0.03, N = 4SE +/- 0.05, N = 3SE +/- 0.28, N = 3SE +/- 0.16, N = 3SE +/- 0.37, N = 37.539.7613.157.609.8413.4616.8616.901. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q46)11050500100714212835SE +/- 0.11, N = 3SE +/- 0.16, N = 4SE +/- 0.27, N = 3SE +/- 0.06, N = 3SE +/- 0.34, N = 3SE +/- 0.09, N = 3SE +/- 0.29, N = 3SE +/- 0.26, N = 38.6712.6622.298.6912.4721.8729.8730.041. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q47)110505001001122334455SE +/- 0.16, N = 4SE +/- 0.08, N = 3SE +/- 0.40, N = 3SE +/- 0.43, N = 3SE +/- 0.31, N = 3SE +/- 0.05, N = 3SE +/- 0.16, N = 4SE +/- 0.22, N = 312.4319.0833.7349.4450.0512.5919.1033.341. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q48)11050100500612182430SE +/- 0.07, N = 4SE +/- 0.09, N = 3SE +/- 0.32, N = 3SE +/- 0.17, N = 3SE +/- 0.27, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 4SE +/- 0.24, N = 37.6510.0016.6723.0023.137.8910.4916.971. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q49)110501001020304050SE +/- 0.08, N = 4SE +/- 0.20, N = 3SE +/- 0.10, N = 3SE +/- 0.18, N = 3SE +/- 0.08, N = 2SE +/- 0.11, N = 4SE +/- 0.37, N = 310.7719.5139.3444.0011.1418.9340.271. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q50)1105010020406080100SE +/- 0.02, N = 3SE +/- 0.25, N = 4SE +/- 0.37, N = 3SE +/- 0.14, N = 4SE +/- 0.22, N = 3SE +/- 0.11, N = 3SE +/- 0.82, N = 38.5622.0050.088.7521.9049.3681.061. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q51)1105010020406080100SE +/- 0.19, N = 4SE +/- 0.17, N = 2SE +/- 0.65, N = 3SE +/- 1.20, N = 3SE +/- 0.07, N = 3SE +/- 0.18, N = 4SE +/- 0.66, N = 313.2226.2858.63101.7213.3026.3259.461. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q52)11050100500510152025SE +/- 0.02, N = 4SE +/- 0.15, N = 3SE +/- 0.10, N = 3SE +/- 0.18, N = 3SE +/- 0.29, N = 3SE +/- 0.08, N = 3SE +/- 0.10, N = 4SE +/- 0.36, N = 36.738.6513.2218.8719.146.788.7613.591. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q53)11050500100510152025SE +/- 0.13, N = 3SE +/- 0.08, N = 4SE +/- 0.18, N = 3SE +/- 0.07, N = 4SE +/- 0.11, N = 3SE +/- 0.25, N = 3SE +/- 0.11, N = 3SE +/- 0.21, N = 37.889.7515.367.909.4614.9419.9620.061. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q54)11010050050918273645SE +/- 0.10, N = 4SE +/- 0.42, N = 3SE +/- 0.19, N = 3SE +/- 0.13, N = 2SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 0.07, N = 4SE +/- 0.16, N = 310.8917.0733.8333.9936.9611.1616.9737.771. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q55)1105050010048121620SE +/- 0.06, N = 4SE +/- 0.19, N = 3SE +/- 0.12, N = 3SE +/- 0.34, N = 3SE +/- 0.36, N = 3SE +/- 0.03, N = 3SE +/- 0.14, N = 4SE +/- 0.23, N = 36.578.7013.6017.9518.226.808.6313.931. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q56)11050100500714212835SE +/- 0.05, N = 4SE +/- 0.14, N = 3SE +/- 0.24, N = 3SE +/- 0.32, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 4SE +/- 0.09, N = 39.8712.8021.1027.5928.059.8813.0220.671. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q57)11050500100714212835SE +/- 0.10, N = 3SE +/- 0.07, N = 4SE +/- 0.60, N = 3SE +/- 0.07, N = 4SE +/- 0.16, N = 3SE +/- 0.03, N = 3SE +/- 0.61, N = 3SE +/- 0.74, N = 310.6416.4824.4410.7616.3824.7831.6331.671. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q58)11050500100816243240SE +/- 0.05, N = 2SE +/- 0.34, N = 3SE +/- 0.28, N = 3SE +/- 1.31, N = 3SE +/- 0.53, N = 3SE +/- 0.04, N = 2SE +/- 0.09, N = 4SE +/- 0.54, N = 39.9214.7424.2034.2135.6110.1713.8424.381. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q60)11050100500714212835SE +/- 0.10, N = 3SE +/- 0.51, N = 3SE +/- 0.21, N = 3SE +/- 0.71, N = 3SE +/- 0.70, N = 3SE +/- 0.04, N = 3SE +/- 0.34, N = 4SE +/- 0.32, N = 310.1914.3222.5730.6931.1710.2514.2123.591. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q61)11010050500246810SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.16, N = 3SE +/- 0.13, N = 3SE +/- 0.17, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 4SE +/- 0.39, N = 26.497.037.517.657.716.547.107.701. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q62)1105050010048121620SE +/- 0.10, N = 4SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.27, N = 3SE +/- 0.07, N = 3SE +/- 0.22, N = 37.639.1912.977.838.9812.6115.6115.661. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q63)11050500100510152025SE +/- 0.05, N = 3SE +/- 0.13, N = 4SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.24, N = 3SE +/- 0.06, N = 2SE +/- 0.31, N = 3SE +/- 0.33, N = 37.799.5515.017.889.8314.7319.8619.931. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q64)110100504080120160200SE +/- 0.18, N = 3SE +/- 0.32, N = 4SE +/- 1.53, N = 3SE +/- 0.19, N = 4SE +/- 0.51, N = 3SE +/- 2.48, N = 3SE +/- 3.02, N = 317.1551.48170.8517.1950.33151.38165.961. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q65)110501001632486480SE +/- 0.02, N = 3SE +/- 0.84, N = 4SE +/- 0.84, N = 3SE +/- 0.06, N = 4SE +/- 0.21, N = 3SE +/- 0.48, N = 3SE +/- 1.31, N = 310.1018.6442.4210.2718.1242.6973.381. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q66)11050500100714212835SE +/- 0.08, N = 3SE +/- 0.18, N = 4SE +/- 0.17, N = 2SE +/- 0.13, N = 3SE +/- 0.16, N = 3SE +/- 0.24, N = 3SE +/- 0.43, N = 3SE +/- 0.44, N = 311.2714.0320.0711.2713.7520.6227.0827.681. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q67)1105010050100150200250SE +/- 0.13, N = 4SE +/- 0.11, N = 3SE +/- 0.51, N = 3SE +/- 1.23, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 4SE +/- 0.63, N = 312.0832.61106.30205.5612.3133.19106.611. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q68)11050500100714212835SE +/- 0.09, N = 3SE +/- 0.14, N = 4SE +/- 0.18, N = 3SE +/- 0.07, N = 4SE +/- 0.27, N = 3SE +/- 0.47, N = 3SE +/- 0.26, N = 3SE +/- 0.84, N = 38.4612.5121.688.5312.8122.6030.4831.311. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q69)11050500100612182430SE +/- 0.18, N = 4SE +/- 0.02, N = 3SE +/- 0.21, N = 2SE +/- 0.42, N = 3SE +/- 0.33, N = 3SE +/- 0.28, N = 3SE +/- 0.17, N = 4SE +/- 0.29, N = 310.9513.9720.1726.0826.7611.0713.8220.281. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q70)11050100500816243240SE +/- 0.01, N = 3SE +/- 0.14, N = 4SE +/- 0.35, N = 3SE +/- 0.15, N = 3SE +/- 0.32, N = 3SE +/- 0.53, N = 3SE +/- 0.83, N = 3SE +/- 1.37, N = 310.2913.4423.7610.3513.7122.9535.1535.881. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q71)11050500100714212835SE +/- 0.08, N = 3SE +/- 0.21, N = 4SE +/- 1.15, N = 2SE +/- 0.10, N = 4SE +/- 0.02, N = 3SE +/- 0.38, N = 3SE +/- 0.82, N = 3SE +/- 0.15, N = 38.9913.1222.279.0412.7123.1930.9131.441. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q72)11010050100200300400500SE +/- 0.25, N = 4SE +/- 0.40, N = 3SE +/- 1.63, N = 3SE +/- 11.04, N = 3SE +/- 0.12, N = 3SE +/- 1.21, N = 4SE +/- 5.27, N = 319.11118.08135.02419.7919.61118.28445.111. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q73)11050500100510152025SE +/- 0.07, N = 3SE +/- 0.10, N = 4SE +/- 0.02, N = 2SE +/- 0.05, N = 4SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.37, N = 3SE +/- 0.46, N = 38.3011.1916.298.3111.1516.6521.3021.921. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q74)11050100306090120150SE +/- 0.08, N = 3SE +/- 0.13, N = 4SE +/- 1.15, N = 3SE +/- 0.05, N = 4SE +/- 0.09, N = 3SE +/- 0.64, N = 3SE +/- 1.38, N = 311.7219.8097.5211.9519.7495.45112.491. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q75)1105010020406080100SE +/- 0.13, N = 4SE +/- 0.38, N = 3SE +/- 1.20, N = 3SE +/- 0.98, N = 3SE +/- 0.15, N = 3SE +/- 0.35, N = 4SE +/- 0.38, N = 314.2627.0459.3796.4214.4327.4959.601. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q76)11050500100714212835SE +/- 0.10, N = 4SE +/- 0.13, N = 2SE +/- 0.40, N = 3SE +/- 0.72, N = 3SE +/- 0.17, N = 3SE +/- 0.03, N = 2SE +/- 0.21, N = 3SE +/- 0.40, N = 38.7812.3020.5928.5929.148.8212.5220.501. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q77)11050100816243240SE +/- 0.08, N = 3SE +/- 0.24, N = 4SE +/- 0.16, N = 3SE +/- 0.05, N = 4SE +/- 0.15, N = 3SE +/- 0.31, N = 3SE +/- 0.30, N = 311.2415.2524.6611.3914.5724.2433.671. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q78)110501004080120160200SE +/- 0.08, N = 3SE +/- 0.31, N = 4SE +/- 0.64, N = 3SE +/- 0.07, N = 4SE +/- 0.13, N = 3SE +/- 2.63, N = 3SE +/- 2.62, N = 314.0344.14145.2914.3343.40145.20186.011. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q79)11050500100714212835SE +/- 0.06, N = 4SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.49, N = 3SE +/- 0.27, N = 3SE +/- 0.19, N = 3SE +/- 0.14, N = 4SE +/- 0.10, N = 38.4411.9921.0430.2730.338.5111.9121.241. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q80)11010050306090120150SE +/- 0.04, N = 3SE +/- 0.46, N = 4SE +/- 2.12, N = 3SE +/- 0.10, N = 4SE +/- 0.75, N = 3SE +/- 1.28, N = 3SE +/- 1.43, N = 313.4548.08154.5313.5247.18100.24154.371. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q81)11050100510152025SE +/- 0.04, N = 3SE +/- 0.17, N = 3SE +/- 0.42, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.16, N = 3SE +/- 0.23, N = 38.7611.5415.868.8711.4615.6018.701. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q82)11050010050918273645SE +/- 0.07, N = 4SE +/- 0.19, N = 3SE +/- 0.43, N = 3SE +/- 0.16, N = 3SE +/- 0.80, N = 3SE +/- 0.10, N = 2SE +/- 0.22, N = 4SE +/- 0.08, N = 38.8616.6426.0226.0638.468.8816.9940.311. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q83)1105010048121620SE +/- 0.06, N = 3SE +/- 0.11, N = 4SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.23, N = 3SE +/- 0.04, N = 3SE +/- 0.25, N = 39.2110.7413.639.2410.7913.2615.751. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q84)110505001003691215SE +/- 0.05, N = 3SE +/- 0.07, N = 4SE +/- 0.21, N = 3SE +/- 0.05, N = 4SE +/- 0.14, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 37.139.1311.687.309.1511.7013.5513.571. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q85)11050500100612182430SE +/- 0.19, N = 3SE +/- 0.29, N = 3SE +/- 0.47, N = 2SE +/- 0.20, N = 3SE +/- 0.30, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 4SE +/- 0.28, N = 311.8614.5620.2224.6025.2312.0014.8519.591. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q86)1105050010048121620SE +/- 0.11, N = 4SE +/- 0.23, N = 3SE +/- 0.23, N = 3SE +/- 0.13, N = 3SE +/- 0.31, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 4SE +/- 0.31, N = 38.049.2812.3015.4015.578.139.1712.231. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q87)110501005001530456075SE +/- 0.05, N = 4SE +/- 0.23, N = 3SE +/- 0.36, N = 3SE +/- 0.15, N = 3SE +/- 0.70, N = 3SE +/- 0.01, N = 3SE +/- 0.72, N = 3SE +/- 0.51, N = 310.0718.0443.6067.9768.1910.0917.6644.421. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q88)110505001001326395265SE +/- 0.12, N = 3SE +/- 0.21, N = 3SE +/- 1.14, N = 3SE +/- 0.43, N = 3SE +/- 1.29, N = 3SE +/- 0.14, N = 2SE +/- 0.39, N = 4SE +/- 0.85, N = 311.3917.4836.1453.7055.6811.8317.1836.301. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q89)11050100500612182430SE +/- 0.01, N = 2SE +/- 0.10, N = 4SE +/- 0.22, N = 3SE +/- 0.10, N = 4SE +/- 0.06, N = 3SE +/- 0.51, N = 3SE +/- 0.16, N = 3SE +/- 0.42, N = 38.7011.0117.658.8110.7817.7023.2223.461. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q90)110505001003691215SE +/- 0.06, N = 4SE +/- 0.13, N = 3SE +/- 0.37, N = 3SE +/- 0.31, N = 3SE +/- 0.43, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 4SE +/- 0.37, N = 36.637.529.8212.1012.116.767.469.971. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q91)110501003691215SE +/- 0.06, N = 4SE +/- 0.25, N = 2SE +/- 0.27, N = 3SE +/- 0.17, N = 3SE +/- 0.04, N = 2SE +/- 0.02, N = 3SE +/- 0.18, N = 38.1910.0010.7312.218.329.7810.921. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q92)1105050010048121620SE +/- 0.06, N = 3SE +/- 0.05, N = 4SE +/- 0.07, N = 3SE +/- 0.08, N = 4SE +/- 0.16, N = 3SE +/- 0.43, N = 3SE +/- 0.44, N = 3SE +/- 0.13, N = 37.589.0712.357.799.0113.1816.0416.241. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q94)11050100714212835SE +/- 0.03, N = 4SE +/- 0.09, N = 3SE +/- 0.44, N = 3SE +/- 0.28, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.33, N = 36.0910.1218.9627.976.119.9319.041. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q95)11050100612182430SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.17, N = 2SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 4SE +/- 0.36, N = 37.2610.1618.1026.657.4610.2118.231. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q96)110501003691215SE +/- 0.03, N = 4SE +/- 0.06, N = 3SE +/- 0.19, N = 3SE +/- 0.19, N = 3SE +/- 0.03, N = 3SE +/- 0.25, N = 3SE +/- 0.08, N = 35.736.6410.1813.535.757.1610.911. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q97)1105010020406080100SE +/- 0.07, N = 3SE +/- 0.17, N = 4SE +/- 0.27, N = 3SE +/- 0.06, N = 4SE +/- 0.33, N = 3SE +/- 0.11, N = 3SE +/- 0.24, N = 39.7116.9948.419.8317.2347.0878.071. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q59)11050500100816243240SE +/- 0.15, N = 2SE +/- 0.10, N = 4SE +/- 0.13, N = 3SE +/- 0.04, N = 4SE +/- 0.23, N = 2SE +/- 0.53, N = 3SE +/- 1.04, N = 3SE +/- 0.85, N = 39.0913.1024.119.1112.5125.2436.0636.211. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q93)11050100306090120150SE +/- 0.02, N = 2SE +/- 0.26, N = 4SE +/- 0.71, N = 3SE +/- 0.04, N = 3SE +/- 0.41, N = 3SE +/- 2.38, N = 3SE +/- 1.70, N = 37.7127.1585.827.7527.0785.15140.111. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q98)110501001.20152.4033.60454.8066.0075SE +/- 0.02, N = 4SE +/- 0.08, N = 2SE +/- 0.14, N = 2SE +/- 0.05, N = 3SE +/- 0.02, N = 2SE +/- 0.02, N = 4SE +/- 0.04, N = 34.855.045.265.344.875.005.161. (CC) gcc options: -O3 -fcommon -lm

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q99)11050100510152025SE +/- 0.02, N = 2SE +/- 0.16, N = 3SE +/- 0.13, N = 3SE +/- 0.64, N = 2SE +/- 0.22, N = 2SE +/- 0.36, N = 3SE +/- 0.29, N = 37.6210.2016.3722.457.8310.2316.261. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 10)Q98Q20Q12Q44Q96Q61Q41Q90Q43Q42Q03Q55Q52Q62Q92Q84Q86Q32Q53Q63Q45Q91Q94Q48Q95Q99Q26Q15Q39Q83Q89Q19Q73Q01Q02Q13Q81Q08Q09Q30Q34Q79Q36Q21Q76Q46Q59Q68Q07Q71Q56Q27Q37Q70Q33Q66Q18Q69Q58Q10Q60Q85Q77Q35Q57Q82Q24Q54Q97Q88Q40Q38Q28Q87Q65Q31Q06Q49Q47Q74Q50Q14Q05Q51Q22Q75Q93Q67Q23Q17Q29Q25Q11Q78Q80Q04Q64Q72306090120150SE +/- 0.02, N = 4SE +/- 0.03, N = 4SE +/- 0.04, N = 4SE +/- 0.04, N = 4SE +/- 0.05, N = 4SE +/- 0.25, N = 3SE +/- 0.07, N = 4SE +/- 0.03, N = 4SE +/- 0.03, N = 4SE +/- 0.09, N = 4SE +/- 0.14, N = 4SE +/- 0.06, N = 4SE +/- 0.10, N = 4SE +/- 0.05, N = 4SE +/- 0.07, N = 4SE +/- 0.04, N = 4SE +/- 0.10, N = 4SE +/- 0.13, N = 4SE +/- 0.25, N = 4SE +/- 0.08, N = 4SE +/- 0.13, N = 4SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 4SE +/- 0.36, N = 3SE +/- 0.27, N = 4SE +/- 0.21, N = 4SE +/- 0.31, N = 4SE +/- 0.10, N = 4SE +/- 0.11, N = 4SE +/- 0.10, N = 4SE +/- 0.10, N = 4SE +/- 0.14, N = 4SE +/- 0.25, N = 4SE +/- 0.17, N = 3SE +/- 0.16, N = 4SE +/- 0.21, N = 4SE +/- 0.13, N = 4SE +/- 0.06, N = 4SE +/- 0.22, N = 3SE +/- 0.14, N = 4SE +/- 0.13, N = 4SE +/- 0.10, N = 4SE +/- 0.14, N = 4SE +/- 0.21, N = 3SE +/- 0.17, N = 4SE +/- 0.32, N = 4SE +/- 0.16, N = 4SE +/- 0.20, N = 4SE +/- 0.11, N = 4SE +/- 0.10, N = 4SE +/- 0.21, N = 4SE +/- 0.14, N = 4SE +/- 0.12, N = 4SE +/- 0.27, N = 4SE +/- 0.17, N = 4SE +/- 0.09, N = 4SE +/- 0.18, N = 4SE +/- 0.16, N = 4SE +/- 0.12, N = 4SE +/- 0.34, N = 4SE +/- 0.03, N = 4SE +/- 0.24, N = 4SE +/- 0.12, N = 4SE +/- 0.07, N = 4SE +/- 0.07, N = 4SE +/- 0.22, N = 4SE +/- 0.17, N = 4SE +/- 0.39, N = 4SE +/- 0.11, N = 4SE +/- 0.21, N = 4SE +/- 0.72, N = 3SE +/- 0.11, N = 4SE +/- 0.28, N = 4SE +/- 0.26, N = 3SE +/- 0.84, N = 4SE +/- 0.14, N = 4SE +/- 0.11, N = 4SE +/- 0.16, N = 4SE +/- 0.13, N = 4SE +/- 0.25, N = 4SE +/- 0.35, N = 4SE +/- 0.37, N = 4SE +/- 0.18, N = 4SE +/- 0.40, N = 4SE +/- 0.26, N = 4SE +/- 0.35, N = 4SE +/- 0.43, N = 4SE +/- 0.13, N = 4SE +/- 0.36, N = 4SE +/- 0.27, N = 4SE +/- 0.27, N = 4SE +/- 0.41, N = 4SE +/- 0.31, N = 4SE +/- 0.46, N = 4SE +/- 0.36, N = 4SE +/- 0.32, N = 4SE +/- 1.21, N = 4SE +/- 0.08, N = 2SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.15, N = 3SE +/- 0.19, N = 3SE +/- 0.13, N = 3SE +/- 0.16, N = 3SE +/- 0.17, N = 3SE +/- 0.14, N = 3SE +/- 0.23, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 3SE +/- 0.24, N = 3SE +/- 0.05, N = 3SE +/- 0.09, N = 3SE +/- 0.25, N = 2SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.16, N = 3SE +/- 0.19, N = 3SE +/- 0.29, N = 3SE +/- 0.20, N = 3SE +/- 0.06, N = 3SE +/- 0.23, N = 3SE +/- 0.22, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.36, N = 3SE +/- 0.28, N = 3SE +/- 0.14, N = 3SE +/- 0.16, N = 3SE +/- 0.05, N = 3SE +/- 0.46, N = 3SE +/- 0.17, N = 3SE +/- 0.13, N = 2SE +/- 0.34, N = 3SE +/- 0.63, N = 3SE +/- 0.23, N = 2SE +/- 0.02, N = 3SE +/- 0.10, N = 3SE +/- 0.14, N = 3SE +/- 0.27, N = 3SE +/- 0.13, N = 3SE +/- 0.27, N = 2SE +/- 0.26, N = 3SE +/- 0.32, N = 3SE +/- 0.16, N = 3SE +/- 0.21, N = 3SE +/- 0.02, N = 3SE +/- 0.51, N = 3SE +/- 0.09, N = 3SE +/- 0.29, N = 3SE +/- 0.15, N = 3SE +/- 0.34, N = 3SE +/- 0.16, N = 3SE +/- 0.93, N = 3SE +/- 0.19, N = 3SE +/- 0.64, N = 3SE +/- 0.42, N = 3SE +/- 0.33, N = 3SE +/- 0.26, N = 3SE +/- 0.11, N = 3SE +/- 0.21, N = 3SE +/- 0.51, N = 3SE +/- 0.23, N = 3SE +/- 0.21, N = 3SE +/- 0.08, N = 3SE +/- 0.63, N = 3SE +/- 0.30, N = 3SE +/- 0.20, N = 3SE +/- 0.09, N = 3SE +/- 0.22, N = 3SE +/- 0.58, N = 3SE +/- 0.60, N = 3SE +/- 0.17, N = 2SE +/- 0.14, N = 3SE +/- 0.38, N = 3SE +/- 0.41, N = 3SE +/- 0.11, N = 3SE +/- 0.46, N = 3SE +/- 0.15, N = 3SE +/- 0.40, N = 3SE +/- 0.79, N = 3SE +/- 0.37, N = 3SE +/- 0.13, N = 3SE +/- 0.75, N = 3SE +/- 0.31, N = 3SE +/- 0.51, N = 3SE +/- 0.40, N = 35.005.095.146.547.107.167.177.468.488.558.638.698.769.079.139.179.199.559.749.759.769.789.9310.2110.2310.3210.3910.4210.4910.7411.0111.1911.2911.3211.5411.8011.8111.8311.9111.9111.9111.9212.0512.5112.5212.5412.5812.6612.9213.0213.1013.1213.4413.7813.8213.8213.8414.0314.1014.1414.2114.8515.2515.9116.4816.9716.9916.9917.1817.4617.4617.6617.6817.6918.6418.6418.8118.9319.1019.8022.0022.7623.8526.3226.5727.1527.4933.0033.1935.1135.3635.7735.8744.1448.0850.1451.48118.285.045.055.146.406.647.037.097.528.428.448.658.708.989.019.029.159.289.389.469.839.8410.0010.0010.1210.1610.2010.3310.4810.7510.7810.7911.1511.1511.2311.4311.4611.6311.8311.8411.9011.9912.0412.1012.3012.4712.4812.5112.7112.7612.8012.8113.3613.4313.6013.7113.7513.8113.9714.3214.3314.5614.5714.7416.3816.5716.6416.7917.0717.2317.3817.4117.4817.5418.0418.1219.0819.3319.4019.5119.7421.9022.1923.3826.2826.9427.0427.0732.6133.7034.6834.6935.4735.9043.4047.1848.8850.33118.081. (CC) gcc options: -O3 -fcommon -lm

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 50)Q98Q12Q20Q41Q61Q44Q90Q96Q91Q84Q86Q92Q62Q45Q52Q42Q83Q55Q43Q03Q32Q63Q53Q39Q01Q81Q21Q30Q26Q99Q73Q48Q08Q02Q15Q89Q34Q19Q95Q94Q13Q85Q66Q10Q69Q76Q56Q27Q07Q18Q79Q68Q46Q33Q36Q71Q60Q37Q70Q59Q09Q58Q77Q57Q35Q47Q31Q22Q88Q54Q82Q49Q40Q28Q65Q05Q38Q87Q97Q06Q50Q24Q51Q75Q14Q93Q74Q11Q67Q25Q29Q17Q78Q04Q80Q64Q23Q72100200300400500SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.10, N = 3SE +/- 0.39, N = 2SE +/- 0.06, N = 3SE +/- 0.37, N = 3SE +/- 0.08, N = 3SE +/- 0.18, N = 3SE +/- 0.21, N = 3SE +/- 0.31, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.13, N = 3SE +/- 0.30, N = 3SE +/- 0.36, N = 3SE +/- 0.08, N = 3SE +/- 0.23, N = 3SE +/- 0.34, N = 3SE +/- 0.08, N = 3SE +/- 0.17, N = 3SE +/- 0.08, N = 3SE +/- 0.36, N = 3SE +/- 0.18, N = 3SE +/- 0.26, N = 3SE +/- 0.04, N = 3SE +/- 0.42, N = 3SE +/- 0.32, N = 3SE +/- 0.12, N = 3SE +/- 0.29, N = 3SE +/- 0.02, N = 2SE +/- 0.24, N = 3SE +/- 0.44, N = 3SE +/- 0.12, N = 3SE +/- 0.22, N = 3SE +/- 0.09, N = 3SE +/- 0.24, N = 3SE +/- 0.18, N = 3SE +/- 0.36, N = 3SE +/- 0.33, N = 3SE +/- 0.28, N = 3SE +/- 0.11, N = 3SE +/- 0.17, N = 2SE +/- 0.37, N = 3SE +/- 0.29, N = 3SE +/- 0.40, N = 3SE +/- 0.09, N = 3SE +/- 0.20, N = 3SE +/- 0.10, N = 3SE +/- 0.48, N = 3SE +/- 0.18, N = 3SE +/- 0.47, N = 3SE +/- 0.71, N = 3SE +/- 1.15, N = 2SE +/- 0.27, N = 3SE +/- 0.40, N = 3SE +/- 0.18, N = 3SE +/- 0.32, N = 3SE +/- 0.35, N = 3SE +/- 0.13, N = 3SE +/- 0.25, N = 3SE +/- 0.54, N = 3SE +/- 0.60, N = 3SE +/- 0.16, N = 3SE +/- 0.27, N = 3SE +/- 0.22, N = 3SE +/- 0.17, N = 3SE +/- 0.54, N = 3SE +/- 0.85, N = 3SE +/- 0.16, N = 3SE +/- 0.37, N = 3SE +/- 0.08, N = 3SE +/- 0.84, N = 3SE +/- 0.48, N = 3SE +/- 0.58, N = 3SE +/- 0.56, N = 3SE +/- 0.66, N = 3SE +/- 0.51, N = 3SE +/- 0.27, N = 3SE +/- 0.91, N = 3SE +/- 0.37, N = 3SE +/- 0.49, N = 3SE +/- 0.66, N = 3SE +/- 0.38, N = 3SE +/- 0.35, N = 3SE +/- 0.71, N = 3SE +/- 1.15, N = 3SE +/- 0.28, N = 3SE +/- 0.63, N = 3SE +/- 1.06, N = 3SE +/- 1.14, N = 3SE +/- 1.40, N = 3SE +/- 0.64, N = 3SE +/- 0.56, N = 3SE +/- 2.12, N = 3SE +/- 1.53, N = 3SE +/- 1.35, N = 3SE +/- 5.27, N = 3SE +/- 0.13, N = 3SE +/- 0.14, N = 2SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.09, N = 3SE +/- 0.37, N = 3SE +/- 0.19, N = 3SE +/- 0.27, N = 3SE +/- 0.09, N = 3SE +/- 0.23, N = 3SE +/- 0.27, N = 3SE +/- 0.43, N = 3SE +/- 0.10, N = 3SE +/- 0.34, N = 3SE +/- 0.04, N = 3SE +/- 0.28, N = 3SE +/- 0.12, N = 3SE +/- 0.30, N = 3SE +/- 0.28, N = 3SE +/- 0.06, N = 2SE +/- 0.25, N = 3SE +/- 0.36, N = 3SE +/- 0.41, N = 3SE +/- 0.20, N = 3SE +/- 0.16, N = 3SE +/- 0.34, N = 3SE +/- 0.07, N = 3SE +/- 0.30, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.32, N = 3SE +/- 0.26, N = 3SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.51, N = 3SE +/- 0.37, N = 3SE +/- 0.11, N = 3SE +/- 0.17, N = 2SE +/- 0.44, N = 3SE +/- 0.17, N = 3SE +/- 0.21, N = 2SE +/- 0.47, N = 2SE +/- 0.15, N = 3SE +/- 0.40, N = 3SE +/- 0.24, N = 3SE +/- 0.39, N = 3SE +/- 0.21, N = 3SE +/- 0.08, N = 3SE +/- 0.24, N = 3SE +/- 0.21, N = 3SE +/- 0.09, N = 3SE +/- 0.37, N = 3SE +/- 0.63, N = 3SE +/- 0.21, N = 3SE +/- 0.47, N = 3SE +/- 0.11, N = 3SE +/- 0.53, N = 3SE +/- 0.38, N = 3SE +/- 0.28, N = 3SE +/- 0.31, N = 3SE +/- 0.16, N = 3SE +/- 0.03, N = 3SE +/- 0.22, N = 3SE +/- 0.53, N = 3SE +/- 0.41, N = 3SE +/- 0.40, N = 3SE +/- 1.14, N = 3SE +/- 0.38, N = 3SE +/- 0.12, N = 3SE +/- 0.80, N = 3SE +/- 0.10, N = 3SE +/- 0.37, N = 3SE +/- 0.66, N = 3SE +/- 0.48, N = 3SE +/- 0.89, N = 3SE +/- 0.36, N = 3SE +/- 1.08, N = 3SE +/- 0.11, N = 3SE +/- 0.46, N = 3SE +/- 0.11, N = 3SE +/- 0.08, N = 3SE +/- 0.65, N = 3SE +/- 1.20, N = 3SE +/- 2.04, N = 3SE +/- 2.38, N = 3SE +/- 0.64, N = 3SE +/- 0.53, N = 3SE +/- 0.51, N = 3SE +/- 0.72, N = 3SE +/- 0.16, N = 3SE +/- 0.43, N = 3SE +/- 2.63, N = 3SE +/- 0.72, N = 3SE +/- 1.43, N = 3SE +/- 3.02, N = 3SE +/- 1.31, N = 3SE +/- 11.04, N = 35.165.215.277.377.707.749.9710.9110.9211.6812.2312.3512.9713.1513.5613.5913.6313.9314.1714.1814.4015.0115.1915.3615.8015.8515.8615.9816.0216.2616.2916.9717.2017.5517.6517.6817.7718.2318.2319.0419.5919.7820.0720.1620.2820.5020.6720.8721.2421.5221.6822.1022.1422.2722.2922.3122.7623.5923.7624.1124.1324.3824.4424.6625.6033.3435.8036.1236.3037.7740.2740.3142.4242.7742.8243.1743.1944.4248.4149.0950.0857.1559.4659.6075.6685.8297.52103.28106.61112.65118.41119.35145.29154.31154.53170.85178.13445.115.215.265.277.287.657.849.8210.1810.7311.7012.3012.6113.1813.2213.2513.2613.4613.6013.7714.1214.7314.9415.1915.2915.4115.6015.8316.0416.2316.3716.6516.6717.2717.5817.5917.7017.8917.9118.1018.9619.4520.1720.2220.2420.5920.6220.6920.7221.0421.1021.4121.8722.0022.3922.5722.6022.7422.9523.1924.2024.2424.4624.7825.0725.2433.5233.7336.1436.6636.9638.4639.3441.4341.6242.6943.4843.6043.7447.0847.6749.3656.7858.6359.3777.1685.1595.45101.84106.30109.51117.34119.31145.20153.78154.37165.96173.15419.791. (CC) gcc options: -O3 -fcommon -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 100)Q12Q20Q98Q41Q61Q90Q91Q96Q84Q86Q62Q83Q92Q45Q42Q55Q81Q43Q52Q03Q30Q63Q53Q01Q26Q21Q37Q73Q08Q99Q32Q39Q48Q89Q06Q34Q40Q44Q85Q19Q82Q15Q95Q69Q02Q10Q56Q66Q18Q94Q13Q27Q76Q33Q07Q46Q79Q60Q36Q68Q71Q57Q77Q54Q70Q58Q59Q35Q24Q09Q25Q17Q49Q29Q47Q31Q88Q22Q05Q38Q87Q28Q65Q97Q50Q75Q80Q14Q51Q74Q11Q72Q93Q64Q78Q04Q67Q2350100150200250SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.16, N = 3SE +/- 0.43, N = 3SE +/- 0.17, N = 3SE +/- 0.19, N = 3SE +/- 0.03, N = 3SE +/- 0.31, N = 3SE +/- 0.22, N = 3SE +/- 0.25, N = 3SE +/- 0.13, N = 3SE +/- 0.16, N = 3SE +/- 0.15, N = 3SE +/- 0.36, N = 3SE +/- 0.23, N = 3SE +/- 0.17, N = 2SE +/- 0.18, N = 3SE +/- 0.20, N = 3SE +/- 0.28, N = 3SE +/- 0.33, N = 3SE +/- 0.21, N = 3SE +/- 0.05, N = 3SE +/- 0.57, N = 3SE +/- 0.09, N = 3SE +/- 0.24, N = 3SE +/- 0.46, N = 3SE +/- 0.28, N = 3SE +/- 0.64, N = 2SE +/- 0.17, N = 3SE +/- 1.30, N = 3SE +/- 0.17, N = 3SE +/- 0.16, N = 3SE +/- 0.17, N = 3SE +/- 0.07, N = 3SE +/- 0.17, N = 2SE +/- 0.66, N = 3SE +/- 0.30, N = 3SE +/- 0.67, N = 3SE +/- 0.16, N = 3SE +/- 0.30, N = 3SE +/- 0.06, N = 3SE +/- 0.33, N = 3SE +/- 0.29, N = 3SE +/- 0.08, N = 3SE +/- 0.32, N = 3SE +/- 0.44, N = 3SE +/- 0.54, N = 3SE +/- 0.28, N = 3SE +/- 0.50, N = 3SE +/- 0.26, N = 3SE +/- 0.17, N = 3SE +/- 0.45, N = 3SE +/- 0.64, N = 3SE +/- 0.26, N = 3SE +/- 0.27, N = 3SE +/- 0.71, N = 3SE +/- 0.49, N = 3SE +/- 0.84, N = 3SE +/- 0.15, N = 3SE +/- 0.74, N = 3SE +/- 0.30, N = 3SE +/- 0.19, N = 3SE +/- 0.83, N = 3SE +/- 0.53, N = 3SE +/- 0.85, N = 3SE +/- 0.17, N = 3SE +/- 0.74, N = 3SE +/- 0.49, N = 3SE +/- 0.33, N = 3SE +/- 0.40, N = 3SE +/- 0.18, N = 3SE +/- 0.23, N = 3SE +/- 0.31, N = 3SE +/- 0.70, N = 3SE +/- 1.29, N = 3SE +/- 0.29, N = 3SE +/- 0.44, N = 3SE +/- 0.66, N = 3SE +/- 0.15, N = 3SE +/- 2.08, N = 3SE +/- 1.31, N = 3SE +/- 0.24, N = 3SE +/- 0.82, N = 3SE +/- 0.98, N = 3SE +/- 1.28, N = 3SE +/- 2.66, N = 3SE +/- 1.20, N = 3SE +/- 1.38, N = 3SE +/- 0.56, N = 3SE +/- 1.63, N = 3SE +/- 1.70, N = 3SE +/- 2.48, N = 3SE +/- 2.62, N = 3SE +/- 1.16, N = 3SE +/- 1.23, N = 3SE +/- 0.08, N = 35.225.325.347.297.5112.1112.2113.5313.5715.5715.6615.7516.2416.8617.7218.2218.7018.7118.8719.5119.5119.9320.0620.1320.4420.5720.9921.9222.2422.4522.6522.7723.0023.2223.7423.9524.0825.2225.2325.5726.0626.1926.6526.7627.5527.5927.5927.6827.8827.9728.1928.4629.1429.1729.3230.0430.3330.6931.0431.3131.4431.6733.6733.8335.1535.6136.2136.6039.9941.1941.9742.9244.0047.4750.0551.4955.6860.7566.7467.3867.9768.1773.3878.0781.0696.42100.24101.62101.72112.49121.65135.02140.11151.38186.01192.45205.56223.121. (CC) gcc options: -O3 -fcommon -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 500)Q20Q12Q41Q61Q90Q84Q86Q62Q92Q45Q42Q55Q30Q52Q43Q03Q63Q53Q26Q21Q73Q37Q32Q08Q34Q48Q89Q06Q85Q39Q44Q19Q82Q69Q15Q66Q10Q18Q07Q02Q56Q76Q13Q33Q27Q46Q79Q68Q36Q71Q60Q57Q54Q58Q70Q59Q35Q09Q25Q17Q31Q47Q88Q22Q28Q38Q87Q1420406080100SE +/- 0.02, N = 2SE +/- 0.09, N = 2SE +/- 0.09, N = 3SE +/- 0.17, N = 3SE +/- 0.31, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 0.07, N = 3SE +/- 0.44, N = 3SE +/- 0.37, N = 3SE +/- 0.25, N = 3SE +/- 0.34, N = 3SE +/- 0.06, N = 3SE +/- 0.29, N = 3SE +/- 0.32, N = 3SE +/- 0.21, N = 2SE +/- 0.31, N = 3SE +/- 0.11, N = 3SE +/- 0.61, N = 3SE +/- 0.28, N = 3SE +/- 0.37, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.13, N = 2SE +/- 0.12, N = 3SE +/- 0.27, N = 3SE +/- 0.42, N = 3SE +/- 0.05, N = 2SE +/- 0.20, N = 3SE +/- 0.37, N = 3SE +/- 0.23, N = 3SE +/- 0.52, N = 3SE +/- 0.43, N = 3SE +/- 0.42, N = 3SE +/- 0.11, N = 3SE +/- 0.43, N = 3SE +/- 1.72, N = 2SE +/- 0.23, N = 3SE +/- 1.17, N = 2SE +/- 0.07, N = 2SE +/- 0.14, N = 3SE +/- 0.72, N = 3SE +/- 0.38, N = 2SE +/- 0.12, N = 3SE +/- 0.46, N = 3SE +/- 0.29, N = 3SE +/- 0.49, N = 3SE +/- 0.26, N = 3SE +/- 0.57, N = 3SE +/- 0.82, N = 3SE +/- 0.70, N = 3SE +/- 0.61, N = 3SE +/- 0.13, N = 2SE +/- 1.31, N = 3SE +/- 1.37, N = 3SE +/- 1.04, N = 3SE +/- 0.28, N = 3SE +/- 0.61, N = 2SE +/- 0.28, N = 3SE +/- 0.71, N = 3SE +/- 0.67, N = 3SE +/- 0.43, N = 3SE +/- 0.43, N = 3SE +/- 0.40, N = 3SE +/- 0.64, N = 3SE +/- 0.18, N = 3SE +/- 0.70, N = 3SE +/- 1.32, N = 35.225.237.327.7112.1013.5515.4015.6116.0416.9017.6117.9518.8919.1419.2319.4819.8619.9620.5921.0221.3021.4022.5922.6622.8123.1323.4623.6124.6024.9925.0325.8026.0226.0826.1127.0827.6927.7327.8327.9028.0528.5928.7229.0429.8629.8730.2730.4830.7330.9131.1731.6333.9934.2135.8836.0636.5039.8041.3043.5549.0049.4453.7061.5067.0468.0868.19100.361. (CC) gcc options: -O3 -fcommon -lm

293 Results Shown

Timed Apache Compilation:
  Comparison:
    Seconds
    Seconds
    Seconds
    Seconds
    Seconds
    Seconds
    Seconds
  Build Comparison:
    Seconds
  Build System Comparison:
    Seconds
  Comparison:
    Seconds
    Seconds
    Seconds
  Build Configuration Comparison:
    Seconds
  Comparison:
    Seconds
    Seconds
    Seconds
    Seconds
  Backend Comparison:
    Nodes Per Second
  Comparison:
    Nodes Per Second
    Nodes Per Second
    Nodes/second
    Seconds
    Seconds
  Benchmark Comparison:
    Microseconds Per Op
    MB/s
  Threads / Copies Comparison:
    Seconds
  50 - 100):
    Requests/sec
  PUT - - 100):
    Requests/sec
  PUT - 50):
    Requests/sec
  50 - 100 - Average Latency):
    ms
  PUT - - 100 - Average Latency):
    ms
  PUT - 50 - - Average Latency):
    ms
  PUT - 50 - 100):
    ms
  100 - 100):
    Requests/sec
  PUT - 100):
    Requests/sec
  100 - 100 - Average Latency):
    ms
  PUT - 100 - - Average Latency):
    ms
  PUT - 100 - 100):
    ms
  50 - 1000):
    Requests/sec
  PUT - - 1000):
    Requests/sec
  50 - 1000 - Average Latency):
    ms
  PUT - - 1000 - Average Latency):
    ms
  PUT - 50 - 1000):
    ms
  500 - 100):
    Requests/sec
  PUT - 500):
    Requests/sec
  500 - 100 - Average Latency):
    ms
  PUT - 500 - - Average Latency):
    ms
  PUT - 500 - 100):
    ms
  100 - 1000):
    Requests/sec
  100 - 1000 - Average Latency):
    ms
  PUT - 100 - 1000):
    ms
  500 - 1000):
    Requests/sec
  500 - 1000 - Average Latency):
    ms
  PUT - 500 - 1000):
    ms
  RANGE - - 100):
    Requests/sec
  RANGE - 50):
    Requests/sec
  RANGE - - 100 - Average Latency):
    ms
  RANGE - 50 - - Average Latency):
    ms
  RANGE - 50 - 100):
    ms
  RANGE - 100):
    Requests/sec
  RANGE - 100 - - Average Latency):
    ms
  RANGE - 100 - 100):
    ms
  RANGE - - 1000):
    Requests/sec
  RANGE - - 1000 - Average Latency):
    ms
  RANGE - 50 - 1000):
    ms
  RANGE - 500):
    Requests/sec
  RANGE - 500 - - Average Latency):
    ms
  RANGE - 500 - 100):
    ms
  RANGE - 100 - 1000):
    ms
  RANGE - 500 - 1000):
    ms
  1000 - 30):
    Seconds
  100 - - 30):
    Seconds
  100 - 1000):
    Seconds
  3000 - 30):
    Seconds
  100 - 3000):
    Seconds
  300 - - 30):
    Seconds
  300 - 1000):
    Seconds
  300 - 3000):
    Seconds
  500 - - 30):
    Seconds
  500 - 1000):
    Seconds
  500 - 3000):
    Seconds
  100 - SHA-512 Benchmark Time):
    Seconds
  1000000 - - SHA-512 Benchmark Time):
    Seconds
  1000000 - 100):
    Seconds
  100 - Calculate Pi Benchmark):
    Seconds
  1000000 - - Calculate Pi Benchmark):
    Seconds
  100 - Calculate Pi Benchmark Using Dataframe):
    Seconds
  1000000 - - Calculate Pi Benchmark Using Dataframe):
    Seconds
  100 - Group By Test Time):
    Seconds
  1000000 - - Group By Test Time):
    Seconds
  100 - Repartition Test Time):
    Seconds
  1000000 - - Repartition Test Time):
    Seconds
  100 - Inner Join Test Time):
    Seconds
  1000000 - - Inner Join Test Time):
    Seconds
  100 - Broadcast Inner Join Test Time):
    Seconds
  1000000 - - Broadcast Inner Join Test Time):
    Seconds
  500 - SHA-512 Benchmark Time):
    Seconds
  1000000 - 500):
    Seconds
  500 - Calculate Pi Benchmark):
    Seconds
  500 - Calculate Pi Benchmark Using Dataframe):
    Seconds
  500 - Group By Test Time):
    Seconds
  500 - Repartition Test Time):
    Seconds
  500 - Inner Join Test Time):
    Seconds
  500 - Broadcast Inner Join Test Time):
    Seconds
  1000 - SHA-512 Benchmark Time):
    Seconds
  1000000 - 1000):
    Seconds
  1000 - Calculate Pi Benchmark):
    Seconds
  1000 - Calculate Pi Benchmark Using Dataframe):
    Seconds
  1000 - Group By Test Time):
    Seconds
  1000 - Repartition Test Time):
    Seconds
  1000 - Inner Join Test Time):
    Seconds
  1000 - Broadcast Inner Join Test Time):
    Seconds
  2000 - SHA-512 Benchmark Time):
    Seconds
  1000000 - 2000):
    Seconds
  2000 - Calculate Pi Benchmark):
    Seconds
  2000 - Calculate Pi Benchmark Using Dataframe):
    Seconds
  2000 - Group By Test Time):
    Seconds
  2000 - Repartition Test Time):
    Seconds
  2000 - Inner Join Test Time):
    Seconds
  2000 - Broadcast Inner Join Test Time):
    Seconds
  10000000 - - SHA-512 Benchmark Time):
    Seconds
  10000000 - 100):
    Seconds
  10000000 - - Calculate Pi Benchmark):
    Seconds
  10000000 - - Calculate Pi Benchmark Using Dataframe):
    Seconds
  10000000 - - Group By Test Time):
    Seconds
  10000000 - - Repartition Test Time):
    Seconds
  10000000 - - Inner Join Test Time):
    Seconds
  10000000 - - Broadcast Inner Join Test Time):
    Seconds
  10000000 - 500):
    Seconds
  20000000 - - SHA-512 Benchmark Time):
    Seconds
  20000000 - 100):
    Seconds
  20000000 - - Calculate Pi Benchmark):
    Seconds
  20000000 - - Calculate Pi Benchmark Using Dataframe):
    Seconds
  20000000 - - Group By Test Time):
    Seconds
  20000000 - - Repartition Test Time):
    Seconds
  20000000 - - Inner Join Test Time):
    Seconds
  20000000 - - Broadcast Inner Join Test Time):
    Seconds
  20000000 - 500):
    Seconds
  40000000 - - SHA-512 Benchmark Time):
    Seconds
  40000000 - 100):
    Seconds
  40000000 - - Calculate Pi Benchmark):
    Seconds
  40000000 - - Calculate Pi Benchmark Using Dataframe):
    Seconds
  40000000 - 500):
    Seconds
  10000000 - 1000):
    Seconds
  10000000 - 2000):
    Seconds
  20000000 - 1000):
    Seconds
  20000000 - 2000):
    Seconds
  40000000 - 1000):
    Seconds
  40000000 - 2000):
    Seconds
  40000000 - - Group By Test Time):
    Seconds
  40000000 - - Repartition Test Time):
    Seconds
  40000000 - - Inner Join Test Time):
    Seconds
  40000000 - - Broadcast Inner Join Test Time):
    Seconds
  Scale Factor Comparison (Geometric Mean Of All Queries):
    Seconds
  1):
    Seconds
  Scale Factor Comparison (Q01):
    Seconds
  Scale Factor Comparison (Q02):
    Seconds
  Scale Factor Comparison (Q03):
    Seconds
  Scale Factor Comparison (Q04):
    Seconds
  Scale Factor Comparison (Q05):
    Seconds
  Scale Factor Comparison (Q06):
    Seconds
  Scale Factor Comparison (Q07):
    Seconds
  Scale Factor Comparison (Q08):
    Seconds
  Scale Factor Comparison (Q09):
    Seconds
  Scale Factor Comparison (Q10):
    Seconds
  Scale Factor Comparison (Q11):
    Seconds
  Scale Factor Comparison (Q12):
    Seconds
  Scale Factor Comparison (Q13):
    Seconds
  Scale Factor Comparison (Q14):
    Seconds
  Scale Factor Comparison (Q15):
    Seconds
  Scale Factor Comparison (Q16):
    Seconds
  Scale Factor Comparison (Q17):
    Seconds
  Scale Factor Comparison (Q18):
    Seconds
  Scale Factor Comparison (Q19):
    Seconds
  Scale Factor Comparison (Q20):
    Seconds
  Scale Factor Comparison (Q21):
    Seconds
  Scale Factor Comparison (Q22):
    Seconds
  512):
    Render Ratio
  44100):
    Render Ratio
  96000):
    Render Ratio
  192000):
    Render Ratio
  1024):
    Render Ratio
  480000):
    Render Ratio
  Comparison:
    Seconds
    Seconds
    Seconds
    Seconds
    Seconds
    Queries Per Minute, Geo Mean
  Scale Factor Comparison (Q01):
    Seconds
  1):
    Seconds
  Scale Factor Comparison (Q02):
    Seconds
  Scale Factor Comparison (Q03):
    Seconds
  Scale Factor Comparison (Q04):
    Seconds
  Scale Factor Comparison (Q05):
    Seconds
  Scale Factor Comparison (Q06):
    Seconds
  Scale Factor Comparison (Q07):
    Seconds
  Scale Factor Comparison (Q08):
    Seconds
  Scale Factor Comparison (Q09):
    Seconds
  Scale Factor Comparison (Q10):
    Seconds
  Scale Factor Comparison (Q11):
    Seconds
  Scale Factor Comparison (Q12):
    Seconds
  Scale Factor Comparison (Q13):
    Seconds
  Scale Factor Comparison (Q14):
    Seconds
  Scale Factor Comparison (Q15):
    Seconds
  Scale Factor Comparison (Q16):
    Seconds
  Scale Factor Comparison (Q17):
    Seconds
  Scale Factor Comparison (Q18):
    Seconds
  Scale Factor Comparison (Q19):
    Seconds
  Scale Factor Comparison (Q20):
    Seconds
  Scale Factor Comparison (Q21):
    Seconds
  Scale Factor Comparison (Q22):
    Seconds
  Scale Factor Comparison (Q23):
    Seconds
  Scale Factor Comparison (Q24):
    Seconds
  Scale Factor Comparison (Q25):
    Seconds
  Scale Factor Comparison (Q26):
    Seconds
  Scale Factor Comparison (Q27):
    Seconds
  Scale Factor Comparison (Q28):
    Seconds
  Scale Factor Comparison (Q29):
    Seconds
  Scale Factor Comparison (Q30):
    Seconds
  Scale Factor Comparison (Q31):
    Seconds
  Scale Factor Comparison (Q32):
    Seconds
  Scale Factor Comparison (Q33):
    Seconds
  Scale Factor Comparison (Q34):
    Seconds
  Scale Factor Comparison (Q35):
    Seconds
  Scale Factor Comparison (Q36):
    Seconds
  Scale Factor Comparison (Q37):
    Seconds
  Scale Factor Comparison (Q38):
    Seconds
  Scale Factor Comparison (Q39):
    Seconds
  Scale Factor Comparison (Q40):
    Seconds
  Scale Factor Comparison (Q41):
    Seconds
  Scale Factor Comparison (Q42):
    Seconds
  Scale Factor Comparison (Q43):
    Seconds
  Scale Factor Comparison (Q44):
    Seconds
  Scale Factor Comparison (Q45):
    Seconds
  Scale Factor Comparison (Q46):
    Seconds
  Scale Factor Comparison (Q47):
    Seconds
  Scale Factor Comparison (Q48):
    Seconds
  Scale Factor Comparison (Q49):
    Seconds
  Scale Factor Comparison (Q50):
    Seconds
  Scale Factor Comparison (Q51):
    Seconds
  Scale Factor Comparison (Q52):
    Seconds
  Scale Factor Comparison (Q53):
    Seconds
  Scale Factor Comparison (Q54):
    Seconds
  Scale Factor Comparison (Q55):
    Seconds
  Scale Factor Comparison (Q56):
    Seconds
  Scale Factor Comparison (Q57):
    Seconds
  Scale Factor Comparison (Q58):
    Seconds
  Scale Factor Comparison (Q60):
    Seconds
  Scale Factor Comparison (Q61):
    Seconds
  Scale Factor Comparison (Q62):
    Seconds
  Scale Factor Comparison (Q63):
    Seconds
  Scale Factor Comparison (Q64):
    Seconds
  Scale Factor Comparison (Q65):
    Seconds
  Scale Factor Comparison (Q66):
    Seconds
  Scale Factor Comparison (Q67):
    Seconds
  Scale Factor Comparison (Q68):
    Seconds
  Scale Factor Comparison (Q69):
    Seconds
  Scale Factor Comparison (Q70):
    Seconds
  Scale Factor Comparison (Q71):
    Seconds
  Scale Factor Comparison (Q72):
    Seconds
  Scale Factor Comparison (Q73):
    Seconds
  Scale Factor Comparison (Q74):
    Seconds
  Scale Factor Comparison (Q75):
    Seconds
  Scale Factor Comparison (Q76):
    Seconds
  Scale Factor Comparison (Q77):
    Seconds
  Scale Factor Comparison (Q78):
    Seconds
  Scale Factor Comparison (Q79):
    Seconds
  Scale Factor Comparison (Q80):
    Seconds
  Scale Factor Comparison (Q81):
    Seconds
  Scale Factor Comparison (Q82):
    Seconds
  Scale Factor Comparison (Q83):
    Seconds
  Scale Factor Comparison (Q84):
    Seconds
  Scale Factor Comparison (Q85):
    Seconds
  Scale Factor Comparison (Q86):
    Seconds
  Scale Factor Comparison (Q87):
    Seconds
  Scale Factor Comparison (Q88):
    Seconds
  Scale Factor Comparison (Q89):
    Seconds
  Scale Factor Comparison (Q90):
    Seconds
  Scale Factor Comparison (Q91):
    Seconds
  Scale Factor Comparison (Q92):
    Seconds
  Scale Factor Comparison (Q94):
    Seconds
  Scale Factor Comparison (Q95):
    Seconds
  Scale Factor Comparison (Q96):
    Seconds
  Scale Factor Comparison (Q97):
    Seconds
  Scale Factor Comparison (Q59):
    Seconds
  Scale Factor Comparison (Q93):
    Seconds
  Scale Factor Comparison (Q98):
    Seconds
  Scale Factor Comparison (Q99):
    Seconds
  10):
    Seconds
  50):
    Seconds
  100):
    Seconds
  500):
    Seconds