rk1-mainline-emmc-run, rk1-mainline-nvme, rok1, pi5-compilation, pi4-raspbian-sd

rk1-mainline-emmc testing on Ubuntu 22.04 via the Phoronix Test Suite. rk1-mainline-nvme: rk1-mainline-nvme testing on Ubuntu 22.04 via the Phoronix Test Suite. rok1: Rockchip ARMv8 Cortex-A76 testing with a Turing Machines RK1 and rockchipdrmfb on Ubuntu 22.04 via the Phoronix Test Suite. pi5-compilation: ARMv8 Cortex-A76 testing on Debian 12 via the Phoronix Test Suite. pi4-raspbian-sd: ARMv8 Cortex-A72 testing on Debian 12 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2405141-NE-RK1EMMCCO86,2405147-NE-RK1MAINLI70,2405142-NE-ROK12186375,2402267-NE-PI5COMPIL39,2402287-NE-PI4RASPBI24&cts=1&ppt=D.

rk1-mainline-emmc-run, rk1-mainline-nvme, rok1, pi5-compilation, pi4-raspbian-sdProcessorMotherboardMemoryDiskGraphicsNetworkChipsetOSKernelVulkanCompilerFile-SystemScreen ResolutionDisplay Serverrk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdrk1-mainline-emmc @ 1.80GHz (4 Cores / 8 Threads)Turing Machines RK132GB1000GB CT1000P3PSSD8 + 31GB BJTD4RUbuntu 22.046.7.0 (aarch64)1.3.255GCC 11.4.0ext4rk1-mainline-nvme @ 1.80GHz (4 Cores / 8 Threads)500GB CT500P3SSD8 + 31GB BJTD4Rrk1-rok-emmc @ 1.80GHz (4 Cores / 8 Threads)rockchipdrmfb5.10.160-rockchip (aarch64)1920x1080Rockchip ARMv8 Cortex-A76 @ 1.80GHz (4 Cores / 8 Threads)ARMv8 Cortex-A76 @ 2.40GHz (4 Cores)Raspberry Pi 5 Model B Rev 1.04096MB500GB CT500P3SSD8Device 1de4:0001Debian 126.1.0-rpi7-rpi-2712 (aarch64)GCC 12.2.0ARMv8 Cortex-A72 @ 1.80GHz (4 Cores)BCM2835 Raspberry Pi 400 Rev 1.0Broadcom BCM271164GB SR64G6.1.0-rpi6-rpi-v8 (aarch64)X ServerOpenBenchmarking.orgKernel Details- rk1-mainline-emmc: Transparent Huge Pages: madvise- rk1-mainline-nvme: Transparent Huge Pages: madvise- pi4-raspbian-sd: snd_bcm2835.enable_headphones=0 snd_bcm2835.enable_hdmi=1 snd_bcm2835.enable_hdmi=0 cfg80211.ieee80211_regdom=USCompiler Details- rk1-mainline-emmc: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - rk1-mainline-nvme: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - rk1-rok-emmc: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - rk1-rok-nvme: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - pi5-raspbian-nvme: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - pi4-raspbian-sd: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v Processor Details- rk1-mainline-emmc: Scaling Governor: rockchip-cpufreq ondemand- rk1-mainline-nvme: Scaling Governor: rockchip-cpufreq performance- rk1-rok-emmc: Scaling Governor: cpufreq-dt performance- rk1-rok-nvme: Scaling Governor: cpufreq-dt performance- pi5-raspbian-nvme: Scaling Governor: cpufreq-dt ondemand- pi4-raspbian-sd: Scaling Governor: cpufreq-dt ondemandPython Details- rk1-mainline-emmc: Python 3.10.12- rk1-mainline-nvme: Python 3.10.12- rk1-rok-emmc: Python 3.10.12- rk1-rok-nvme: Python 3.10.12- pi5-raspbian-nvme: Python 3.11.2- pi4-raspbian-sd: Python 3.11.2Security Details- rk1-mainline-emmc: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - rk1-mainline-nvme: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - rk1-rok-emmc: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - rk1-rok-nvme: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - pi5-raspbian-nvme: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected - pi4-raspbian-sd: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable + srbds: Not affected + tsx_async_abort: Not affected

rk1-mainline-emmc-run, rk1-mainline-nvme, rok1, pi5-compilation, pi4-raspbian-sdspark-tpcds: 3000rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.org

Timed Apache Compilation

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Apache Compilation 2.4.41ComparisonTime To Compile50100150200250SE +/- 0.16, N = 3SE +/- 0.22, N = 3SE +/- 0.26, N = 3SE +/- 0.38, N = 3SE +/- 0.37, N = 3SE +/- 0.49, N = 360.6359.3259.1659.7677.31223.03

Timed FFmpeg Compilation

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.1ComparisonTime To Compile2004006008001000SE +/- 0.50, N = 3SE +/- 0.58, N = 3SE +/- 0.84, N = 3SE +/- 0.36, N = 3SE +/- 0.09, N = 3SE +/- 1.65, N = 3209.95200.28196.60194.15349.94971.00

Timed GCC Compilation

Comparison

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed GCC Compilation 13.2ComparisonTime To Compile9001800270036004500SE +/- 12.28, N = 34406.83

Timed GDB GNU Debugger Compilation

Comparison

rk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed GDB GNU Debugger Compilation 10.2ComparisonTime To Compile90180270360450SE +/- 1.39, N = 3SE +/- 1.63, N = 3249.25393.65

Timed Gem5 Compilation

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 23.0.1ComparisonTime To Compile5001000150020002500SE +/- 3.08, N = 3SE +/- 0.90, N = 3SE +/- 2.55, N = 3SE +/- 0.96, N = 32329.032257.242222.422220.18

Timed Godot Game Engine Compilation

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 4.0ComparisonTime To Compile8001600240032004000SE +/- 7.67, N = 3SE +/- 4.62, N = 3SE +/- 4.83, N = 3SE +/- 6.78, N = 3SE +/- 3.05, N = 31922.641852.591835.921844.363498.30

Timed ImageMagick Compilation

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed ImageMagick Compilation 6.9.0ComparisonTime To Compile50100150200250SE +/- 0.66, N = 3SE +/- 0.50, N = 3SE +/- 0.41, N = 3SE +/- 0.43, N = 3SE +/- 0.49, N = 3120.10115.09114.08112.86211.59

Timed Linux Kernel Compilation

Build Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build Comparisondefconfigallmodconfig2K4K6K8K10KSE +/- 1.10, N = 3SE +/- 4.42, N = 3SE +/- 1.28, N = 3SE +/- 1.62, N = 3SE +/- 5.72, N = 3SE +/- 1.83, N = 3SE +/- 2.04, N = 3SE +/- 2.80, N = 3SE +/- 9.15, N = 3SE +/- 14.83, N = 31199.615759.511160.505536.031138.205375.951131.975371.021904.559463.57

Timed LLVM Compilation

Build System Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System ComparisonNinjaUnix Makefiles8001600240032004000SE +/- 5.47, N = 3SE +/- 5.63, N = 3SE +/- 1.73, N = 3SE +/- 3.39, N = 3SE +/- 3.31, N = 3SE +/- 6.63, N = 3SE +/- 1.23, N = 3SE +/- 2.47, N = 33662.543722.373524.423577.043480.733524.743468.303511.13

Timed MPlayer Compilation

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed MPlayer Compilation 1.5ComparisonTime To Compile60120180240300SE +/- 0.66, N = 3SE +/- 1.17, N = 3SE +/- 1.75, N = 3SE +/- 1.68, N = 3SE +/- 0.06, N = 3158.06152.52148.87150.11254.69

Timed Node.js Compilation

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 19.8.1ComparisonTime To Compile7001400210028003500SE +/- 2.91, N = 3SE +/- 1.20, N = 3SE +/- 3.73, N = 3SE +/- 0.29, N = 33378.823261.913289.073283.24

Timed PHP Compilation

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed PHP Compilation 8.1.9ComparisonTime To Compile110220330440550SE +/- 4.51, N = 3SE +/- 1.19, N = 3SE +/- 2.82, N = 3SE +/- 2.08, N = 3SE +/- 1.64, N = 3364.44334.21346.68343.16519.40

Timed CPython Compilation

Build Configuration Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed CPython Compilation 3.10.6Build Configuration ComparisonDefaultReleased Build, PGO + LTO Optimized200400600800100066.13784.3059.76744.6060.52764.7261.47783.8793.78862.02

Build2

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterBuild2 0.15ComparisonTime To Compile2004006008001000SE +/- 1.02, N = 3SE +/- 2.62, N = 3SE +/- 2.22, N = 3SE +/- 3.79, N = 3SE +/- 4.32, N = 3688.05673.85668.87669.641064.90

Timed Eigen Compilation

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Eigen Compilation 3.3.9ComparisonTime To Compile4080120160200SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 2.34, N = 3SE +/- 1.77, N = 3SE +/- 0.03, N = 3173.21166.90192.10202.51166.00

Timed Erlang/OTP Compilation

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Erlang/OTP Compilation 25.0ComparisonTime To Compile90180270360450SE +/- 0.61, N = 3SE +/- 0.12, N = 3SE +/- 0.77, N = 3SE +/- 0.74, N = 3SE +/- 0.17, N = 3310.70298.12301.84330.42405.21

Timed Wasmer Compilation

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Wasmer Compilation 2.3ComparisonTime To Compile80160240320400SE +/- 0.59, N = 3SE +/- 0.10, N = 3SE +/- 1.67, N = 3SE +/- 1.65, N = 3SE +/- 0.79, N = 3215.92204.89198.46188.16372.861. (CC) gcc options: -ldl -lgcc_s -lutil -lrt -lpthread -lm -lc -pie -nodefaultlibs

LeelaChessZero

Backend Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend ComparisonBLAS246810SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.11, N = 9SE +/- 0.00, N = 3SE +/- 0.00, N = 35566711. (CXX) g++ options: -flto -pthread

TSCP

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgNodes Per Second, More Is BetterTSCP 1.81ComparisonAI Chess Performance200K400K600K800K1000KSE +/- 370.48, N = 5SE +/- 1140.25, N = 5SE +/- 238.60, N = 5SE +/- 239.20, N = 5SE +/- 350.28, N = 5SE +/- 463.49, N = 57385077724868109218121178877794454711. (CC) gcc options: -O3 -march=native

Stockfish

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 15ComparisonTotal Time1.1M2.2M3.3M4.4M5.5MSE +/- 385132.57, N = 9SE +/- 121318.23, N = 9SE +/- 138882.38, N = 7SE +/- 88074.41, N = 9SE +/- 38968.66, N = 9SE +/- 21647.79, N = 95271840487374748637654326446311657211366601. (CXX) g++ options: -lgcov -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -flto -flto=jobserver

asmFish

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgNodes/second, More Is BetterasmFish 2018-07-23Comparison1024 Hash Memory, 26 Depth2M4M6M8M10MSE +/- 75549.20, N = 6SE +/- 43781.35, N = 3SE +/- 65797.59, N = 9SE +/- 44374.95, N = 3SE +/- 34823.82, N = 375838568005820781721077211592767131

m-queens

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is Betterm-queens 1.2ComparisonTime To Solve120240360480600SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.33, N = 3216.46206.45206.26206.40316.59567.491. (CXX) g++ options: -fopenmp -O2 -march=native

N-Queens

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterN-Queens 1.0ComparisonElapsed Time20406080100SE +/- 0.70, N = 15SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 359.4855.7656.1856.2463.00109.661. (CC) gcc options: -static -fopenmp -O3 -march=native

LevelDB

Benchmark Comparison

rk1-mainline-emmcrk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgMicroseconds Per Op, Fewer Is BetterLevelDB 1.23Benchmark ComparisonHot ReadFill SyncOverwriteRandom FillRandom ReadSeek RandomRandom DeleteSequential Fill8001600240032004000SE +/- 0.032, N = 3SE +/- 124.904, N = 15SE +/- 0.512, N = 15SE +/- 0.486, N = 10SE +/- 0.043, N = 3SE +/- 0.148, N = 15SE +/- 0.132, N = 3SE +/- 0.405, N = 3SE +/- 0.014, N = 3SE +/- 80.483, N = 15SE +/- 1.898, N = 5SE +/- 0.770, N = 3SE +/- 0.015, N = 3SE +/- 0.013, N = 3SE +/- 1.094, N = 3SE +/- 0.648, N = 3SE +/- 0.015, N = 3SE +/- 9.836, N = 3SE +/- 0.482, N = 3SE +/- 1.262, N = 3SE +/- 0.015, N = 3SE +/- 0.008, N = 3SE +/- 0.861, N = 3SE +/- 0.569, N = 34.5933015.64662.01361.5504.6066.37655.52759.0314.5203224.474156.267153.4934.4976.275142.858149.8534.5173817.429149.216150.3524.5026.273139.647147.1511. (CXX) g++ options: -fno-exceptions -fno-rtti -O3 -lgmock -lgtest -lsnappy

LevelDB

Benchmark Comparison

rk1-mainline-emmcrk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgMB/s, More Is BetterLevelDB 1.23Benchmark ComparisonFill SyncOverwriteRandom FillSequential Fill48121620SE +/- 0.01, N = 15SE +/- 0.11, N = 15SE +/- 0.11, N = 10SE +/- 0.12, N = 3SE +/- 0.01, N = 15SE +/- 0.06, N = 5SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 30.314.214.315.00.35.55.65.80.25.85.86.01. (CXX) g++ options: -fno-exceptions -fno-rtti -O3 -lgmock -lgtest -lsnappy

SQLite

Threads / Copies Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies Comparison1816243240SE +/- 0.28, N = 15SE +/- 0.11, N = 3SE +/- 0.35, N = 3SE +/- 0.04, N = 336.0731.2836.3033.271. (CC) gcc options: -O2 -lreadline -ltermcap -lz -lm

etcd

Test Comparison (Connections: 50 - Clients: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 50 - Clients: 100)PUTRANGE4K8K12K16K20KSE +/- 548.13, N = 9SE +/- 162.99, N = 9SE +/- 103.48, N = 3SE +/- 149.49, N = 3SE +/- 580.79, N = 9SE +/- 213.67, N = 9SE +/- 13.84, N = 3SE +/- 170.29, N = 69019.798177.7117919.7417702.599143.018026.1217625.6417733.58

etcd

Connections Comparison (Test: PUT - - Clients: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Connections Comparison (Test: PUT - - Clients: 100)501005004K8K12K16K20KSE +/- 548.13, N = 9SE +/- 78.80, N = 3SE +/- 154.99, N = 9SE +/- 103.48, N = 3SE +/- 121.87, N = 3SE +/- 210.10, N = 3SE +/- 580.79, N = 9SE +/- 59.42, N = 3SE +/- 162.97, N = 9SE +/- 13.84, N = 3SE +/- 230.09, N = 3SE +/- 107.83, N = 39019.797525.007773.6817919.7416623.4016740.459143.017417.327555.4817625.6416034.3316067.27

etcd

Clients Comparison (Test: PUT - Connections: 50)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 50)10010007K14K21K28K35KSE +/- 548.13, N = 9SE +/- 452.84, N = 9SE +/- 103.48, N = 3SE +/- 166.43, N = 3SE +/- 580.79, N = 9SE +/- 523.12, N = 12SE +/- 13.84, N = 3SE +/- 97.60, N = 39019.7916573.1917919.7432076.419143.0119495.9717625.6430813.77

etcd

Test Comparison (Connections: 50 - Clients: 100 - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 50 - Clients: 100 - Average Latency)PUTRANGE3691215SE +/- 0.57, N = 9SE +/- 0.23, N = 9SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.55, N = 9SE +/- 0.31, N = 9SE +/- 0.00, N = 3SE +/- 0.05, N = 611.312.25.55.611.112.45.65.6

etcd

Connections Comparison (Test: PUT - - Clients: 100 - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Connections Comparison (Test: PUT - - Clients: 100 - Average Latency)501005003691215SE +/- 0.57, N = 9SE +/- 0.15, N = 3SE +/- 0.25, N = 9SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.55, N = 9SE +/- 0.12, N = 3SE +/- 0.26, N = 9SE +/- 0.00, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 311.313.212.85.55.95.911.113.413.25.66.26.1

etcd

Clients Comparison (Test: PUT - Connections: 50 - - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 50 - - Average Latency)10010001326395265SE +/- 0.57, N = 9SE +/- 1.79, N = 9SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.55, N = 9SE +/- 1.66, N = 12SE +/- 0.00, N = 3SE +/- 0.12, N = 311.359.05.529.911.150.35.630.9

etcd

Comparison (Test: PUT - Connections: 50 - Clients: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 50 - Clients: 100)Average Latency3691215SE +/- 0.57, N = 9SE +/- 0.03, N = 3SE +/- 0.55, N = 9SE +/- 0.00, N = 311.35.511.15.6

etcd

Test Comparison (Connections: 100 - Clients: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 100 - Clients: 100)PUTRANGE4K8K12K16K20KSE +/- 78.80, N = 3SE +/- 43.16, N = 3SE +/- 121.87, N = 3SE +/- 92.45, N = 3SE +/- 59.42, N = 3SE +/- 90.88, N = 3SE +/- 230.09, N = 3SE +/- 51.41, N = 37525.007344.5816623.4016784.837417.327054.6216034.3315796.44

etcd

Clients Comparison (Test: PUT - Connections: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 100)10010006K12K18K24K30KSE +/- 78.80, N = 3SE +/- 392.03, N = 9SE +/- 121.87, N = 3SE +/- 119.58, N = 3SE +/- 59.42, N = 3SE +/- 530.09, N = 12SE +/- 230.09, N = 3SE +/- 97.95, N = 37525.0015482.1316623.4030106.847417.3219163.3516034.3328950.57

etcd

Test Comparison (Connections: 100 - Clients: 100 - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 100 - Clients: 100 - Average Latency)PUTRANGE48121620SE +/- 0.15, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.15, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 313.213.55.95.913.414.06.26.2

etcd

Clients Comparison (Test: PUT - Connections: 100 - - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 100 - - Average Latency)10010001428425670SE +/- 0.15, N = 3SE +/- 1.82, N = 9SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 1.74, N = 12SE +/- 0.09, N = 3SE +/- 0.13, N = 313.263.05.931.713.450.96.232.6

etcd

Comparison (Test: PUT - Connections: 100 - Clients: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 100 - Clients: 100)Average Latency3691215SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 313.25.913.46.2

etcd

Test Comparison (Connections: 50 - Clients: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 50 - Clients: 1000)PUTRANGE7K14K21K28K35KSE +/- 452.84, N = 9SE +/- 428.03, N = 9SE +/- 166.43, N = 3SE +/- 208.41, N = 3SE +/- 523.12, N = 12SE +/- 466.92, N = 12SE +/- 97.60, N = 3SE +/- 55.90, N = 316573.1915862.1232076.4132275.1519495.9718635.5030813.7730789.21

etcd

Connections Comparison (Test: PUT - - Clients: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Connections Comparison (Test: PUT - - Clients: 1000)501005007K14K21K28K35KSE +/- 452.84, N = 9SE +/- 392.03, N = 9SE +/- 131.09, N = 3SE +/- 166.43, N = 3SE +/- 119.58, N = 3SE +/- 6.47, N = 3SE +/- 523.12, N = 12SE +/- 530.09, N = 12SE +/- 178.58, N = 3SE +/- 97.60, N = 3SE +/- 97.95, N = 3SE +/- 76.06, N = 316573.1915482.1313947.8732076.4130106.8422994.3819495.9719163.3516043.0030813.7728950.5721936.54

etcd

Test Comparison (Connections: 50 - Clients: 1000 - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 50 - Clients: 1000 - Average Latency)PUTRANGE1428425670SE +/- 1.79, N = 9SE +/- 1.90, N = 9SE +/- 0.18, N = 3SE +/- 0.22, N = 3SE +/- 1.66, N = 12SE +/- 1.59, N = 12SE +/- 0.12, N = 3SE +/- 0.07, N = 359.061.829.929.750.352.630.931.0

etcd

Connections Comparison (Test: PUT - - Clients: 1000 - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Connections Comparison (Test: PUT - - Clients: 1000 - Average Latency)501005001530456075SE +/- 1.79, N = 9SE +/- 1.82, N = 9SE +/- 0.71, N = 3SE +/- 0.18, N = 3SE +/- 0.12, N = 3SE +/- 0.00, N = 3SE +/- 1.66, N = 12SE +/- 1.74, N = 12SE +/- 0.73, N = 3SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 0.21, N = 359.063.067.829.931.740.650.350.958.730.932.641.9

etcd

Comparison (Test: PUT - Connections: 50 - Clients: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 50 - Clients: 1000)Average Latency1326395265SE +/- 1.79, N = 9SE +/- 0.18, N = 3SE +/- 1.66, N = 12SE +/- 0.12, N = 359.029.950.330.9

etcd

Test Comparison (Connections: 500 - Clients: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 500 - Clients: 100)PUTRANGE4K8K12K16K20KSE +/- 154.99, N = 9SE +/- 186.80, N = 6SE +/- 210.10, N = 3SE +/- 32.79, N = 3SE +/- 162.97, N = 9SE +/- 157.07, N = 9SE +/- 107.83, N = 3SE +/- 51.80, N = 37773.687871.6916740.4516375.197555.487311.1416067.2715844.21

etcd

Clients Comparison (Test: PUT - Connections: 500)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 500)10010005K10K15K20K25KSE +/- 154.99, N = 9SE +/- 131.09, N = 3SE +/- 210.10, N = 3SE +/- 6.47, N = 3SE +/- 162.97, N = 9SE +/- 178.58, N = 3SE +/- 107.83, N = 3SE +/- 76.06, N = 37773.6813947.8716740.4522994.387555.4816043.0016067.2721936.54

etcd

Test Comparison (Connections: 500 - Clients: 100 - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 500 - Clients: 100 - Average Latency)PUTRANGE3691215SE +/- 0.25, N = 9SE +/- 0.31, N = 6SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.26, N = 9SE +/- 0.26, N = 9SE +/- 0.06, N = 3SE +/- 0.00, N = 312.812.65.96.013.213.66.16.2

etcd

Clients Comparison (Test: PUT - Connections: 500 - - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 500 - - Average Latency)10010001530456075SE +/- 0.25, N = 9SE +/- 0.71, N = 3SE +/- 0.06, N = 3SE +/- 0.00, N = 3SE +/- 0.26, N = 9SE +/- 0.73, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 312.867.85.940.613.258.76.141.9

etcd

Comparison (Test: PUT - Connections: 500 - Clients: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 500 - Clients: 100)Average Latency3691215SE +/- 0.25, N = 9SE +/- 0.06, N = 3SE +/- 0.26, N = 9SE +/- 0.06, N = 312.85.913.26.1

etcd

Test Comparison (Connections: 100 - Clients: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 100 - Clients: 1000)PUTRANGE6K12K18K24K30KSE +/- 392.03, N = 9SE +/- 438.82, N = 9SE +/- 119.58, N = 3SE +/- 136.35, N = 3SE +/- 530.09, N = 12SE +/- 414.34, N = 12SE +/- 97.95, N = 3SE +/- 123.00, N = 315482.1315177.0530106.8430214.1019163.3518202.3628950.5728883.95

etcd

Test Comparison (Connections: 100 - Clients: 1000 - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 100 - Clients: 1000 - Average Latency)PUTRANGE1428425670SE +/- 1.82, N = 9SE +/- 2.12, N = 9SE +/- 0.12, N = 3SE +/- 0.15, N = 3SE +/- 1.74, N = 12SE +/- 1.57, N = 12SE +/- 0.13, N = 3SE +/- 0.18, N = 363.064.431.731.650.953.532.632.7

etcd

Comparison (Test: PUT - Connections: 100 - Clients: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 100 - Clients: 1000)Average Latency1428425670SE +/- 1.82, N = 9SE +/- 0.12, N = 3SE +/- 1.74, N = 12SE +/- 0.13, N = 363.031.750.932.6

etcd

Test Comparison (Connections: 500 - Clients: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 500 - Clients: 1000)PUTRANGE5K10K15K20K25KSE +/- 131.09, N = 3SE +/- 181.75, N = 3SE +/- 6.47, N = 3SE +/- 44.26, N = 3SE +/- 178.58, N = 3SE +/- 379.06, N = 6SE +/- 76.06, N = 3SE +/- 41.44, N = 313947.8713685.5922994.3822948.3416043.0015827.1221936.5421829.11

etcd

Test Comparison (Connections: 500 - Clients: 1000 - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 500 - Clients: 1000 - Average Latency)PUTRANGE1530456075SE +/- 0.71, N = 3SE +/- 0.98, N = 3SE +/- 0.00, N = 3SE +/- 0.12, N = 3SE +/- 0.73, N = 3SE +/- 1.51, N = 6SE +/- 0.21, N = 3SE +/- 0.06, N = 367.869.240.640.758.759.841.942.2

etcd

Comparison (Test: PUT - Connections: 500 - Clients: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 500 - Clients: 1000)Average Latency1530456075SE +/- 0.71, N = 3SE +/- 0.00, N = 3SE +/- 0.73, N = 3SE +/- 0.21, N = 367.840.658.741.9

etcd

Connections Comparison (Test: RANGE - - Clients: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Connections Comparison (Test: RANGE - - Clients: 100)501005004K8K12K16K20KSE +/- 162.99, N = 9SE +/- 43.16, N = 3SE +/- 186.80, N = 6SE +/- 149.49, N = 3SE +/- 92.45, N = 3SE +/- 32.79, N = 3SE +/- 213.67, N = 9SE +/- 90.88, N = 3SE +/- 157.07, N = 9SE +/- 170.29, N = 6SE +/- 51.41, N = 3SE +/- 51.80, N = 38177.717344.587871.6917702.5916784.8316375.198026.127054.627311.1417733.5815796.4415844.21

etcd

Clients Comparison (Test: RANGE - Connections: 50)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 50)10010007K14K21K28K35KSE +/- 162.99, N = 9SE +/- 428.03, N = 9SE +/- 149.49, N = 3SE +/- 208.41, N = 3SE +/- 213.67, N = 9SE +/- 466.92, N = 12SE +/- 170.29, N = 6SE +/- 55.90, N = 38177.7115862.1217702.5932275.158026.1218635.5017733.5830789.21

etcd

Connections Comparison (Test: RANGE - - Clients: 100 - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Connections Comparison (Test: RANGE - - Clients: 100 - Average Latency)5010050048121620SE +/- 0.23, N = 9SE +/- 0.09, N = 3SE +/- 0.31, N = 6SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.31, N = 9SE +/- 0.15, N = 3SE +/- 0.26, N = 9SE +/- 0.05, N = 6SE +/- 0.03, N = 3SE +/- 0.00, N = 312.213.512.65.65.96.012.414.013.65.66.26.2

etcd

Clients Comparison (Test: RANGE - Connections: 50 - - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 50 - - Average Latency)10010001428425670SE +/- 0.23, N = 9SE +/- 1.90, N = 9SE +/- 0.06, N = 3SE +/- 0.22, N = 3SE +/- 0.31, N = 9SE +/- 1.59, N = 12SE +/- 0.05, N = 6SE +/- 0.07, N = 312.261.85.629.712.452.65.631.0

etcd

Comparison (Test: RANGE - Connections: 50 - Clients: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 50 - Clients: 100)Average Latency3691215SE +/- 0.23, N = 9SE +/- 0.06, N = 3SE +/- 0.31, N = 9SE +/- 0.05, N = 612.25.612.45.6

etcd

Clients Comparison (Test: RANGE - Connections: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 100)10010006K12K18K24K30KSE +/- 43.16, N = 3SE +/- 438.82, N = 9SE +/- 92.45, N = 3SE +/- 136.35, N = 3SE +/- 90.88, N = 3SE +/- 414.34, N = 12SE +/- 51.41, N = 3SE +/- 123.00, N = 37344.5815177.0516784.8330214.107054.6218202.3615796.4428883.95

etcd

Clients Comparison (Test: RANGE - Connections: 100 - - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 100 - - Average Latency)10010001428425670SE +/- 0.09, N = 3SE +/- 2.12, N = 9SE +/- 0.03, N = 3SE +/- 0.15, N = 3SE +/- 0.15, N = 3SE +/- 1.57, N = 12SE +/- 0.03, N = 3SE +/- 0.18, N = 313.564.45.931.614.053.56.232.7

etcd

Comparison (Test: RANGE - Connections: 100 - Clients: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 100 - Clients: 100)Average Latency48121620SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 313.55.914.06.2

etcd

Connections Comparison (Test: RANGE - - Clients: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Connections Comparison (Test: RANGE - - Clients: 1000)501005007K14K21K28K35KSE +/- 428.03, N = 9SE +/- 438.82, N = 9SE +/- 181.75, N = 3SE +/- 208.41, N = 3SE +/- 136.35, N = 3SE +/- 44.26, N = 3SE +/- 466.92, N = 12SE +/- 414.34, N = 12SE +/- 379.06, N = 6SE +/- 55.90, N = 3SE +/- 123.00, N = 3SE +/- 41.44, N = 315862.1215177.0513685.5932275.1530214.1022948.3418635.5018202.3615827.1230789.2128883.9521829.11

etcd

Connections Comparison (Test: RANGE - - Clients: 1000 - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Connections Comparison (Test: RANGE - - Clients: 1000 - Average Latency)501005001530456075SE +/- 1.90, N = 9SE +/- 2.12, N = 9SE +/- 0.98, N = 3SE +/- 0.22, N = 3SE +/- 0.15, N = 3SE +/- 0.12, N = 3SE +/- 1.59, N = 12SE +/- 1.57, N = 12SE +/- 1.51, N = 6SE +/- 0.07, N = 3SE +/- 0.18, N = 3SE +/- 0.06, N = 361.864.469.229.731.640.752.653.559.831.032.742.2

etcd

Comparison (Test: RANGE - Connections: 50 - Clients: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 50 - Clients: 1000)Average Latency1428425670SE +/- 1.90, N = 9SE +/- 0.22, N = 3SE +/- 1.59, N = 12SE +/- 0.07, N = 361.829.752.631.0

etcd

Clients Comparison (Test: RANGE - Connections: 500)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 500)10010005K10K15K20K25KSE +/- 186.80, N = 6SE +/- 181.75, N = 3SE +/- 32.79, N = 3SE +/- 44.26, N = 3SE +/- 157.07, N = 9SE +/- 379.06, N = 6SE +/- 51.80, N = 3SE +/- 41.44, N = 37871.6913685.5916375.1922948.347311.1415827.1215844.2121829.11

etcd

Clients Comparison (Test: RANGE - Connections: 500 - - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 500 - - Average Latency)10010001530456075SE +/- 0.31, N = 6SE +/- 0.98, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.26, N = 9SE +/- 1.51, N = 6SE +/- 0.00, N = 3SE +/- 0.06, N = 312.669.26.040.713.659.86.242.2

etcd

Comparison (Test: RANGE - Connections: 500 - Clients: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 500 - Clients: 100)Average Latency3691215SE +/- 0.31, N = 6SE +/- 0.03, N = 3SE +/- 0.26, N = 9SE +/- 0.00, N = 312.66.013.66.2

etcd

Comparison (Test: RANGE - Connections: 100 - Clients: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 100 - Clients: 1000)Average Latency1428425670SE +/- 2.12, N = 9SE +/- 0.15, N = 3SE +/- 1.57, N = 12SE +/- 0.18, N = 364.431.653.532.7

etcd

Comparison (Test: RANGE - Connections: 500 - Clients: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 500 - Clients: 1000)Average Latency1530456075SE +/- 0.98, N = 3SE +/- 0.12, N = 3SE +/- 1.51, N = 6SE +/- 0.06, N = 369.240.759.842.2

Apache CouchDB

Bulk Size Comparison (Inserts: 1000 - Rounds: 30)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Bulk Size Comparison (Inserts: 1000 - Rounds: 30)100300500150300450600750SE +/- 3.82, N = 9SE +/- 2.78, N = 3SE +/- 0.74, N = 3SE +/- 2.31, N = 3SE +/- 3.79, N = 3SE +/- 0.51, N = 3SE +/- 2.80, N = 9SE +/- 1.83, N = 3SE +/- 3.77, N = 3SE +/- 2.59, N = 6SE +/- 0.91, N = 3SE +/- 2.58, N = 3262.44377.97464.69247.76366.67438.30266.25384.07676.09258.52394.74679.401. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Inserts Comparison (Bulk Size: 100 - - Rounds: 30)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Inserts Comparison (Bulk Size: 100 - - Rounds: 30)100030002004006008001000SE +/- 3.82, N = 9SE +/- 1.11, N = 3SE +/- 2.31, N = 3SE +/- 0.84, N = 3SE +/- 2.80, N = 9SE +/- 1.88, N = 3SE +/- 2.59, N = 6SE +/- 10.18, N = 3262.44887.89247.76860.53266.25855.61258.52871.541. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Rounds Comparison (Bulk Size: 100 - Inserts: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 100 - Inserts: 1000)3060120180240300SE +/- 3.82, N = 9SE +/- 2.31, N = 3SE +/- 2.80, N = 9SE +/- 2.59, N = 6262.44247.76266.25258.521. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Bulk Size Comparison (Inserts: 3000 - Rounds: 30)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Bulk Size Comparison (Inserts: 3000 - Rounds: 30)1003005005001000150020002500SE +/- 1.11, N = 3SE +/- 14.88, N = 5SE +/- 0.87, N = 3SE +/- 0.84, N = 3SE +/- 2.19, N = 3SE +/- 1.95, N = 3SE +/- 1.88, N = 3SE +/- 31.00, N = 9SE +/- 11.33, N = 3SE +/- 10.18, N = 3SE +/- 2.59, N = 3SE +/- 13.77, N = 3887.891412.822261.83860.531314.732158.52855.611492.532083.07871.541444.002140.741. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Rounds Comparison (Bulk Size: 100 - Inserts: 3000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 100 - Inserts: 3000)302004006008001000SE +/- 1.11, N = 3SE +/- 0.84, N = 3SE +/- 1.88, N = 3SE +/- 10.18, N = 3887.89860.53855.61871.541. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Inserts Comparison (Bulk Size: 300 - - Rounds: 30)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Inserts Comparison (Bulk Size: 300 - - Rounds: 30)1000300030060090012001500SE +/- 2.78, N = 3SE +/- 14.88, N = 5SE +/- 3.79, N = 3SE +/- 2.19, N = 3SE +/- 1.83, N = 3SE +/- 31.00, N = 9SE +/- 0.91, N = 3SE +/- 2.59, N = 3377.971412.82366.671314.73384.071492.53394.741444.001. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Rounds Comparison (Bulk Size: 300 - Inserts: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 300 - Inserts: 1000)3090180270360450SE +/- 2.78, N = 3SE +/- 3.79, N = 3SE +/- 1.83, N = 3SE +/- 0.91, N = 3377.97366.67384.07394.741. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Rounds Comparison (Bulk Size: 300 - Inserts: 3000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 300 - Inserts: 3000)3030060090012001500SE +/- 14.88, N = 5SE +/- 2.19, N = 3SE +/- 31.00, N = 9SE +/- 2.59, N = 31412.821314.731492.531444.001. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Inserts Comparison (Bulk Size: 500 - - Rounds: 30)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Inserts Comparison (Bulk Size: 500 - - Rounds: 30)100030005001000150020002500SE +/- 0.74, N = 3SE +/- 0.87, N = 3SE +/- 0.51, N = 3SE +/- 1.95, N = 3SE +/- 3.77, N = 3SE +/- 11.33, N = 3SE +/- 2.58, N = 3SE +/- 13.77, N = 3464.692261.83438.302158.52676.092083.07679.402140.741. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Rounds Comparison (Bulk Size: 500 - Inserts: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 500 - Inserts: 1000)30150300450600750SE +/- 0.74, N = 3SE +/- 0.51, N = 3SE +/- 3.77, N = 3SE +/- 2.58, N = 3464.69438.30676.09679.401. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Rounds Comparison (Bulk Size: 500 - Inserts: 3000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 500 - Inserts: 3000)305001000150020002500SE +/- 0.87, N = 3SE +/- 1.95, N = 3SE +/- 11.33, N = 3SE +/- 13.77, N = 32261.832158.522083.072140.741. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache Spark

Row Count Comparison (Partitions: 100 - SHA-512 Benchmark Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - SHA-512 Benchmark Time)10000001000000020000000400000004080120160200SE +/- 0.11, N = 4SE +/- 0.32, N = 3SE +/- 0.22, N = 3SE +/- 0.34, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.34, N = 3SE +/- 0.84, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.12, N = 3SE +/- 0.58, N = 3SE +/- 0.10, N = 5SE +/- 0.39, N = 3SE +/- 0.67, N = 3SE +/- 0.82, N = 310.0157.0596.68195.459.5055.2893.79190.039.3452.6988.81177.819.5652.8889.48178.89

Apache Spark

Partitions Comparison (Row Count: 1000000 - - SHA-512 Benchmark Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - SHA-512 Benchmark Time)100500100020003691215SE +/- 0.11, N = 4SE +/- 0.08, N = 3SE +/- 0.14, N = 3SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 4SE +/- 0.12, N = 9SE +/- 0.10, N = 5SE +/- 0.11, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 310.0111.2311.3812.969.5010.4311.1812.559.349.8910.7812.639.5610.4811.1412.88

Apache Spark

Comparison (Row Count: 1000000 - Partitions: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 1000000 - Partitions: 100)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time160320480640800SE +/- 0.113137090, N = 4SE +/- 9.681628257, N = 4SE +/- 0.122562063, N = 4SE +/- 0.023541873, N = 4SE +/- 0.025356347, N = 4SE +/- 0.134671456, N = 4SE +/- 0.085253143, N = 4SE +/- 0.038555282, N = 3SE +/- 1.768265132, N = 3SE +/- 0.257940983, N = 3SE +/- 0.129389851, N = 3SE +/- 0.084920457, N = 3SE +/- 0.004165140, N = 3SE +/- 0.102452612, N = 3SE +/- 0.093919752, N = 3SE +/- 1.541717417, N = 3SE +/- 0.039099097, N = 3SE +/- 0.130013375, N = 3SE +/- 0.070931558, N = 3SE +/- 0.294062371, N = 3SE +/- 0.076264083, N = 3SE +/- 0.101368246, N = 5SE +/- 0.461842438, N = 5SE +/- 0.089037280, N = 5SE +/- 0.081615689, N = 5SE +/- 0.034264151, N = 5SE +/- 0.044993077, N = 5SE +/- 0.069228259, N = 510.010000000727.52000000033.7600000009.0700000009.0800000006.5900000005.7200000009.500000000694.41000000032.1400000008.8100000008.7900000006.2500000005.6900000009.340000000581.45000000031.8400000008.7500000008.6200000006.5400000005.5000000009.560000000581.85221078531.6300000009.0900000008.7500000006.0400000005.450000000

Apache Spark

Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark)1000000100000002000000040000000160320480640800SE +/- 9.68, N = 4SE +/- 3.83, N = 3SE +/- 8.94, N = 3SE +/- 8.88, N = 3SE +/- 1.77, N = 3SE +/- 7.97, N = 3SE +/- 8.48, N = 3SE +/- 1.80, N = 3SE +/- 1.54, N = 3SE +/- 1.47, N = 3SE +/- 1.38, N = 3SE +/- 0.87, N = 3SE +/- 0.46, N = 5SE +/- 0.70, N = 3SE +/- 3.74, N = 3SE +/- 0.68, N = 3727.52722.90713.91724.99694.41681.48694.61694.62581.45581.85580.52579.98581.85580.29582.87581.19

Apache Spark

Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark)10050010002000160320480640800SE +/- 9.68, N = 4SE +/- 10.10, N = 3SE +/- 1.88, N = 3SE +/- 5.14, N = 3SE +/- 1.77, N = 3SE +/- 3.62, N = 3SE +/- 1.43, N = 3SE +/- 8.22, N = 3SE +/- 1.54, N = 3SE +/- 0.64, N = 3SE +/- 0.54, N = 4SE +/- 0.47, N = 9SE +/- 0.46, N = 5SE +/- 1.70, N = 3SE +/- 2.32, N = 3SE +/- 0.55, N = 3727.52733.90717.10733.77694.41685.12695.32690.63581.45580.99580.24580.68581.85579.16583.50582.61

Apache Spark

Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark Using Dataframe)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark Using Dataframe)1000000100000002000000040000000816243240SE +/- 0.12, N = 4SE +/- 0.10, N = 3SE +/- 0.32, N = 3SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.09, N = 3SE +/- 0.23, N = 3SE +/- 0.23, N = 3SE +/- 0.04, N = 3SE +/- 0.29, N = 3SE +/- 0.07, N = 3SE +/- 0.38, N = 3SE +/- 0.09, N = 5SE +/- 0.06, N = 3SE +/- 0.18, N = 3SE +/- 0.10, N = 333.7634.0233.7333.6332.1432.3532.2432.0831.8431.4931.8131.5731.6331.9731.6231.79

Apache Spark

Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark Using Dataframe)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark Using Dataframe)10050010002000816243240SE +/- 0.12, N = 4SE +/- 0.16, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.26, N = 3SE +/- 0.16, N = 3SE +/- 0.10, N = 3SE +/- 0.23, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 4SE +/- 0.09, N = 9SE +/- 0.09, N = 5SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.12, N = 333.7633.7633.3933.7932.1432.2732.3632.0331.8431.7931.8831.5631.6331.7231.5431.68

Apache Spark

Row Count Comparison (Partitions: 100 - Group By Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Group By Test Time)100000010000000200000004000000020406080100SE +/- 0.02, N = 4SE +/- 0.30, N = 3SE +/- 0.45, N = 3SE +/- 0.13, N = 3SE +/- 0.25, N = 3SE +/- 0.32, N = 3SE +/- 2.29, N = 3SE +/- 0.13, N = 3SE +/- 3.06, N = 3SE +/- 0.73, N = 3SE +/- 0.08, N = 5SE +/- 0.24, N = 3SE +/- 0.47, N = 3SE +/- 3.33, N = 39.0725.0537.118.8123.5035.5187.328.7526.6234.669.0923.9034.4188.01

Apache Spark

Partitions Comparison (Row Count: 1000000 - - Group By Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Group By Test Time)100500100020003691215SE +/- 0.02, N = 4SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.15, N = 3SE +/- 0.13, N = 3SE +/- 0.19, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 4SE +/- 0.13, N = 9SE +/- 0.08, N = 5SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.23, N = 39.0710.1311.3913.028.819.9511.1012.868.759.8410.9312.839.0910.0311.1813.31

Apache Spark

Row Count Comparison (Partitions: 100 - Repartition Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Repartition Test Time)1000000100000002000000040000000306090120150SE +/- 0.03, N = 4SE +/- 0.56, N = 3SE +/- 0.55, N = 3SE +/- 0.08, N = 3SE +/- 0.18, N = 3SE +/- 0.33, N = 3SE +/- 1.31, N = 3SE +/- 0.07, N = 3SE +/- 0.76, N = 3SE +/- 2.01, N = 3SE +/- 0.03, N = 5SE +/- 0.43, N = 3SE +/- 0.15, N = 3SE +/- 0.42, N = 39.0841.2874.328.7938.2971.59137.288.6238.5872.358.7537.0768.12131.38

Apache Spark

Partitions Comparison (Row Count: 1000000 - - Repartition Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Repartition Test Time)100500100020003691215SE +/- 0.03, N = 4SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.18, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 4SE +/- 0.04, N = 9SE +/- 0.03, N = 5SE +/- 0.07, N = 3SE +/- 0.18, N = 3SE +/- 0.16, N = 39.089.4610.0611.018.799.1010.0510.718.629.009.7410.578.759.219.9510.85

Apache Spark

Row Count Comparison (Partitions: 100 - Inner Join Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Inner Join Test Time)1000000100000002000000040000000306090120150SE +/- 0.134671456, N = 4SE +/- 0.257232291, N = 3SE +/- 0.574015178, N = 3SE +/- 0.004165140, N = 3SE +/- 0.120293064, N = 3SE +/- 0.323667212, N = 3SE +/- 1.752337079, N = 3SE +/- 0.294062371, N = 3SE +/- 1.642152192, N = 3SE +/- 1.129567495, N = 3SE +/- 0.044993077, N = 5SE +/- 1.372283254, N = 3SE +/- 0.475686548, N = 3SE +/- 1.445788055, N = 36.59000000047.52000000083.9800000006.25000000043.58000000080.900000000157.8800000006.54000000043.88000000075.6800000006.04000000043.71000000076.870000000152.872557219

Apache Spark

Partitions Comparison (Row Count: 1000000 - - Inner Join Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Inner Join Test Time)100500100020003691215SE +/- 0.13, N = 4SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.00, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.29, N = 3SE +/- 0.52, N = 3SE +/- 0.63, N = 4SE +/- 0.50, N = 9SE +/- 0.04, N = 5SE +/- 0.04, N = 3SE +/- 0.11, N = 3SE +/- 0.40, N = 36.597.268.3310.696.257.018.0110.686.547.538.6311.066.047.037.8110.89

Apache Spark

Row Count Comparison (Partitions: 100 - Broadcast Inner Join Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Broadcast Inner Join Test Time)10000001000000020000000400000004080120160200SE +/- 0.09, N = 4SE +/- 0.25, N = 3SE +/- 0.19, N = 3SE +/- 0.10, N = 3SE +/- 0.71, N = 3SE +/- 0.43, N = 3SE +/- 2.32, N = 3SE +/- 0.08, N = 3SE +/- 0.62, N = 3SE +/- 0.59, N = 3SE +/- 0.07, N = 5SE +/- 0.21, N = 3SE +/- 0.55, N = 3SE +/- 0.60, N = 35.7247.1082.035.6944.2679.21159.015.5043.1973.605.4542.8574.60150.05

Apache Spark

Partitions Comparison (Row Count: 1000000 - - Broadcast Inner Join Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Broadcast Inner Join Test Time)10050010002000246810SE +/- 0.09, N = 4SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.18, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.12, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 4SE +/- 0.13, N = 9SE +/- 0.07, N = 5SE +/- 0.49, N = 3SE +/- 0.06, N = 3SE +/- 0.27, N = 35.726.627.298.585.696.296.998.045.506.126.908.375.456.517.058.41

Apache Spark

Row Count Comparison (Partitions: 500 - SHA-512 Benchmark Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - SHA-512 Benchmark Time)10000001000000020000000400000004080120160200SE +/- 0.075456756, N = 3SE +/- 0.109148903, N = 3SE +/- 0.307771793, N = 3SE +/- 0.260000987, N = 3SE +/- 0.073904401, N = 3SE +/- 0.088475323, N = 3SE +/- 0.105154004, N = 3SE +/- 0.553867494, N = 3SE +/- 0.026873455, N = 3SE +/- 0.112654588, N = 3SE +/- 0.160687224, N = 3SE +/- 0.477080995, N = 3SE +/- 0.114204323, N = 3SE +/- 0.195921788, N = 3SE +/- 0.331996595, N = 3SE +/- 1.561648800, N = 311.23000000052.62000000099.640000000189.39000000010.43000000050.73000000096.850000000183.2000000009.89000000047.87000000090.560000000172.06000000010.48000000048.84000000091.240000000172.690048331

Apache Spark

Comparison (Row Count: 1000000 - Partitions: 500)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 1000000 - Partitions: 500)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time160320480640800SE +/- 0.075456756, N = 3SE +/- 10.096513371, N = 3SE +/- 0.158253119, N = 3SE +/- 0.085288962, N = 3SE +/- 0.037643391, N = 3SE +/- 0.056766652, N = 3SE +/- 0.094366471, N = 3SE +/- 0.073904401, N = 3SE +/- 3.616590948, N = 3SE +/- 0.155432056, N = 3SE +/- 0.188967987, N = 3SE +/- 0.076523207, N = 3SE +/- 0.103943425, N = 3SE +/- 0.103211248, N = 3SE +/- 0.026873455, N = 3SE +/- 0.635610275, N = 3SE +/- 0.017302603, N = 3SE +/- 0.152630685, N = 3SE +/- 0.101989022, N = 3SE +/- 0.517942458, N = 3SE +/- 0.063047733, N = 3SE +/- 0.114204323, N = 3SE +/- 1.696546131, N = 3SE +/- 0.016927629, N = 3SE +/- 0.086808001, N = 3SE +/- 0.069154351, N = 3SE +/- 0.043852959, N = 3SE +/- 0.486110869, N = 311.230000000733.90000000033.76000000010.1300000009.4600000007.2600000006.62000000010.430000000685.12000000032.2700000009.9500000009.1000000007.0100000006.2900000009.890000000580.99000000031.7900000009.8400000009.0000000007.5300000006.12000000010.480000000579.16066724031.72000000010.0300000009.2100000007.0300000006.510000000

Apache Spark

Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark)1000000100000002000000040000000160320480640800SE +/- 10.10, N = 3SE +/- 3.66, N = 3SE +/- 17.41, N = 3SE +/- 6.99, N = 3SE +/- 3.62, N = 3SE +/- 3.78, N = 3SE +/- 4.56, N = 3SE +/- 4.60, N = 3SE +/- 0.64, N = 3SE +/- 1.02, N = 3SE +/- 0.79, N = 3SE +/- 0.86, N = 3SE +/- 1.70, N = 3SE +/- 0.62, N = 3SE +/- 0.67, N = 3SE +/- 0.55, N = 3733.90692.06714.05728.26685.12684.23683.57690.62580.99579.55581.12580.30579.16581.78583.11579.01

Apache Spark

Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark Using Dataframe)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark Using Dataframe)1000000100000002000000040000000816243240SE +/- 0.16, N = 3SE +/- 0.13, N = 3SE +/- 0.25, N = 3SE +/- 0.10, N = 3SE +/- 0.16, N = 3SE +/- 0.05, N = 3SE +/- 0.22, N = 3SE +/- 0.36, N = 3SE +/- 0.02, N = 3SE +/- 0.11, N = 3SE +/- 0.15, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.09, N = 333.7633.8933.7233.7732.2732.1731.8431.9631.7931.7931.7631.5131.7231.8131.7431.71

Apache Spark

Row Count Comparison (Partitions: 500 - Group By Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Group By Test Time)100000010000000200000004000000020406080100SE +/- 0.09, N = 3SE +/- 0.42, N = 3SE +/- 0.10, N = 3SE +/- 0.19, N = 3SE +/- 0.51, N = 3SE +/- 0.72, N = 3SE +/- 4.05, N = 3SE +/- 0.15, N = 3SE +/- 1.78, N = 3SE +/- 4.59, N = 3SE +/- 0.09, N = 3SE +/- 0.17, N = 3SE +/- 0.13, N = 3SE +/- 1.17, N = 310.1323.2837.009.9522.3736.3789.239.8423.8239.2610.0322.3835.9982.35

Apache Spark

Row Count Comparison (Partitions: 500 - Repartition Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Repartition Test Time)1000000100000002000000040000000306090120150SE +/- 0.037643391, N = 3SE +/- 0.579061882, N = 3SE +/- 0.150029474, N = 3SE +/- 0.076523207, N = 3SE +/- 0.263873750, N = 3SE +/- 0.119615928, N = 3SE +/- 0.575990239, N = 3SE +/- 0.101989022, N = 3SE +/- 1.074726167, N = 3SE +/- 0.840434214, N = 3SE +/- 0.069154351, N = 3SE +/- 0.254871419, N = 3SE +/- 0.310887433, N = 3SE +/- 0.835252655, N = 39.46000000040.16000000073.2200000009.10000000038.21000000071.300000000138.0400000009.00000000038.92000000070.9000000009.21000000036.44000000067.860000000131.531132677

Apache Spark

Row Count Comparison (Partitions: 500 - Inner Join Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Inner Join Test Time)1000000100000002000000040000000306090120150SE +/- 0.056766652, N = 3SE +/- 0.422261678, N = 3SE +/- 0.562607380, N = 3SE +/- 0.103943425, N = 3SE +/- 0.391685283, N = 3SE +/- 0.747944666, N = 3SE +/- 0.391834664, N = 3SE +/- 0.517942458, N = 3SE +/- 0.798930107, N = 3SE +/- 0.488163973, N = 3SE +/- 0.043852959, N = 3SE +/- 0.324188438, N = 3SE +/- 0.097366593, N = 3SE +/- 1.021947894, N = 37.26000000044.68000000083.8400000007.01000000042.54000000080.990000000158.1100000007.53000000042.43000000078.0300000007.03000000040.24000000077.630000000152.207485397

Apache Spark

Row Count Comparison (Partitions: 500 - Broadcast Inner Join Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Broadcast Inner Join Test Time)1000000100000002000000040000000306090120150SE +/- 0.094366471, N = 3SE +/- 0.236866720, N = 3SE +/- 0.300364443, N = 3SE +/- 0.103211248, N = 3SE +/- 0.236232308, N = 3SE +/- 0.489603948, N = 3SE +/- 0.852271154, N = 3SE +/- 0.063047733, N = 3SE +/- 0.416062930, N = 3SE +/- 0.043071403, N = 3SE +/- 0.486110869, N = 3SE +/- 0.448087864, N = 3SE +/- 0.730826056, N = 3SE +/- 0.764058299, N = 36.62000000042.68000000083.5300000006.29000000040.95000000080.770000000157.0800000006.12000000039.16000000075.2300000006.51000000038.35000000076.270000000147.548531194

Apache Spark

Row Count Comparison (Partitions: 1000 - SHA-512 Benchmark Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - SHA-512 Benchmark Time)10000001000000020000000400000004080120160200SE +/- 0.14, N = 3SE +/- 0.22, N = 3SE +/- 0.20, N = 3SE +/- 0.54, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.20, N = 3SE +/- 0.13, N = 3SE +/- 0.12, N = 4SE +/- 0.15, N = 3SE +/- 0.29, N = 3SE +/- 0.77, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.48, N = 311.3853.52100.73189.7311.1851.6495.92183.3510.7849.2191.39172.4511.1449.4592.42172.19

Apache Spark

Comparison (Row Count: 1000000 - Partitions: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 1000000 - Partitions: 1000)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time150300450600750SE +/- 0.14, N = 3SE +/- 1.88, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 1.43, N = 3SE +/- 0.10, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 4SE +/- 0.54, N = 4SE +/- 0.05, N = 4SE +/- 0.08, N = 4SE +/- 0.07, N = 4SE +/- 0.63, N = 4SE +/- 0.06, N = 4SE +/- 0.01, N = 3SE +/- 2.32, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.18, N = 3SE +/- 0.11, N = 3SE +/- 0.06, N = 311.38717.1033.3911.3910.068.337.2911.18695.3232.3611.1010.058.016.9910.78580.2431.8810.939.748.636.9011.14583.5031.5411.189.957.817.05

Apache Spark

Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark)1000000100000002000000040000000160320480640800SE +/- 1.88, N = 3SE +/- 5.58, N = 3SE +/- 11.19, N = 3SE +/- 14.94, N = 3SE +/- 1.43, N = 3SE +/- 4.78, N = 3SE +/- 2.66, N = 3SE +/- 6.51, N = 3SE +/- 0.54, N = 4SE +/- 1.40, N = 3SE +/- 0.66, N = 3SE +/- 0.56, N = 3SE +/- 2.32, N = 3SE +/- 0.29, N = 3SE +/- 1.10, N = 3SE +/- 1.66, N = 3717.10722.36722.93721.00695.32690.24687.06697.90580.24580.37579.19581.69583.50580.46580.24581.60

Apache Spark

Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark Using Dataframe)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark Using Dataframe)1000000100000002000000040000000816243240SE +/- 0.08, N = 3SE +/- 0.18, N = 3SE +/- 0.19, N = 3SE +/- 0.22, N = 3SE +/- 0.10, N = 3SE +/- 0.32, N = 3SE +/- 0.15, N = 3SE +/- 0.16, N = 3SE +/- 0.05, N = 4SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.16, N = 3SE +/- 0.08, N = 3SE +/- 0.26, N = 3SE +/- 0.32, N = 3SE +/- 0.10, N = 333.3934.0033.8133.5132.3632.2432.0532.4031.8831.6631.7531.5431.5431.3631.2231.61

Apache Spark

Row Count Comparison (Partitions: 1000 - Group By Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Group By Test Time)100000010000000200000004000000020406080100SE +/- 0.03, N = 3SE +/- 0.35, N = 3SE +/- 0.79, N = 3SE +/- 0.02, N = 3SE +/- 0.28, N = 3SE +/- 0.15, N = 3SE +/- 2.33, N = 3SE +/- 0.08, N = 4SE +/- 0.36, N = 3SE +/- 2.03, N = 3SE +/- 0.09, N = 3SE +/- 0.20, N = 3SE +/- 0.44, N = 3SE +/- 0.85, N = 311.3923.8937.3111.1022.2935.2788.0210.9322.4435.8311.1822.6234.7079.60

Apache Spark

Row Count Comparison (Partitions: 1000 - Repartition Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Repartition Test Time)1000000100000002000000040000000306090120150SE +/- 0.02, N = 3SE +/- 0.23, N = 3SE +/- 0.23, N = 3SE +/- 0.07, N = 3SE +/- 0.22, N = 3SE +/- 0.23, N = 3SE +/- 0.83, N = 3SE +/- 0.07, N = 4SE +/- 0.54, N = 3SE +/- 1.03, N = 3SE +/- 0.18, N = 3SE +/- 0.31, N = 3SE +/- 0.20, N = 3SE +/- 0.93, N = 310.0639.9675.1810.0538.6171.70138.879.7439.3172.989.9536.7268.54131.43

Apache Spark

Row Count Comparison (Partitions: 1000 - Inner Join Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Inner Join Test Time)10000001000000020000000400000004080120160200SE +/- 0.105150363, N = 3SE +/- 0.399790551, N = 3SE +/- 0.315382741, N = 3SE +/- 0.035374915, N = 3SE +/- 0.136942862, N = 3SE +/- 0.420756743, N = 3SE +/- 1.923212084, N = 3SE +/- 0.633875719, N = 4SE +/- 0.557375853, N = 3SE +/- 0.855084002, N = 3SE +/- 0.108422107, N = 3SE +/- 0.211182878, N = 3SE +/- 0.524371080, N = 3SE +/- 1.834767926, N = 38.33000000045.60000000085.1200000008.01000000044.00000000081.350000000162.0100000008.63000000043.30000000078.4200000007.81000000041.49000000079.290000000151.543861997

Apache Spark

Row Count Comparison (Partitions: 1000 - Broadcast Inner Join Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Broadcast Inner Join Test Time)1000000100000002000000040000000306090120150SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.51, N = 3SE +/- 0.12, N = 3SE +/- 0.16, N = 3SE +/- 0.09, N = 3SE +/- 0.25, N = 3SE +/- 0.06, N = 4SE +/- 1.25, N = 3SE +/- 0.83, N = 3SE +/- 0.06, N = 3SE +/- 0.36, N = 3SE +/- 0.20, N = 3SE +/- 1.46, N = 37.2943.4784.016.9941.9880.64158.246.9040.9075.967.0539.2276.66147.55

Apache Spark

Row Count Comparison (Partitions: 2000 - SHA-512 Benchmark Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - SHA-512 Benchmark Time)10000001000000020000000400000004080120160200SE +/- 0.14, N = 3SE +/- 0.39, N = 3SE +/- 0.14, N = 3SE +/- 0.40, N = 3SE +/- 0.11, N = 3SE +/- 0.34, N = 3SE +/- 0.37, N = 3SE +/- 0.21, N = 3SE +/- 0.12, N = 9SE +/- 0.36, N = 3SE +/- 0.02, N = 3SE +/- 0.42, N = 3SE +/- 0.11, N = 3SE +/- 0.24, N = 3SE +/- 0.11, N = 3SE +/- 0.47, N = 312.9655.17101.15192.8112.5553.0497.65185.5112.6350.8091.96175.8412.8851.0992.19175.24

Apache Spark

Comparison (Row Count: 1000000 - Partitions: 2000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 1000000 - Partitions: 2000)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time160320480640800SE +/- 0.139768323, N = 3SE +/- 5.138863712, N = 3SE +/- 0.013599313, N = 3SE +/- 0.146972816, N = 3SE +/- 0.181687585, N = 3SE +/- 0.098619535, N = 3SE +/- 0.177939327, N = 3SE +/- 0.112867497, N = 3SE +/- 8.221686317, N = 3SE +/- 0.230080533, N = 3SE +/- 0.090717982, N = 3SE +/- 0.042552140, N = 3SE +/- 0.094249006, N = 3SE +/- 0.011049874, N = 3SE +/- 0.121232499, N = 9SE +/- 0.468273880, N = 9SE +/- 0.090240232, N = 9SE +/- 0.134671941, N = 9SE +/- 0.039688685, N = 9SE +/- 0.501143304, N = 9SE +/- 0.128969955, N = 9SE +/- 0.113414449, N = 3SE +/- 0.548006604, N = 3SE +/- 0.123827132, N = 3SE +/- 0.230601906, N = 3SE +/- 0.155773144, N = 3SE +/- 0.401879123, N = 3SE +/- 0.269877699, N = 312.960000000733.77000000033.79000000013.02000000011.01000000010.6900000008.58000000012.550000000690.63000000032.03000000012.86000000010.71000000010.6800000008.04000000012.630000000580.68000000031.56000000012.83000000010.57000000011.0600000008.37000000012.880000000582.61489470731.68000000013.31000000010.85000000010.8900000008.410000000

Apache Spark

Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark)1000000100000002000000040000000160320480640800SE +/- 5.14, N = 3SE +/- 13.31, N = 3SE +/- 22.40, N = 3SE +/- 16.56, N = 3SE +/- 8.22, N = 3SE +/- 6.18, N = 3SE +/- 2.10, N = 3SE +/- 8.50, N = 3SE +/- 0.47, N = 9SE +/- 0.41, N = 3SE +/- 1.08, N = 3SE +/- 0.49, N = 3SE +/- 0.55, N = 3SE +/- 0.51, N = 3SE +/- 0.28, N = 3SE +/- 1.28, N = 3733.77711.60723.32710.71690.63699.96681.91695.17580.68581.17579.87580.86582.61577.92581.10579.55

Apache Spark

Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark Using Dataframe)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark Using Dataframe)1000000100000002000000040000000816243240SE +/- 0.01, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 3SE +/- 0.06, N = 3SE +/- 0.23, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.31, N = 3SE +/- 0.09, N = 9SE +/- 0.14, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.15, N = 3SE +/- 0.14, N = 333.7933.9633.9133.7932.0331.9232.2132.2031.5631.6631.6131.6531.6831.5831.6631.32

Apache Spark

Row Count Comparison (Partitions: 2000 - Group By Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Group By Test Time)100000010000000200000004000000020406080100SE +/- 0.15, N = 3SE +/- 0.28, N = 3SE +/- 0.10, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.46, N = 3SE +/- 4.77, N = 3SE +/- 0.13, N = 9SE +/- 0.22, N = 3SE +/- 0.23, N = 3SE +/- 0.39, N = 3SE +/- 0.41, N = 3SE +/- 3.36, N = 313.0224.8537.3512.8624.0936.7283.8712.8324.1013.3124.1337.1681.61

Apache Spark

Row Count Comparison (Partitions: 2000 - Repartition Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Repartition Test Time)1000000100000002000000040000000306090120150SE +/- 0.18, N = 3SE +/- 0.03, N = 3SE +/- 0.46, N = 3SE +/- 0.04, N = 3SE +/- 0.21, N = 3SE +/- 0.20, N = 3SE +/- 0.91, N = 3SE +/- 0.04, N = 9SE +/- 0.66, N = 3SE +/- 0.16, N = 3SE +/- 0.08, N = 3SE +/- 0.14, N = 3SE +/- 0.77, N = 311.0140.5075.4410.7139.2272.28137.4510.5739.3310.8537.9469.09131.39

Apache Spark

Row Count Comparison (Partitions: 2000 - Inner Join Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Inner Join Test Time)10000001000000020000000400000004080120160200SE +/- 0.10, N = 3SE +/- 0.21, N = 3SE +/- 0.28, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.31, N = 3SE +/- 1.46, N = 3SE +/- 0.50, N = 9SE +/- 1.45, N = 3SE +/- 0.40, N = 3SE +/- 0.15, N = 3SE +/- 0.05, N = 3SE +/- 1.01, N = 310.6947.6786.4310.6845.7483.64159.1211.0647.6110.8944.2380.41151.60

Apache Spark

Row Count Comparison (Partitions: 2000 - Broadcast Inner Join Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Broadcast Inner Join Test Time)1000000100000002000000040000000306090120150SE +/- 0.18, N = 3SE +/- 0.27, N = 3SE +/- 0.57, N = 3SE +/- 0.01, N = 3SE +/- 0.28, N = 3SE +/- 0.08, N = 3SE +/- 1.89, N = 3SE +/- 0.13, N = 9SE +/- 0.24, N = 3SE +/- 0.27, N = 3SE +/- 0.13, N = 3SE +/- 0.89, N = 3SE +/- 0.50, N = 38.5844.5983.948.0442.9081.25157.258.3740.938.4141.1677.56148.66

Apache Spark

Partitions Comparison (Row Count: 10000000 - - SHA-512 Benchmark Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - SHA-512 Benchmark Time)100500100020001326395265SE +/- 0.32, N = 3SE +/- 0.11, N = 3SE +/- 0.22, N = 3SE +/- 0.39, N = 3SE +/- 0.14, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.34, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 3SE +/- 0.15, N = 3SE +/- 0.36, N = 3SE +/- 0.39, N = 3SE +/- 0.20, N = 3SE +/- 0.05, N = 3SE +/- 0.24, N = 357.0552.6253.5255.1755.2850.7351.6453.0452.6947.8749.2150.8052.8848.8449.4551.09

Apache Spark

Comparison (Row Count: 10000000 - Partitions: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 10000000 - Partitions: 100)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time160320480640800SE +/- 0.32, N = 3SE +/- 3.83, N = 3SE +/- 0.10, N = 3SE +/- 0.30, N = 3SE +/- 0.56, N = 3SE +/- 0.26, N = 3SE +/- 0.25, N = 3SE +/- 0.14, N = 3SE +/- 7.97, N = 3SE +/- 0.09, N = 3SE +/- 0.25, N = 3SE +/- 0.18, N = 3SE +/- 0.12, N = 3SE +/- 0.71, N = 3SE +/- 0.05, N = 3SE +/- 1.47, N = 3SE +/- 0.29, N = 3SE +/- 3.06, N = 3SE +/- 0.76, N = 3SE +/- 1.64, N = 3SE +/- 0.62, N = 3SE +/- 0.39, N = 3SE +/- 0.70, N = 3SE +/- 0.06, N = 3SE +/- 0.24, N = 3SE +/- 0.43, N = 3SE +/- 1.37, N = 3SE +/- 0.21, N = 357.05722.9034.0225.0541.2847.5247.1055.28681.4832.3523.5038.2943.5844.2652.69581.8531.4926.6238.5843.8843.1952.88580.2931.9723.9037.0743.7142.85

Apache Spark

Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark)10050010002000160320480640800SE +/- 3.83, N = 3SE +/- 3.66, N = 3SE +/- 5.58, N = 3SE +/- 13.31, N = 3SE +/- 7.97, N = 3SE +/- 3.78, N = 3SE +/- 4.78, N = 3SE +/- 6.18, N = 3SE +/- 1.47, N = 3SE +/- 1.02, N = 3SE +/- 1.40, N = 3SE +/- 0.41, N = 3SE +/- 0.70, N = 3SE +/- 0.62, N = 3SE +/- 0.29, N = 3SE +/- 0.51, N = 3722.90692.06722.36711.60681.48684.23690.24699.96581.85579.55580.37581.17580.29581.78580.46577.92

Apache Spark

Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark Using Dataframe)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark Using Dataframe)10050010002000816243240SE +/- 0.10, N = 3SE +/- 0.13, N = 3SE +/- 0.18, N = 3SE +/- 0.14, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.32, N = 3SE +/- 0.06, N = 3SE +/- 0.29, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.04, N = 334.0233.8934.0033.9632.3532.1732.2431.9231.4931.7931.6631.6631.9731.8131.3631.58

Apache Spark

Partitions Comparison (Row Count: 10000000 - - Group By Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Group By Test Time)10050010002000612182430SE +/- 0.30, N = 3SE +/- 0.42, N = 3SE +/- 0.35, N = 3SE +/- 0.28, N = 3SE +/- 0.25, N = 3SE +/- 0.51, N = 3SE +/- 0.28, N = 3SE +/- 0.13, N = 3SE +/- 3.06, N = 3SE +/- 1.78, N = 3SE +/- 0.36, N = 3SE +/- 0.22, N = 3SE +/- 0.24, N = 3SE +/- 0.17, N = 3SE +/- 0.20, N = 3SE +/- 0.39, N = 325.0523.2823.8924.8523.5022.3722.2924.0926.6223.8222.4424.1023.9022.3822.6224.13

Apache Spark

Partitions Comparison (Row Count: 10000000 - - Repartition Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Repartition Test Time)10050010002000918273645SE +/- 0.56, N = 3SE +/- 0.58, N = 3SE +/- 0.23, N = 3SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.26, N = 3SE +/- 0.22, N = 3SE +/- 0.21, N = 3SE +/- 0.76, N = 3SE +/- 1.07, N = 3SE +/- 0.54, N = 3SE +/- 0.66, N = 3SE +/- 0.43, N = 3SE +/- 0.25, N = 3SE +/- 0.31, N = 3SE +/- 0.08, N = 341.2840.1639.9640.5038.2938.2138.6139.2238.5838.9239.3139.3337.0736.4436.7237.94

Apache Spark

Partitions Comparison (Row Count: 10000000 - - Inner Join Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Inner Join Test Time)100500100020001122334455SE +/- 0.26, N = 3SE +/- 0.42, N = 3SE +/- 0.40, N = 3SE +/- 0.21, N = 3SE +/- 0.12, N = 3SE +/- 0.39, N = 3SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 1.64, N = 3SE +/- 0.80, N = 3SE +/- 0.56, N = 3SE +/- 1.45, N = 3SE +/- 1.37, N = 3SE +/- 0.32, N = 3SE +/- 0.21, N = 3SE +/- 0.15, N = 347.5244.6845.6047.6743.5842.5444.0045.7443.8842.4343.3047.6143.7140.2441.4944.23

Apache Spark

Partitions Comparison (Row Count: 10000000 - - Broadcast Inner Join Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Broadcast Inner Join Test Time)100500100020001122334455SE +/- 0.25, N = 3SE +/- 0.24, N = 3SE +/- 0.09, N = 3SE +/- 0.27, N = 3SE +/- 0.71, N = 3SE +/- 0.24, N = 3SE +/- 0.16, N = 3SE +/- 0.28, N = 3SE +/- 0.62, N = 3SE +/- 0.42, N = 3SE +/- 1.25, N = 3SE +/- 0.24, N = 3SE +/- 0.21, N = 3SE +/- 0.45, N = 3SE +/- 0.36, N = 3SE +/- 0.13, N = 347.1042.6843.4744.5944.2640.9541.9842.9043.1939.1640.9040.9342.8538.3539.2241.16

Apache Spark

Comparison (Row Count: 10000000 - Partitions: 500)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 10000000 - Partitions: 500)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time150300450600750SE +/- 0.11, N = 3SE +/- 3.66, N = 3SE +/- 0.13, N = 3SE +/- 0.42, N = 3SE +/- 0.58, N = 3SE +/- 0.42, N = 3SE +/- 0.24, N = 3SE +/- 0.09, N = 3SE +/- 3.78, N = 3SE +/- 0.05, N = 3SE +/- 0.51, N = 3SE +/- 0.26, N = 3SE +/- 0.39, N = 3SE +/- 0.24, N = 3SE +/- 0.11, N = 3SE +/- 1.02, N = 3SE +/- 0.11, N = 3SE +/- 1.78, N = 3SE +/- 1.07, N = 3SE +/- 0.80, N = 3SE +/- 0.42, N = 3SE +/- 0.20, N = 3SE +/- 0.62, N = 3SE +/- 0.05, N = 3SE +/- 0.17, N = 3SE +/- 0.25, N = 3SE +/- 0.32, N = 3SE +/- 0.45, N = 352.62692.0633.8923.2840.1644.6842.6850.73684.2332.1722.3738.2142.5440.9547.87579.5531.7923.8238.9242.4339.1648.84581.7831.8122.3836.4440.2438.35

Apache Spark

Partitions Comparison (Row Count: 20000000 - - SHA-512 Benchmark Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - SHA-512 Benchmark Time)1005001000200020406080100SE +/- 0.22, N = 3SE +/- 0.31, N = 3SE +/- 0.20, N = 3SE +/- 0.14, N = 3SE +/- 0.34, N = 3SE +/- 0.11, N = 3SE +/- 0.20, N = 3SE +/- 0.37, N = 3SE +/- 0.12, N = 3SE +/- 0.16, N = 3SE +/- 0.29, N = 3SE +/- 0.02, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 396.6899.64100.73101.1593.7996.8595.9297.6588.8190.5691.3991.9689.4891.2492.4292.19

Apache Spark

Comparison (Row Count: 20000000 - Partitions: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 20000000 - Partitions: 100)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time150300450600750SE +/- 0.22, N = 3SE +/- 8.94, N = 3SE +/- 0.32, N = 3SE +/- 0.45, N = 3SE +/- 0.55, N = 3SE +/- 0.57, N = 3SE +/- 0.19, N = 3SE +/- 0.34, N = 3SE +/- 8.48, N = 3SE +/- 0.23, N = 3SE +/- 0.32, N = 3SE +/- 0.33, N = 3SE +/- 0.32, N = 3SE +/- 0.43, N = 3SE +/- 0.12, N = 3SE +/- 1.38, N = 3SE +/- 0.07, N = 3SE +/- 0.73, N = 3SE +/- 2.01, N = 3SE +/- 1.13, N = 3SE +/- 0.59, N = 3SE +/- 0.67, N = 3SE +/- 3.74, N = 3SE +/- 0.18, N = 3SE +/- 0.47, N = 3SE +/- 0.15, N = 3SE +/- 0.48, N = 3SE +/- 0.55, N = 396.68713.9133.7337.1174.3283.9882.0393.79694.6132.2435.5171.5980.9079.2188.81580.5231.8134.6672.3575.6873.6089.48582.8731.6234.4168.1276.8774.60

Apache Spark

Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark)10050010002000160320480640800SE +/- 8.94, N = 3SE +/- 17.41, N = 3SE +/- 11.19, N = 3SE +/- 22.40, N = 3SE +/- 8.48, N = 3SE +/- 4.56, N = 3SE +/- 2.66, N = 3SE +/- 2.10, N = 3SE +/- 1.38, N = 3SE +/- 0.79, N = 3SE +/- 0.66, N = 3SE +/- 1.08, N = 3SE +/- 3.74, N = 3SE +/- 0.67, N = 3SE +/- 1.10, N = 3SE +/- 0.28, N = 3713.91714.05722.93723.32694.61683.57687.06681.91580.52581.12579.19579.87582.87583.11580.24581.10

Apache Spark

Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark Using Dataframe)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark Using Dataframe)10050010002000816243240SE +/- 0.32, N = 3SE +/- 0.25, N = 3SE +/- 0.19, N = 3SE +/- 0.11, N = 3SE +/- 0.23, N = 3SE +/- 0.22, N = 3SE +/- 0.15, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.15, N = 3SE +/- 0.14, N = 3SE +/- 0.10, N = 3SE +/- 0.18, N = 3SE +/- 0.10, N = 3SE +/- 0.32, N = 3SE +/- 0.15, N = 333.7333.7233.8133.9132.2431.8432.0532.2131.8131.7631.7531.6131.6231.7431.2231.66

Apache Spark

Partitions Comparison (Row Count: 20000000 - - Group By Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Group By Test Time)10050010002000918273645SE +/- 0.45, N = 3SE +/- 0.10, N = 3SE +/- 0.79, N = 3SE +/- 0.10, N = 3SE +/- 0.32, N = 3SE +/- 0.72, N = 3SE +/- 0.15, N = 3SE +/- 0.46, N = 3SE +/- 0.73, N = 3SE +/- 4.59, N = 3SE +/- 2.03, N = 3SE +/- 0.47, N = 3SE +/- 0.13, N = 3SE +/- 0.44, N = 3SE +/- 0.41, N = 337.1137.0037.3137.3535.5136.3735.2736.7234.6639.2635.8334.4135.9934.7037.16

Apache Spark

Partitions Comparison (Row Count: 20000000 - - Repartition Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Repartition Test Time)1005001000200020406080100SE +/- 0.55, N = 3SE +/- 0.15, N = 3SE +/- 0.23, N = 3SE +/- 0.46, N = 3SE +/- 0.33, N = 3SE +/- 0.12, N = 3SE +/- 0.23, N = 3SE +/- 0.20, N = 3SE +/- 2.01, N = 3SE +/- 0.84, N = 3SE +/- 1.03, N = 3SE +/- 0.15, N = 3SE +/- 0.31, N = 3SE +/- 0.20, N = 3SE +/- 0.14, N = 374.3273.2275.1875.4471.5971.3071.7072.2872.3570.9072.9868.1267.8668.5469.09

Apache Spark

Partitions Comparison (Row Count: 20000000 - - Inner Join Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Inner Join Test Time)1005001000200020406080100SE +/- 0.57, N = 3SE +/- 0.56, N = 3SE +/- 0.32, N = 3SE +/- 0.28, N = 3SE +/- 0.32, N = 3SE +/- 0.75, N = 3SE +/- 0.42, N = 3SE +/- 0.31, N = 3SE +/- 1.13, N = 3SE +/- 0.49, N = 3SE +/- 0.86, N = 3SE +/- 0.48, N = 3SE +/- 0.10, N = 3SE +/- 0.52, N = 3SE +/- 0.05, N = 383.9883.8485.1286.4380.9080.9981.3583.6475.6878.0378.4276.8777.6379.2980.41

Apache Spark

Partitions Comparison (Row Count: 20000000 - - Broadcast Inner Join Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Broadcast Inner Join Test Time)1005001000200020406080100SE +/- 0.19, N = 3SE +/- 0.30, N = 3SE +/- 0.51, N = 3SE +/- 0.57, N = 3SE +/- 0.43, N = 3SE +/- 0.49, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.59, N = 3SE +/- 0.04, N = 3SE +/- 0.83, N = 3SE +/- 0.55, N = 3SE +/- 0.73, N = 3SE +/- 0.20, N = 3SE +/- 0.89, N = 382.0383.5384.0183.9479.2180.7780.6481.2573.6075.2375.9674.6076.2776.6677.56

Apache Spark

Comparison (Row Count: 20000000 - Partitions: 500)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 20000000 - Partitions: 500)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time150300450600750SE +/- 0.31, N = 3SE +/- 17.41, N = 3SE +/- 0.25, N = 3SE +/- 0.10, N = 3SE +/- 0.15, N = 3SE +/- 0.56, N = 3SE +/- 0.30, N = 3SE +/- 0.11, N = 3SE +/- 4.56, N = 3SE +/- 0.22, N = 3SE +/- 0.72, N = 3SE +/- 0.12, N = 3SE +/- 0.75, N = 3SE +/- 0.49, N = 3SE +/- 0.16, N = 3SE +/- 0.79, N = 3SE +/- 0.15, N = 3SE +/- 4.59, N = 3SE +/- 0.84, N = 3SE +/- 0.49, N = 3SE +/- 0.04, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.10, N = 3SE +/- 0.13, N = 3SE +/- 0.31, N = 3SE +/- 0.10, N = 3SE +/- 0.73, N = 399.64714.0533.7237.0073.2283.8483.5396.85683.5731.8436.3771.3080.9980.7790.56581.1231.7639.2670.9078.0375.2391.24583.1131.7435.9967.8677.6376.27

Apache Spark

Partitions Comparison (Row Count: 40000000 - - SHA-512 Benchmark Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - SHA-512 Benchmark Time)100500100020004080120160200SE +/- 0.34, N = 3SE +/- 0.26, N = 3SE +/- 0.54, N = 3SE +/- 0.40, N = 3SE +/- 0.84, N = 3SE +/- 0.55, N = 3SE +/- 0.13, N = 3SE +/- 0.21, N = 3SE +/- 0.58, N = 3SE +/- 0.48, N = 3SE +/- 0.77, N = 3SE +/- 0.42, N = 3SE +/- 0.82, N = 3SE +/- 1.56, N = 3SE +/- 0.48, N = 3SE +/- 0.47, N = 3195.45189.39189.73192.81190.03183.20183.35185.51177.81172.06172.45175.84178.89172.69172.19175.24

Apache Spark

Comparison (Row Count: 40000000 - Partitions: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 40000000 - Partitions: 100)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time160320480640800SE +/- 0.34, N = 3SE +/- 8.88, N = 3SE +/- 0.05, N = 3SE +/- 0.84, N = 3SE +/- 1.80, N = 3SE +/- 0.23, N = 3SE +/- 2.29, N = 3SE +/- 1.31, N = 3SE +/- 1.75, N = 3SE +/- 2.32, N = 3SE +/- 0.58, N = 3SE +/- 0.87, N = 3SE +/- 0.38, N = 3SE +/- 0.82, N = 3SE +/- 0.68, N = 3SE +/- 0.10, N = 3SE +/- 3.33, N = 3SE +/- 0.42, N = 3SE +/- 1.45, N = 3SE +/- 0.60, N = 3195.45724.9933.63190.03694.6232.0887.32137.28157.88159.01177.81579.9831.57178.89581.1931.7988.01131.38152.87150.05

Apache Spark

Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark)10050010002000160320480640800SE +/- 8.88, N = 3SE +/- 6.99, N = 3SE +/- 14.94, N = 3SE +/- 16.56, N = 3SE +/- 1.80, N = 3SE +/- 4.60, N = 3SE +/- 6.51, N = 3SE +/- 8.50, N = 3SE +/- 0.87, N = 3SE +/- 0.86, N = 3SE +/- 0.56, N = 3SE +/- 0.49, N = 3SE +/- 0.68, N = 3SE +/- 0.55, N = 3SE +/- 1.66, N = 3SE +/- 1.28, N = 3724.99728.26721.00710.71694.62690.62697.90695.17579.98580.30581.69580.86581.19579.01581.60579.55

Apache Spark

Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark Using Dataframe)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark Using Dataframe)10050010002000816243240SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.22, N = 3SE +/- 0.06, N = 3SE +/- 0.23, N = 3SE +/- 0.36, N = 3SE +/- 0.16, N = 3SE +/- 0.31, N = 3SE +/- 0.38, N = 3SE +/- 0.11, N = 3SE +/- 0.16, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.14, N = 333.6333.7733.5133.7932.0831.9632.4032.2031.5731.5131.5431.6531.7931.7131.6131.32

Apache Spark

Comparison (Row Count: 40000000 - Partitions: 500)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 40000000 - Partitions: 500)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time160320480640800SE +/- 0.26, N = 3SE +/- 6.99, N = 3SE +/- 0.10, N = 3SE +/- 0.55, N = 3SE +/- 4.60, N = 3SE +/- 0.36, N = 3SE +/- 4.05, N = 3SE +/- 0.58, N = 3SE +/- 0.39, N = 3SE +/- 0.85, N = 3SE +/- 0.48, N = 3SE +/- 0.86, N = 3SE +/- 0.11, N = 3SE +/- 1.56, N = 3SE +/- 0.55, N = 3SE +/- 0.09, N = 3SE +/- 1.17, N = 3SE +/- 0.84, N = 3SE +/- 1.02, N = 3SE +/- 0.76, N = 3189.39728.2633.77183.20690.6231.9689.23138.04158.11157.08172.06580.3031.51172.69579.0131.7182.35131.53152.21147.55

Apache Spark

Comparison (Row Count: 10000000 - Partitions: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 10000000 - Partitions: 1000)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time160320480640800SE +/- 0.22, N = 3SE +/- 5.58, N = 3SE +/- 0.18, N = 3SE +/- 0.35, N = 3SE +/- 0.23, N = 3SE +/- 0.40, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 4.78, N = 3SE +/- 0.32, N = 3SE +/- 0.28, N = 3SE +/- 0.22, N = 3SE +/- 0.14, N = 3SE +/- 0.16, N = 3SE +/- 0.15, N = 3SE +/- 1.40, N = 3SE +/- 0.04, N = 3SE +/- 0.36, N = 3SE +/- 0.54, N = 3SE +/- 0.56, N = 3SE +/- 1.25, N = 3SE +/- 0.05, N = 3SE +/- 0.29, N = 3SE +/- 0.26, N = 3SE +/- 0.20, N = 3SE +/- 0.31, N = 3SE +/- 0.21, N = 3SE +/- 0.36, N = 353.52722.3634.0023.8939.9645.6043.4751.64690.2432.2422.2938.6144.0041.9849.21580.3731.6622.4439.3143.3040.9049.45580.4631.3622.6236.7241.4939.22

Apache Spark

Comparison (Row Count: 10000000 - Partitions: 2000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 10000000 - Partitions: 2000)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time150300450600750SE +/- 0.39, N = 3SE +/- 13.31, N = 3SE +/- 0.14, N = 3SE +/- 0.28, N = 3SE +/- 0.03, N = 3SE +/- 0.21, N = 3SE +/- 0.27, N = 3SE +/- 0.34, N = 3SE +/- 6.18, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.21, N = 3SE +/- 0.04, N = 3SE +/- 0.28, N = 3SE +/- 0.36, N = 3SE +/- 0.41, N = 3SE +/- 0.14, N = 3SE +/- 0.22, N = 3SE +/- 0.66, N = 3SE +/- 1.45, N = 3SE +/- 0.24, N = 3SE +/- 0.24, N = 3SE +/- 0.51, N = 3SE +/- 0.04, N = 3SE +/- 0.39, N = 3SE +/- 0.08, N = 3SE +/- 0.15, N = 3SE +/- 0.13, N = 355.17711.6033.9624.8540.5047.6744.5953.04699.9631.9224.0939.2245.7442.9050.80581.1731.6624.1039.3347.6140.9351.09577.9231.5824.1337.9444.2341.16

Apache Spark

Comparison (Row Count: 20000000 - Partitions: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 20000000 - Partitions: 1000)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time160320480640800SE +/- 0.20, N = 3SE +/- 11.19, N = 3SE +/- 0.19, N = 3SE +/- 0.79, N = 3SE +/- 0.23, N = 3SE +/- 0.32, N = 3SE +/- 0.51, N = 3SE +/- 0.20, N = 3SE +/- 2.66, N = 3SE +/- 0.15, N = 3SE +/- 0.15, N = 3SE +/- 0.23, N = 3SE +/- 0.42, N = 3SE +/- 0.09, N = 3SE +/- 0.29, N = 3SE +/- 0.66, N = 3SE +/- 0.14, N = 3SE +/- 2.03, N = 3SE +/- 1.03, N = 3SE +/- 0.86, N = 3SE +/- 0.83, N = 3SE +/- 0.10, N = 3SE +/- 1.10, N = 3SE +/- 0.32, N = 3SE +/- 0.44, N = 3SE +/- 0.20, N = 3SE +/- 0.52, N = 3SE +/- 0.20, N = 3100.73722.9333.8137.3175.1885.1284.0195.92687.0632.0535.2771.7081.3580.6491.39579.1931.7535.8372.9878.4275.9692.42580.2431.2234.7068.5479.2976.66

Apache Spark

Comparison (Row Count: 20000000 - Partitions: 2000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 20000000 - Partitions: 2000)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time160320480640800SE +/- 0.14, N = 3SE +/- 22.40, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.46, N = 3SE +/- 0.28, N = 3SE +/- 0.57, N = 3SE +/- 0.37, N = 3SE +/- 2.10, N = 3SE +/- 0.09, N = 3SE +/- 0.46, N = 3SE +/- 0.20, N = 3SE +/- 0.31, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 1.08, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.28, N = 3SE +/- 0.15, N = 3SE +/- 0.41, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 3SE +/- 0.89, N = 3101.15723.3233.9137.3575.4486.4383.9497.65681.9132.2136.7272.2883.6481.2591.96579.8731.6192.19581.1031.6637.1669.0980.4177.56

Apache Spark

Comparison (Row Count: 40000000 - Partitions: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 40000000 - Partitions: 1000)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time160320480640800SE +/- 0.54, N = 3SE +/- 14.94, N = 3SE +/- 0.22, N = 3SE +/- 0.13, N = 3SE +/- 6.51, N = 3SE +/- 0.16, N = 3SE +/- 2.33, N = 3SE +/- 0.83, N = 3SE +/- 1.92, N = 3SE +/- 0.25, N = 3SE +/- 0.77, N = 3SE +/- 0.56, N = 3SE +/- 0.16, N = 3SE +/- 0.48, N = 3SE +/- 1.66, N = 3SE +/- 0.10, N = 3SE +/- 0.85, N = 3SE +/- 0.93, N = 3SE +/- 1.83, N = 3SE +/- 1.46, N = 3189.73721.0033.51183.35697.9032.4088.02138.87162.01158.24172.45581.6931.54172.19581.6031.6179.60131.43151.54147.55

Apache Spark

Comparison (Row Count: 40000000 - Partitions: 2000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 40000000 - Partitions: 2000)SHA-512 Benchmark TimeCalculate Pi BenchmarkCalculate Pi Benchmark Using DataframeGroup By Test TimeRepartition Test TimeInner Join Test TimeBroadcast Inner Join Test Time150300450600750SE +/- 0.40, N = 3SE +/- 16.56, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 3SE +/- 8.50, N = 3SE +/- 0.31, N = 3SE +/- 4.77, N = 3SE +/- 0.91, N = 3SE +/- 1.46, N = 3SE +/- 1.89, N = 3SE +/- 0.42, N = 3SE +/- 0.49, N = 3SE +/- 0.10, N = 3SE +/- 0.47, N = 3SE +/- 1.28, N = 3SE +/- 0.14, N = 3SE +/- 3.36, N = 3SE +/- 0.77, N = 3SE +/- 1.01, N = 3SE +/- 0.50, N = 3192.81710.7133.79185.51695.1732.2083.87137.45159.12157.25175.84580.8631.65175.24579.5531.3281.61131.39151.60148.66

Apache Spark

Partitions Comparison (Row Count: 40000000 - - Group By Test Time)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Group By Test Time)1005001000200020406080100SE +/- 2.29, N = 3SE +/- 4.05, N = 3SE +/- 2.33, N = 3SE +/- 4.77, N = 3SE +/- 3.33, N = 3SE +/- 1.17, N = 3SE +/- 0.85, N = 3SE +/- 3.36, N = 387.3289.2388.0283.8788.0182.3579.6081.61

Apache Spark

Partitions Comparison (Row Count: 40000000 - - Repartition Test Time)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Repartition Test Time)10050010002000306090120150SE +/- 1.31, N = 3SE +/- 0.58, N = 3SE +/- 0.83, N = 3SE +/- 0.91, N = 3SE +/- 0.42, N = 3SE +/- 0.84, N = 3SE +/- 0.93, N = 3SE +/- 0.77, N = 3137.28138.04138.87137.45131.38131.53131.43131.39

Apache Spark

Partitions Comparison (Row Count: 40000000 - - Inner Join Test Time)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Inner Join Test Time)100500100020004080120160200SE +/- 1.75, N = 3SE +/- 0.39, N = 3SE +/- 1.92, N = 3SE +/- 1.46, N = 3SE +/- 1.45, N = 3SE +/- 1.02, N = 3SE +/- 1.83, N = 3SE +/- 1.01, N = 3157.88158.11162.01159.12152.87152.21151.54151.60

Apache Spark

Partitions Comparison (Row Count: 40000000 - - Broadcast Inner Join Test Time)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Broadcast Inner Join Test Time)100500100020004080120160200SE +/- 2.32, N = 3SE +/- 0.85, N = 3SE +/- 0.25, N = 3SE +/- 1.89, N = 3SE +/- 0.60, N = 3SE +/- 0.76, N = 3SE +/- 1.46, N = 3SE +/- 0.50, N = 3159.01157.08158.24157.25150.05147.55147.55148.66

Apache Spark TPC-H

Scale Factor Comparison (Geometric Mean Of All Queries)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Geometric Mean Of All Queries)11.05842.11683.17524.23365.292SE +/- 0.02205715, N = 3SE +/- 0.03832583, N = 84.703943664.58796121

Apache Spark TPC-H

Comparison (Scale Factor: 1)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Comparison (Scale Factor: 1)Geometric Mean Of All QueriesQ01Q02Q03Q04Q05Q06Q07Q08Q09Q10Q11Q12Q13Q14Q15Q16Q17Q18Q19Q20Q21Q2248121620SE +/- 0.02205715, N = 3SE +/- 0.17776740, N = 3SE +/- 0.06585723, N = 3SE +/- 0.17085945, N = 3SE +/- 0.15831346, N = 3SE +/- 0.08288138, N = 3SE +/- 0.06400088, N = 3SE +/- 0.01424190, N = 3SE +/- 0.07990249, N = 3SE +/- 0.03195754, N = 3SE +/- 0.12475642, N = 3SE +/- 0.00889576, N = 3SE +/- 0.07812445, N = 3SE +/- 0.05404231, N = 3SE +/- 0.09844103, N = 3SE +/- 0.01587727, N = 3SE +/- 0.04807800, N = 3SE +/- 0.11188602, N = 3SE +/- 0.02944973, N = 3SE +/- 0.08247514, N = 3SE +/- 0.16740673, N = 3SE +/- 0.45650715, N = 3SE +/- 0.05419067, N = 3SE +/- 0.03832583, N = 8SE +/- 0.10385415, N = 8SE +/- 0.10497115, N = 8SE +/- 0.07160103, N = 8SE +/- 0.15490647, N = 8SE +/- 0.06264325, N = 8SE +/- 0.02204410, N = 8SE +/- 0.12029949, N = 8SE +/- 0.01870892, N = 8SE +/- 0.06360940, N = 8SE +/- 0.08702141, N = 8SE +/- 0.02504461, N = 8SE +/- 0.07037349, N = 8SE +/- 0.02994103, N = 8SE +/- 0.08797017, N = 8SE +/- 0.02096419, N = 8SE +/- 0.04873253, N = 8SE +/- 0.05677966, N = 8SE +/- 0.15655408, N = 8SE +/- 0.04107179, N = 8SE +/- 0.02853109, N = 8SE +/- 0.09251555, N = 8SE +/- 0.40940044, N = 84.703943668.991113985.121564716.219260696.352845996.451014203.144960965.678459015.125953208.098931315.488646352.229465094.411468983.309991523.483763383.733936312.365291437.480081888.852170943.456161104.9555333518.002487182.635502584.587961218.898104675.176648266.013409675.946094636.250915592.872663115.712453195.013944217.734836885.450984962.230567374.261494313.002522233.417816823.521971972.378982937.148795848.634209873.266044204.5986599416.831480503.25603971

Apache Spark TPC-H

Scale Factor Comparison (Q01)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q01)13691215SE +/- 0.17776740, N = 3SE +/- 0.10385415, N = 88.991113988.89810467

Apache Spark TPC-H

Scale Factor Comparison (Q02)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q02)11.16472.32943.49414.65885.8235SE +/- 0.06585723, N = 3SE +/- 0.10497115, N = 85.121564715.17664826

Apache Spark TPC-H

Scale Factor Comparison (Q03)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q03)1246810SE +/- 0.17085945, N = 3SE +/- 0.07160103, N = 86.219260696.01340967

Apache Spark TPC-H

Scale Factor Comparison (Q04)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q04)1246810SE +/- 0.15831346, N = 3SE +/- 0.15490647, N = 86.352845995.94609463

Apache Spark TPC-H

Scale Factor Comparison (Q05)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q05)1246810SE +/- 0.08288138, N = 3SE +/- 0.06264325, N = 86.451014206.25091559

Apache Spark TPC-H

Scale Factor Comparison (Q06)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q06)10.70761.41522.12282.83043.538SE +/- 0.06400088, N = 3SE +/- 0.02204410, N = 83.144960962.87266311

Apache Spark TPC-H

Scale Factor Comparison (Q07)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q07)11.28532.57063.85595.14126.4265SE +/- 0.01424190, N = 3SE +/- 0.12029949, N = 85.678459015.71245319

Apache Spark TPC-H

Scale Factor Comparison (Q08)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q08)11.15332.30663.45994.61325.7665SE +/- 0.07990249, N = 3SE +/- 0.01870892, N = 85.125953205.01394421

Apache Spark TPC-H

Scale Factor Comparison (Q09)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q09)1246810SE +/- 0.03195754, N = 3SE +/- 0.06360940, N = 88.098931317.73483688

Apache Spark TPC-H

Scale Factor Comparison (Q10)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q10)11.23492.46983.70474.93966.1745SE +/- 0.12475642, N = 3SE +/- 0.08702141, N = 85.488646355.45098496

Apache Spark TPC-H

Scale Factor Comparison (Q11)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q11)10.50191.00381.50572.00762.5095SE +/- 0.00889576, N = 3SE +/- 0.02504461, N = 82.229465092.23056737

Apache Spark TPC-H

Scale Factor Comparison (Q12)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q12)10.99261.98522.97783.97044.963SE +/- 0.07812445, N = 3SE +/- 0.07037349, N = 84.411468984.26149431

Apache Spark TPC-H

Scale Factor Comparison (Q13)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q13)10.74471.48942.23412.97883.7235SE +/- 0.05404231, N = 3SE +/- 0.02994103, N = 83.309991523.00252223

Apache Spark TPC-H

Scale Factor Comparison (Q14)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q14)10.78381.56762.35143.13523.919SE +/- 0.09844103, N = 3SE +/- 0.08797017, N = 83.483763383.41781682

Apache Spark TPC-H

Scale Factor Comparison (Q15)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q15)10.84011.68022.52033.36044.2005SE +/- 0.01587727, N = 3SE +/- 0.02096419, N = 83.733936313.52197197

Apache Spark TPC-H

Scale Factor Comparison (Q16)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q16)10.53531.07061.60592.14122.6765SE +/- 0.04807800, N = 3SE +/- 0.04873253, N = 82.365291432.37898293

Apache Spark TPC-H

Scale Factor Comparison (Q17)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q17)1246810SE +/- 0.11188602, N = 3SE +/- 0.05677966, N = 87.480081887.14879584

Apache Spark TPC-H

Scale Factor Comparison (Q18)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q18)1246810SE +/- 0.02944973, N = 3SE +/- 0.15655408, N = 88.852170948.63420987

Apache Spark TPC-H

Scale Factor Comparison (Q19)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q19)10.77761.55522.33283.11043.888SE +/- 0.08247514, N = 3SE +/- 0.04107179, N = 83.456161103.26604420

Apache Spark TPC-H

Scale Factor Comparison (Q20)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q20)11.1152.233.3454.465.575SE +/- 0.16740673, N = 3SE +/- 0.02853109, N = 84.955533354.59865994

Apache Spark TPC-H

Scale Factor Comparison (Q21)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q21)148121620SE +/- 0.46, N = 3SE +/- 0.09, N = 818.0016.83

Apache Spark TPC-H

Scale Factor Comparison (Q22)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q22)10.73261.46522.19782.93043.663SE +/- 0.05419067, N = 3SE +/- 0.40940044, N = 82.635502583.25603971

Stargate Digital Audio Workstation

Sample Rate Comparison (Buffer Size: 512)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate Comparison (Buffer Size: 512)44100960001920004800000.17930.35860.53790.71720.8965SE +/- 0.000792, N = 3SE +/- 0.000635, N = 3SE +/- 0.000865, N = 3SE +/- 0.000670, N = 3SE +/- 0.000393, N = 3SE +/- 0.000167, N = 3SE +/- 0.000291, N = 3SE +/- 0.000207, N = 3SE +/- 0.006662, N = 12SE +/- 0.000630, N = 3SE +/- 0.000095, N = 3SE +/- 0.006668, N = 12SE +/- 0.010750, N = 3SE +/- 0.000529, N = 3SE +/- 0.000288, N = 3SE +/- 0.003804, N = 3SE +/- 0.000267, N = 3SE +/- 0.000135, N = 3SE +/- 0.000076, N = 3SE +/- 0.000305, N = 30.7757920.5491470.3643850.7437710.7970650.5633470.3732820.7642510.7762970.5912680.3928780.7477070.7705080.5902210.3917290.7620930.3355090.2255670.1451090.3218431. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Buffer Size Comparison (Sample Rate: 44100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Buffer Size Comparison (Sample Rate: 44100)51210240.18480.36960.55440.73920.924SE +/- 0.000792, N = 3SE +/- 0.000604, N = 3SE +/- 0.000393, N = 3SE +/- 0.000098, N = 3SE +/- 0.006662, N = 12SE +/- 0.000730, N = 3SE +/- 0.010750, N = 3SE +/- 0.000258, N = 3SE +/- 0.000267, N = 3SE +/- 0.000223, N = 30.7757920.7972600.7970650.8213730.7762970.8005280.7705080.8000440.3355090.3624481. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Buffer Size Comparison (Sample Rate: 96000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Buffer Size Comparison (Sample Rate: 96000)51210240.1330.2660.3990.5320.665SE +/- 0.000635, N = 3SE +/- 0.000339, N = 3SE +/- 0.000167, N = 3SE +/- 0.000195, N = 3SE +/- 0.000630, N = 3SE +/- 0.003479, N = 3SE +/- 0.000529, N = 3SE +/- 0.005146, N = 9SE +/- 0.000135, N = 3SE +/- 0.000279, N = 30.5491470.5708350.5633470.5852210.5912680.5586620.5902210.5763900.2255670.2521971. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Buffer Size Comparison (Sample Rate: 192000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Buffer Size Comparison (Sample Rate: 192000)51210240.08870.17740.26610.35480.4435SE +/- 0.000865, N = 3SE +/- 0.000191, N = 3SE +/- 0.000291, N = 3SE +/- 0.000285, N = 3SE +/- 0.000095, N = 3SE +/- 0.003917, N = 3SE +/- 0.000288, N = 3SE +/- 0.000760, N = 3SE +/- 0.000076, N = 3SE +/- 0.000090, N = 30.3643850.3815700.3732820.3907500.3928780.3911850.3917290.3942900.1451090.1666061. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate Comparison (Buffer Size: 1024)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate Comparison (Buffer Size: 1024)44100960001920004800000.18480.36960.55440.73920.924SE +/- 0.000604, N = 3SE +/- 0.000339, N = 3SE +/- 0.000191, N = 3SE +/- 0.000798, N = 3SE +/- 0.000098, N = 3SE +/- 0.000195, N = 3SE +/- 0.000285, N = 3SE +/- 0.001050, N = 3SE +/- 0.000730, N = 3SE +/- 0.003479, N = 3SE +/- 0.003917, N = 3SE +/- 0.000633, N = 3SE +/- 0.000258, N = 3SE +/- 0.005146, N = 9SE +/- 0.000760, N = 3SE +/- 0.000443, N = 3SE +/- 0.000223, N = 3SE +/- 0.000279, N = 3SE +/- 0.000090, N = 3SE +/- 0.000131, N = 30.7972600.5708350.3815700.7656160.8213730.5852210.3907500.7859610.8005280.5586620.3911850.7678290.8000440.5763900.3942900.7668230.3624480.2521970.1666060.3481211. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Buffer Size Comparison (Sample Rate: 480000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Buffer Size Comparison (Sample Rate: 480000)51210240.17680.35360.53040.70720.884SE +/- 0.000670, N = 3SE +/- 0.000798, N = 3SE +/- 0.000207, N = 3SE +/- 0.001050, N = 3SE +/- 0.006668, N = 12SE +/- 0.000633, N = 3SE +/- 0.003804, N = 3SE +/- 0.000443, N = 3SE +/- 0.000305, N = 3SE +/- 0.000131, N = 30.7437710.7656160.7642510.7859610.7477070.7678290.7620930.7668230.3218430.3481211. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Monkey Audio Encoding

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterMonkey Audio Encoding 3.99.6ComparisonWAV To APE1122334455SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.66, N = 2520.2819.4818.5718.6746.561. (CXX) g++ options: -O3 -pedantic -rdynamic -lrt

FLAC Audio Encoding

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterFLAC Audio Encoding 1.4ComparisonWAV To FLAC20406080100SE +/- 0.33, N = 25SE +/- 0.14, N = 5SE +/- 0.55, N = 25SE +/- 0.02, N = 5SE +/- 0.45, N = 554.3145.3351.6043.5190.291. (CXX) g++ options: -O3 -fvisibility=hidden -logg -lm

LAME MP3 Encoding

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterLAME MP3 Encoding 3.100ComparisonWAV To MP3612182430SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 313.0512.5011.8911.9624.371. (CC) gcc options: -O3 -ffast-math -funroll-loops -fschedule-insns2 -fbranch-count-reg -fforce-addr -pipe -lncurses -lm

Opus Codec Encoding

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterOpus Codec Encoding 1.4ComparisonWAV To Opus Encode306090120150SE +/- 0.17, N = 5SE +/- 0.02, N = 5SE +/- 0.31, N = 5SE +/- 0.02, N = 5SE +/- 0.17, N = 571.5067.6265.4564.44129.791. (CXX) g++ options: -O3 -fvisibility=hidden -logg -lm

WavPack Audio Encoding

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcpi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterWavPack Audio Encoding 5.3ComparisonWAV To WavPack4080120160200SE +/- 0.07, N = 5SE +/- 0.13, N = 5SE +/- 0.05, N = 5SE +/- 0.08, N = 5104.0499.6294.62188.001. (CXX) g++ options: -rdynamic

ClickHouse

Comparison

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5Comparison100M Rows Hits Dataset, First Run / Cold Cache100M Rows Hits Dataset, Second Run100M Rows Hits Dataset, Third Run1020304050SE +/- 0.56, N = 3SE +/- 0.67, N = 3SE +/- 0.37, N = 3SE +/- 0.29, N = 3SE +/- 0.32, N = 3SE +/- 0.71, N = 343.4546.1545.7238.8341.3741.81

Apache Spark TPC-DS

Scale Factor Comparison (Q01)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q01)11050100510152025SE +/- 0.10, N = 3SE +/- 0.14, N = 4SE +/- 0.04, N = 3SE +/- 0.10, N = 4SE +/- 0.02, N = 3SE +/- 0.20, N = 3SE +/- 0.05, N = 38.9311.2915.858.9811.2315.4120.131. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Comparison (Scale Factor: 1)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 1)Q01Q02Q03Q04Q05Q06Q07Q08Q09Q10Q11Q12Q13Q14Q15Q16Q17Q18Q19Q20Q21Q22Q23Q24Q25Q26Q27Q28Q29Q30Q31Q32Q33Q34Q35Q36Q37Q38Q39Q40Q41Q42Q43Q44Q45Q46Q47Q48Q49Q50Q51Q52Q53Q54Q55Q56Q57Q58Q60Q61Q62Q63Q64Q65Q66Q67Q68Q69Q70Q71Q72Q73Q74Q75Q76Q77Q78Q79Q80Q81Q82Q83Q84Q85Q86Q87Q88Q89Q90Q91Q92Q94Q95Q96Q97Q59Q93Q98Q99510152025SE +/- 0.10, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.22, N = 3SE +/- 0.19, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.12, N = 3SE +/- 0.11, N = 3SE +/- 0.17, N = 3SE +/- 0.10, N = 3SE +/- 0.02, N = 3SE +/- 0.16, N = 3SE +/- 0.33, N = 3SE +/- 0.09, N = 3SE +/- 0.16, N = 3SE +/- 0.10, N = 3SE +/- 0.19, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.14, N = 3SE +/- 0.21, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.02, N = 3SE +/- 0.17, N = 3SE +/- 0.06, N = 2SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.13, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 2SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 0.13, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 2SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.18, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.11, N = 3SE +/- 0.09, N = 3SE +/- 0.28, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 2SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.19, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 2SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.14, N = 2SE +/- 0.01, N = 2SE +/- 0.07, N = 3SE +/- 0.04, N = 2SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.15, N = 2SE +/- 0.02, N = 2SE +/- 0.02, N = 2SE +/- 0.22, N = 2SE +/- 0.10, N = 4SE +/- 0.06, N = 4SE +/- 0.07, N = 4SE +/- 0.10, N = 4SE +/- 0.11, N = 4SE +/- 0.05, N = 4SE +/- 0.04, N = 4SE +/- 0.01, N = 4SE +/- 0.05, N = 4SE +/- 0.16, N = 4SE +/- 0.05, N = 4SE +/- 0.02, N = 4SE +/- 0.11, N = 4SE +/- 0.11, N = 4SE +/- 0.02, N = 4SE +/- 0.10, N = 4SE +/- 0.12, N = 4SE +/- 0.08, N = 4SE +/- 0.05, N = 4SE +/- 0.02, N = 4SE +/- 0.08, N = 4SE +/- 0.18, N = 4SE +/- 0.23, N = 4SE +/- 0.05, N = 4SE +/- 0.11, N = 4SE +/- 0.14, N = 4SE +/- 0.05, N = 4SE +/- 0.12, N = 3SE +/- 0.04, N = 4SE +/- 0.07, N = 3SE +/- 0.14, N = 4SE +/- 0.04, N = 4SE +/- 0.09, N = 4SE +/- 0.13, N = 2SE +/- 0.08, N = 4SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 4SE +/- 0.12, N = 4SE +/- 0.04, N = 3SE +/- 0.05, N = 4SE +/- 0.03, N = 4SE +/- 0.09, N = 4SE +/- 0.03, N = 4SE +/- 0.03, N = 4SE +/- 0.06, N = 3SE +/- 0.16, N = 4SE +/- 0.07, N = 4SE +/- 0.08, N = 4SE +/- 0.14, N = 4SE +/- 0.19, N = 4SE +/- 0.02, N = 4SE +/- 0.07, N = 4SE +/- 0.10, N = 4SE +/- 0.06, N = 4SE +/- 0.05, N = 4SE +/- 0.07, N = 4SE +/- 0.05, N = 2SE +/- 0.10, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.19, N = 4SE +/- 0.06, N = 4SE +/- 0.13, N = 3SE +/- 0.13, N = 4SE +/- 0.07, N = 4SE +/- 0.18, N = 4SE +/- 0.15, N = 3SE +/- 0.10, N = 4SE +/- 0.25, N = 4SE +/- 0.05, N = 4SE +/- 0.05, N = 4SE +/- 0.13, N = 4SE +/- 0.10, N = 4SE +/- 0.05, N = 4SE +/- 0.07, N = 4SE +/- 0.06, N = 4SE +/- 0.10, N = 4SE +/- 0.08, N = 3SE +/- 0.07, N = 4SE +/- 0.02, N = 3SE +/- 0.05, N = 4SE +/- 0.19, N = 3SE +/- 0.11, N = 4SE +/- 0.05, N = 4SE +/- 0.12, N = 3SE +/- 0.10, N = 4SE +/- 0.06, N = 4SE +/- 0.06, N = 4SE +/- 0.08, N = 4SE +/- 0.03, N = 4SE +/- 0.04, N = 3SE +/- 0.03, N = 4SE +/- 0.06, N = 4SE +/- 0.04, N = 4SE +/- 0.04, N = 3SE +/- 0.02, N = 4SE +/- 0.02, N = 28.939.776.7515.1612.119.118.488.758.1911.4512.754.958.269.017.576.3111.7210.598.174.977.9910.758.082.7211.217.899.1211.1411.639.0012.087.6810.208.4111.229.255.2210.183.768.076.236.707.248.647.538.6712.597.8911.148.5613.306.787.8811.166.809.8810.6410.1710.256.547.637.7917.1510.1011.2712.318.4611.0710.298.9919.618.3011.7214.438.8211.2414.038.5113.458.768.889.217.1312.008.1310.0911.838.706.768.327.586.117.465.759.719.097.714.877.838.989.696.7915.0411.799.338.468.807.9011.5312.704.908.409.037.496.2911.9910.588.024.947.9110.428.072.6811.277.888.9911.0211.199.2612.297.7010.048.6111.488.835.0910.083.728.006.226.727.158.617.608.6912.437.6510.778.7513.226.737.9010.896.579.8710.769.9210.196.497.837.8817.1910.2711.2712.088.5310.9510.359.0419.118.3111.9514.268.7811.3914.338.4413.528.878.869.247.3011.868.0410.0711.398.816.638.197.796.097.265.739.839.117.754.857.621. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q02)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q02)11050100500714212835SE +/- 0.14, N = 3SE +/- 0.25, N = 4SE +/- 0.12, N = 3SE +/- 0.06, N = 4SE +/- 0.36, N = 3SE +/- 0.09, N = 3SE +/- 0.29, N = 3SE +/- 0.07, N = 29.7711.3217.559.6911.6317.5827.5527.901. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q03)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q03)11050100500510152025SE +/- 0.03, N = 3SE +/- 0.03, N = 4SE +/- 0.08, N = 3SE +/- 0.07, N = 4SE +/- 0.17, N = 3SE +/- 0.28, N = 3SE +/- 0.20, N = 3SE +/- 0.21, N = 26.758.4814.186.799.0214.1219.5119.481. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q04)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q04)110501004080120160200SE +/- 0.22, N = 3SE +/- 0.36, N = 4SE +/- 0.56, N = 3SE +/- 0.10, N = 4SE +/- 0.31, N = 3SE +/- 0.72, N = 3SE +/- 1.16, N = 315.1650.14154.3115.0448.88153.78192.451. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q05)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q05)110501001530456075SE +/- 0.19, N = 3SE +/- 0.37, N = 4SE +/- 0.56, N = 3SE +/- 0.11, N = 4SE +/- 0.60, N = 3SE +/- 1.08, N = 3SE +/- 0.44, N = 312.1123.8543.1711.7923.3843.7466.741. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q06)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q06)110501005001122334455SE +/- 0.03, N = 3SE +/- 0.14, N = 4SE +/- 0.91, N = 3SE +/- 0.05, N = 4SE +/- 0.30, N = 3SE +/- 0.46, N = 3SE +/- 0.17, N = 3SE +/- 0.05, N = 29.1118.8149.099.3319.4047.6723.7423.611. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q07)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q07)11050100500714212835SE +/- 0.10, N = 3SE +/- 0.32, N = 4SE +/- 0.48, N = 3SE +/- 0.04, N = 4SE +/- 0.10, N = 3SE +/- 0.21, N = 3SE +/- 0.64, N = 3SE +/- 1.17, N = 28.4812.5821.528.4612.7620.7229.3227.831. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q08)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q08)11050100500510152025SE +/- 0.12, N = 3SE +/- 0.13, N = 4SE +/- 0.44, N = 3SE +/- 0.01, N = 4SE +/- 0.14, N = 3SE +/- 0.26, N = 3SE +/- 0.28, N = 3SE +/- 0.13, N = 28.7511.8317.208.8011.8417.2722.2422.661. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q09)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q09)11050100500918273645SE +/- 0.11, N = 3SE +/- 0.10, N = 4SE +/- 0.25, N = 3SE +/- 0.05, N = 4SE +/- 0.28, N = 3SE +/- 0.16, N = 3SE +/- 0.49, N = 3SE +/- 0.61, N = 28.1912.0524.137.9011.8324.4641.1939.801. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q10)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q10)11050100500714212835SE +/- 0.17, N = 3SE +/- 0.12, N = 4SE +/- 0.37, N = 3SE +/- 0.16, N = 4SE +/- 0.09, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 3SE +/- 1.72, N = 211.4514.1420.1611.5314.3320.2427.5927.691. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q11)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q11)11050100306090120150SE +/- 0.10, N = 3SE +/- 0.27, N = 4SE +/- 0.28, N = 3SE +/- 0.05, N = 4SE +/- 0.37, N = 3SE +/- 0.53, N = 3SE +/- 0.56, N = 312.7535.77103.2812.7035.90101.84121.651. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q12)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q12)110501005001.18582.37163.55744.74325.929SE +/- 0.02, N = 3SE +/- 0.04, N = 4SE +/- 0.08, N = 3SE +/- 0.02, N = 4SE +/- 0.03, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 24.955.145.274.905.145.215.225.231. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q13)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q13)11050100500714212835SE +/- 0.16, N = 3SE +/- 0.16, N = 4SE +/- 0.11, N = 3SE +/- 0.11, N = 4SE +/- 0.10, N = 3SE +/- 0.17, N = 3SE +/- 0.50, N = 3SE +/- 0.38, N = 28.2611.8019.788.4011.4319.4528.1928.721. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q14)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q14)1105010050020406080100SE +/- 0.33, N = 3SE +/- 0.35, N = 4SE +/- 0.35, N = 3SE +/- 0.11, N = 4SE +/- 0.58, N = 3SE +/- 2.04, N = 3SE +/- 2.66, N = 3SE +/- 1.32, N = 39.0122.7675.669.0322.1977.16101.62100.361. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q15)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q15)11050100500612182430SE +/- 0.09, N = 3SE +/- 0.21, N = 4SE +/- 0.24, N = 3SE +/- 0.02, N = 4SE +/- 0.19, N = 3SE +/- 0.09, N = 3SE +/- 0.30, N = 3SE +/- 0.11, N = 37.5710.3917.777.4910.3317.5926.1926.111. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q16)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q16)1246810SE +/- 0.16, N = 3SE +/- 0.10, N = 46.316.291. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q17)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q17)11050100500306090120150SE +/- 0.10, N = 3SE +/- 0.36, N = 4SE +/- 1.40, N = 3SE +/- 0.12, N = 4SE +/- 0.15, N = 3SE +/- 0.43, N = 3SE +/- 0.40, N = 3SE +/- 0.71, N = 311.7235.11119.3511.9934.68119.3142.9243.551. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q18)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q18)11050100500714212835SE +/- 0.19, N = 3SE +/- 0.12, N = 4SE +/- 0.20, N = 3SE +/- 0.08, N = 4SE +/- 0.21, N = 3SE +/- 0.21, N = 3SE +/- 0.54, N = 3SE +/- 0.23, N = 310.5913.7820.8710.5813.8121.4127.8827.731. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q19)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q19)11050100500612182430SE +/- 0.09, N = 3SE +/- 0.21, N = 4SE +/- 0.18, N = 3SE +/- 0.05, N = 4SE +/- 0.22, N = 3SE +/- 0.37, N = 3SE +/- 0.67, N = 3SE +/- 0.52, N = 38.1711.8118.238.0211.1517.8925.5725.801. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q20)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q20)110501005001.1972.3943.5914.7885.985SE +/- 0.04, N = 3SE +/- 0.03, N = 4SE +/- 0.08, N = 3SE +/- 0.02, N = 4SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 24.975.095.214.945.055.275.325.221. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q21)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q21)11050100500510152025SE +/- 0.03, N = 3SE +/- 0.17, N = 4SE +/- 0.26, N = 3SE +/- 0.08, N = 4SE +/- 0.17, N = 3SE +/- 0.34, N = 3SE +/- 0.09, N = 3SE +/- 0.28, N = 37.9912.5415.807.9112.1015.8320.5721.021. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q22)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q22)110501005001428425670SE +/- 0.05, N = 3SE +/- 0.40, N = 4SE +/- 0.54, N = 3SE +/- 0.18, N = 4SE +/- 0.14, N = 3SE +/- 0.38, N = 3SE +/- 0.29, N = 3SE +/- 0.40, N = 310.7526.5736.1210.4226.9436.6660.7561.501. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q23)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q23)1105010050100150200250SE +/- 0.02, N = 3SE +/- 0.43, N = 4SE +/- 1.35, N = 3SE +/- 0.23, N = 4SE +/- 0.46, N = 3SE +/- 1.31, N = 3SE +/- 0.08, N = 38.0833.00178.138.0733.70173.15223.121. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q24)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q24)110501001326395265SE +/- 0.02, N = 3SE +/- 0.11, N = 4SE +/- 0.49, N = 3SE +/- 0.05, N = 4SE +/- 0.64, N = 3SE +/- 0.08, N = 3SE +/- 0.74, N = 32.7217.4657.152.6816.7956.7839.991. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q25)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q25)11050100500306090120150SE +/- 0.12, N = 3SE +/- 0.27, N = 4SE +/- 1.06, N = 3SE +/- 0.11, N = 4SE +/- 0.79, N = 3SE +/- 0.72, N = 3SE +/- 0.33, N = 3SE +/- 0.28, N = 311.2135.36112.6511.2735.47109.5141.9741.301. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q26)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q26)11050100500510152025SE +/- 0.06, N = 3SE +/- 0.27, N = 4SE +/- 0.12, N = 3SE +/- 0.14, N = 4SE +/- 0.29, N = 3SE +/- 0.30, N = 3SE +/- 0.57, N = 3SE +/- 0.61, N = 37.8910.3216.027.8810.4816.2320.4420.591. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q27)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q27)11050100500714212835SE +/- 0.14, N = 3SE +/- 0.20, N = 4SE +/- 0.47, N = 3SE +/- 0.05, N = 4SE +/- 0.27, N = 2SE +/- 0.39, N = 3SE +/- 0.26, N = 3SE +/- 0.46, N = 39.1212.9222.108.9913.4320.6928.4629.861. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q28)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q28)110501005001530456075SE +/- 0.21, N = 3SE +/- 0.21, N = 4SE +/- 0.48, N = 3SE +/- 0.12, N = 3SE +/- 0.51, N = 3SE +/- 0.66, N = 3SE +/- 2.08, N = 3SE +/- 0.64, N = 311.1417.4642.7711.0217.5441.6268.1767.041. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q29)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q29)11050100306090120150SE +/- 0.09, N = 3SE +/- 0.41, N = 4SE +/- 1.14, N = 3SE +/- 0.04, N = 4SE +/- 0.40, N = 3SE +/- 0.16, N = 3SE +/- 0.23, N = 311.6335.87118.4111.1934.69117.3447.471. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q30)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q30)11050100500510152025SE +/- 0.05, N = 3SE +/- 0.06, N = 4SE +/- 0.32, N = 3SE +/- 0.07, N = 3SE +/- 0.16, N = 3SE +/- 0.07, N = 3SE +/- 0.28, N = 3SE +/- 0.06, N = 39.0011.9115.989.2611.9016.0419.5118.891. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q31)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q31)110501005001224364860SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.17, N = 3SE +/- 0.14, N = 4SE +/- 0.63, N = 3SE +/- 0.41, N = 3SE +/- 0.70, N = 3SE +/- 0.67, N = 312.0818.6435.8012.2919.3333.5251.4949.001. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q32)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q32)11050100500510152025SE +/- 0.07, N = 3SE +/- 0.25, N = 4SE +/- 0.17, N = 3SE +/- 0.04, N = 4SE +/- 0.14, N = 3SE +/- 0.41, N = 3SE +/- 0.17, N = 3SE +/- 0.33, N = 37.689.7414.407.709.3815.2922.6522.591. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q33)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q33)11050100500714212835SE +/- 0.09, N = 3SE +/- 0.16, N = 4SE +/- 0.40, N = 3SE +/- 0.09, N = 4SE +/- 0.26, N = 3SE +/- 0.37, N = 3SE +/- 0.45, N = 3SE +/- 0.12, N = 310.2014.1022.3110.0413.6022.0029.1729.041. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q34)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q34)11050100500612182430SE +/- 0.02, N = 3SE +/- 0.22, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 2SE +/- 0.46, N = 3SE +/- 0.11, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 38.4111.9117.688.6112.0417.9123.9522.811. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q35)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q35)11050100500816243240SE +/- 0.17, N = 3SE +/- 0.12, N = 4SE +/- 0.27, N = 3SE +/- 0.08, N = 4SE +/- 0.93, N = 3SE +/- 0.22, N = 3SE +/- 0.17, N = 3SE +/- 0.28, N = 311.2215.9125.6011.4816.5725.0736.6036.501. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q36)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q36)11050100500714212835SE +/- 0.06, N = 2SE +/- 0.13, N = 4SE +/- 0.71, N = 3SE +/- 0.12, N = 3SE +/- 0.63, N = 3SE +/- 0.63, N = 3SE +/- 0.49, N = 3SE +/- 0.57, N = 39.2511.9222.148.8312.4822.3931.0430.731. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q37)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q37)11050100500510152025SE +/- 0.05, N = 3SE +/- 0.27, N = 4SE +/- 0.18, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.24, N = 3SE +/- 0.33, N = 35.2213.8222.765.0913.3622.7420.9921.401. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q38)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q38)110501005001530456075SE +/- 0.07, N = 3SE +/- 0.28, N = 4SE +/- 0.66, N = 3SE +/- 0.05, N = 4SE +/- 0.11, N = 3SE +/- 0.89, N = 3SE +/- 0.66, N = 3SE +/- 0.18, N = 310.1817.6943.1910.0817.4143.4867.3868.081. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q39)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q39)11050100500612182430SE +/- 0.07, N = 3SE +/- 0.31, N = 4SE +/- 0.36, N = 3SE +/- 0.12, N = 4SE +/- 0.20, N = 3SE +/- 0.36, N = 3SE +/- 1.30, N = 3SE +/- 0.37, N = 33.7610.4215.193.7210.7515.1922.7724.991. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q40)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q40)110501001020304050SE +/- 0.13, N = 3SE +/- 0.11, N = 4SE +/- 0.58, N = 3SE +/- 0.04, N = 3SE +/- 0.26, N = 3SE +/- 0.37, N = 3SE +/- 0.17, N = 28.0717.6842.828.0017.3841.4324.081. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q41)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q41)11050100500246810SE +/- 0.01, N = 3SE +/- 0.07, N = 4SE +/- 0.10, N = 3SE +/- 0.05, N = 4SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 36.237.177.376.227.097.287.297.321. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q42)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q42)1105010050048121620SE +/- 0.06, N = 3SE +/- 0.06, N = 4SE +/- 0.30, N = 3SE +/- 0.03, N = 4SE +/- 0.06, N = 3SE +/- 0.34, N = 3SE +/- 0.15, N = 3SE +/- 0.25, N = 36.708.6913.566.728.4413.2517.7217.611. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q43)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q43)11050100500510152025SE +/- 0.06, N = 3SE +/- 0.09, N = 4SE +/- 0.34, N = 3SE +/- 0.09, N = 4SE +/- 0.08, N = 3SE +/- 0.30, N = 3SE +/- 0.17, N = 2SE +/- 0.32, N = 37.248.5514.177.158.4213.7718.7119.231. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q44)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q44)11050100500612182430SE +/- 0.13, N = 3SE +/- 0.04, N = 4SE +/- 0.06, N = 3SE +/- 0.03, N = 4SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.66, N = 3SE +/- 0.23, N = 38.646.547.748.616.407.8425.2225.031. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q45)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q45)1105010050048121620SE +/- 0.01, N = 3SE +/- 0.13, N = 4SE +/- 0.13, N = 3SE +/- 0.03, N = 4SE +/- 0.05, N = 3SE +/- 0.28, N = 3SE +/- 0.16, N = 3SE +/- 0.37, N = 37.539.7613.157.609.8413.4616.8616.901. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q46)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q46)11050100500714212835SE +/- 0.11, N = 3SE +/- 0.16, N = 4SE +/- 0.27, N = 3SE +/- 0.06, N = 3SE +/- 0.34, N = 3SE +/- 0.09, N = 3SE +/- 0.26, N = 3SE +/- 0.29, N = 38.6712.6622.298.6912.4721.8730.0429.871. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q47)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q47)110501005001122334455SE +/- 0.05, N = 3SE +/- 0.16, N = 4SE +/- 0.22, N = 3SE +/- 0.16, N = 4SE +/- 0.08, N = 3SE +/- 0.40, N = 3SE +/- 0.31, N = 3SE +/- 0.43, N = 312.5919.1033.3412.4319.0833.7350.0549.441. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q48)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q48)11050100500612182430SE +/- 0.05, N = 3SE +/- 0.10, N = 4SE +/- 0.24, N = 3SE +/- 0.07, N = 4SE +/- 0.09, N = 3SE +/- 0.32, N = 3SE +/- 0.17, N = 3SE +/- 0.27, N = 37.8910.4916.977.6510.0016.6723.0023.131. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q49)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q49)110501001020304050SE +/- 0.08, N = 2SE +/- 0.11, N = 4SE +/- 0.37, N = 3SE +/- 0.08, N = 4SE +/- 0.20, N = 3SE +/- 0.10, N = 3SE +/- 0.18, N = 311.1418.9340.2710.7719.5139.3444.001. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q50)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q50)1105010020406080100SE +/- 0.02, N = 3SE +/- 0.25, N = 4SE +/- 0.37, N = 3SE +/- 0.14, N = 4SE +/- 0.22, N = 3SE +/- 0.11, N = 3SE +/- 0.82, N = 38.5622.0050.088.7521.9049.3681.061. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q51)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q51)1105010020406080100SE +/- 0.07, N = 3SE +/- 0.18, N = 4SE +/- 0.66, N = 3SE +/- 0.19, N = 4SE +/- 0.17, N = 2SE +/- 0.65, N = 3SE +/- 1.20, N = 313.3026.3259.4613.2226.2858.63101.721. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q52)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q52)11050100500510152025SE +/- 0.08, N = 3SE +/- 0.10, N = 4SE +/- 0.36, N = 3SE +/- 0.02, N = 4SE +/- 0.15, N = 3SE +/- 0.10, N = 3SE +/- 0.18, N = 3SE +/- 0.29, N = 36.788.7613.596.738.6513.2218.8719.141. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q53)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q53)11050100500510152025SE +/- 0.13, N = 3SE +/- 0.08, N = 4SE +/- 0.18, N = 3SE +/- 0.07, N = 4SE +/- 0.11, N = 3SE +/- 0.25, N = 3SE +/- 0.21, N = 3SE +/- 0.11, N = 37.889.7515.367.909.4614.9420.0619.961. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q54)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q54)11050100500918273645SE +/- 0.13, N = 3SE +/- 0.07, N = 4SE +/- 0.16, N = 3SE +/- 0.10, N = 4SE +/- 0.42, N = 3SE +/- 0.12, N = 3SE +/- 0.19, N = 3SE +/- 0.13, N = 211.1616.9737.7710.8917.0736.9633.8333.991. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q55)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q55)1105010050048121620SE +/- 0.03, N = 3SE +/- 0.14, N = 4SE +/- 0.23, N = 3SE +/- 0.06, N = 4SE +/- 0.19, N = 3SE +/- 0.12, N = 3SE +/- 0.36, N = 3SE +/- 0.34, N = 36.808.6313.936.578.7013.6018.2217.951. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q56)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q56)11050100500714212835SE +/- 0.05, N = 3SE +/- 0.11, N = 4SE +/- 0.09, N = 3SE +/- 0.05, N = 4SE +/- 0.14, N = 3SE +/- 0.24, N = 3SE +/- 0.32, N = 3SE +/- 0.14, N = 39.8813.0220.679.8712.8021.1027.5928.051. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q57)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q57)11050100500714212835SE +/- 0.10, N = 3SE +/- 0.07, N = 4SE +/- 0.60, N = 3SE +/- 0.07, N = 4SE +/- 0.16, N = 3SE +/- 0.03, N = 3SE +/- 0.74, N = 3SE +/- 0.61, N = 310.6416.4824.4410.7616.3824.7831.6731.631. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q58)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q58)11050100500816243240SE +/- 0.04, N = 2SE +/- 0.09, N = 4SE +/- 0.54, N = 3SE +/- 0.05, N = 2SE +/- 0.34, N = 3SE +/- 0.28, N = 3SE +/- 0.53, N = 3SE +/- 1.31, N = 310.1713.8424.389.9214.7424.2035.6134.211. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q60)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q60)11050100500714212835SE +/- 0.04, N = 3SE +/- 0.34, N = 4SE +/- 0.32, N = 3SE +/- 0.10, N = 3SE +/- 0.51, N = 3SE +/- 0.21, N = 3SE +/- 0.71, N = 3SE +/- 0.70, N = 310.2514.2123.5910.1914.3222.5730.6931.171. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q61)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q61)11050100500246810SE +/- 0.04, N = 3SE +/- 0.05, N = 4SE +/- 0.39, N = 2SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.13, N = 3SE +/- 0.16, N = 3SE +/- 0.17, N = 36.547.107.706.497.037.657.517.711. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q62)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q62)1105010050048121620SE +/- 0.10, N = 4SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.27, N = 3SE +/- 0.22, N = 3SE +/- 0.07, N = 37.639.1912.977.838.9812.6115.6615.611. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q63)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q63)11050100500510152025SE +/- 0.05, N = 3SE +/- 0.13, N = 4SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.24, N = 3SE +/- 0.06, N = 2SE +/- 0.33, N = 3SE +/- 0.31, N = 37.799.5515.017.889.8314.7319.9319.861. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q64)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q64)110501004080120160200SE +/- 0.18, N = 3SE +/- 0.32, N = 4SE +/- 1.53, N = 3SE +/- 0.19, N = 4SE +/- 0.51, N = 3SE +/- 3.02, N = 3SE +/- 2.48, N = 317.1551.48170.8517.1950.33165.96151.381. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q65)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q65)110501001632486480SE +/- 0.02, N = 3SE +/- 0.84, N = 4SE +/- 0.84, N = 3SE +/- 0.06, N = 4SE +/- 0.21, N = 3SE +/- 0.48, N = 3SE +/- 1.31, N = 310.1018.6442.4210.2718.1242.6973.381. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q66)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q66)11050100500714212835SE +/- 0.08, N = 3SE +/- 0.18, N = 4SE +/- 0.17, N = 2SE +/- 0.13, N = 3SE +/- 0.16, N = 3SE +/- 0.24, N = 3SE +/- 0.44, N = 3SE +/- 0.43, N = 311.2714.0320.0711.2713.7520.6227.6827.081. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q67)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q67)1105010050100150200250SE +/- 0.11, N = 3SE +/- 0.13, N = 4SE +/- 0.63, N = 3SE +/- 0.13, N = 4SE +/- 0.11, N = 3SE +/- 0.51, N = 3SE +/- 1.23, N = 312.3133.19106.6112.0832.61106.30205.561. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q68)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q68)11050100500714212835SE +/- 0.09, N = 3SE +/- 0.14, N = 4SE +/- 0.18, N = 3SE +/- 0.07, N = 4SE +/- 0.27, N = 3SE +/- 0.47, N = 3SE +/- 0.84, N = 3SE +/- 0.26, N = 38.4612.5121.688.5312.8122.6031.3130.481. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q69)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q69)11050100500612182430SE +/- 0.28, N = 3SE +/- 0.17, N = 4SE +/- 0.29, N = 3SE +/- 0.18, N = 4SE +/- 0.02, N = 3SE +/- 0.21, N = 2SE +/- 0.33, N = 3SE +/- 0.42, N = 311.0713.8220.2810.9513.9720.1726.7626.081. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q70)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q70)11050100500816243240SE +/- 0.01, N = 3SE +/- 0.14, N = 4SE +/- 0.35, N = 3SE +/- 0.15, N = 3SE +/- 0.32, N = 3SE +/- 0.53, N = 3SE +/- 0.83, N = 3SE +/- 1.37, N = 310.2913.4423.7610.3513.7122.9535.1535.881. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q71)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q71)11050100500714212835SE +/- 0.08, N = 3SE +/- 0.21, N = 4SE +/- 1.15, N = 2SE +/- 0.10, N = 4SE +/- 0.02, N = 3SE +/- 0.38, N = 3SE +/- 0.15, N = 3SE +/- 0.82, N = 38.9913.1222.279.0412.7123.1931.4430.911. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q72)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q72)11050100100200300400500SE +/- 0.12, N = 3SE +/- 1.21, N = 4SE +/- 5.27, N = 3SE +/- 0.25, N = 4SE +/- 0.40, N = 3SE +/- 11.04, N = 3SE +/- 1.63, N = 319.61118.28445.1119.11118.08419.79135.021. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q73)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q73)11050100500510152025SE +/- 0.07, N = 3SE +/- 0.10, N = 4SE +/- 0.02, N = 2SE +/- 0.05, N = 4SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.46, N = 3SE +/- 0.37, N = 38.3011.1916.298.3111.1516.6521.9221.301. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q74)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q74)11050100306090120150SE +/- 0.08, N = 3SE +/- 0.13, N = 4SE +/- 1.15, N = 3SE +/- 0.05, N = 4SE +/- 0.09, N = 3SE +/- 0.64, N = 3SE +/- 1.38, N = 311.7219.8097.5211.9519.7495.45112.491. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q75)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q75)1105010020406080100SE +/- 0.15, N = 3SE +/- 0.35, N = 4SE +/- 0.38, N = 3SE +/- 0.13, N = 4SE +/- 0.38, N = 3SE +/- 1.20, N = 3SE +/- 0.98, N = 314.4327.4959.6014.2627.0459.3796.421. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q76)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q76)11050100500714212835SE +/- 0.03, N = 2SE +/- 0.21, N = 3SE +/- 0.40, N = 3SE +/- 0.10, N = 4SE +/- 0.13, N = 2SE +/- 0.40, N = 3SE +/- 0.17, N = 3SE +/- 0.72, N = 38.8212.5220.508.7812.3020.5929.1428.591. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q77)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q77)11050100816243240SE +/- 0.08, N = 3SE +/- 0.24, N = 4SE +/- 0.16, N = 3SE +/- 0.05, N = 4SE +/- 0.15, N = 3SE +/- 0.31, N = 3SE +/- 0.30, N = 311.2415.2524.6611.3914.5724.2433.671. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q78)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q78)110501004080120160200SE +/- 0.08, N = 3SE +/- 0.31, N = 4SE +/- 0.64, N = 3SE +/- 0.07, N = 4SE +/- 0.13, N = 3SE +/- 2.63, N = 3SE +/- 2.62, N = 314.0344.14145.2914.3343.40145.20186.011. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q79)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q79)11050100500714212835SE +/- 0.19, N = 3SE +/- 0.14, N = 4SE +/- 0.10, N = 3SE +/- 0.06, N = 4SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.27, N = 3SE +/- 0.49, N = 38.5111.9121.248.4411.9921.0430.3330.271. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q80)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q80)11050100306090120150SE +/- 0.04, N = 3SE +/- 0.46, N = 4SE +/- 2.12, N = 3SE +/- 0.10, N = 4SE +/- 0.75, N = 3SE +/- 1.43, N = 3SE +/- 1.28, N = 313.4548.08154.5313.5247.18154.37100.241. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q81)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q81)11050100510152025SE +/- 0.04, N = 3SE +/- 0.17, N = 3SE +/- 0.42, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.16, N = 3SE +/- 0.23, N = 38.7611.5415.868.8711.4615.6018.701. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q82)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q82)11050100500918273645SE +/- 0.10, N = 2SE +/- 0.22, N = 4SE +/- 0.08, N = 3SE +/- 0.07, N = 4SE +/- 0.19, N = 3SE +/- 0.80, N = 3SE +/- 0.16, N = 3SE +/- 0.43, N = 38.8816.9940.318.8616.6438.4626.0626.021. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q83)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q83)1105010048121620SE +/- 0.06, N = 3SE +/- 0.11, N = 4SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.23, N = 3SE +/- 0.04, N = 3SE +/- 0.25, N = 39.2110.7413.639.2410.7913.2615.751. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q84)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q84)110501005003691215SE +/- 0.05, N = 3SE +/- 0.07, N = 4SE +/- 0.21, N = 3SE +/- 0.05, N = 4SE +/- 0.14, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 37.139.1311.687.309.1511.7013.5713.551. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q85)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q85)11050100500612182430SE +/- 0.03, N = 3SE +/- 0.03, N = 4SE +/- 0.28, N = 3SE +/- 0.19, N = 3SE +/- 0.29, N = 3SE +/- 0.47, N = 2SE +/- 0.30, N = 3SE +/- 0.20, N = 312.0014.8519.5911.8614.5620.2225.2324.601. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q86)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q86)1105010050048121620SE +/- 0.03, N = 3SE +/- 0.04, N = 4SE +/- 0.31, N = 3SE +/- 0.11, N = 4SE +/- 0.23, N = 3SE +/- 0.23, N = 3SE +/- 0.31, N = 3SE +/- 0.13, N = 38.139.1712.238.049.2812.3015.5715.401. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q87)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q87)110501005001530456075SE +/- 0.01, N = 3SE +/- 0.72, N = 3SE +/- 0.51, N = 3SE +/- 0.05, N = 4SE +/- 0.23, N = 3SE +/- 0.36, N = 3SE +/- 0.15, N = 3SE +/- 0.70, N = 310.0917.6644.4210.0718.0443.6067.9768.191. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q88)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q88)110501005001326395265SE +/- 0.14, N = 2SE +/- 0.39, N = 4SE +/- 0.85, N = 3SE +/- 0.12, N = 3SE +/- 0.21, N = 3SE +/- 1.14, N = 3SE +/- 1.29, N = 3SE +/- 0.43, N = 311.8317.1836.3011.3917.4836.1455.6853.701. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q89)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q89)11050100500612182430SE +/- 0.01, N = 2SE +/- 0.10, N = 4SE +/- 0.22, N = 3SE +/- 0.10, N = 4SE +/- 0.06, N = 3SE +/- 0.51, N = 3SE +/- 0.16, N = 3SE +/- 0.42, N = 38.7011.0117.658.8110.7817.7023.2223.461. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q90)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q90)110501005003691215SE +/- 0.07, N = 3SE +/- 0.03, N = 4SE +/- 0.37, N = 3SE +/- 0.06, N = 4SE +/- 0.13, N = 3SE +/- 0.37, N = 3SE +/- 0.43, N = 3SE +/- 0.31, N = 36.767.469.976.637.529.8212.1112.101. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q91)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q91)110501003691215SE +/- 0.04, N = 2SE +/- 0.02, N = 3SE +/- 0.18, N = 3SE +/- 0.06, N = 4SE +/- 0.25, N = 2SE +/- 0.27, N = 3SE +/- 0.17, N = 38.329.7810.928.1910.0010.7312.211. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q92)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q92)1105010050048121620SE +/- 0.06, N = 3SE +/- 0.05, N = 4SE +/- 0.07, N = 3SE +/- 0.08, N = 4SE +/- 0.16, N = 3SE +/- 0.43, N = 3SE +/- 0.13, N = 3SE +/- 0.44, N = 37.589.0712.357.799.0113.1816.2416.041. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q94)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q94)11050100714212835SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.33, N = 3SE +/- 0.03, N = 4SE +/- 0.09, N = 3SE +/- 0.44, N = 3SE +/- 0.28, N = 36.119.9319.046.0910.1218.9627.971. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q95)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q95)11050100612182430SE +/- 0.08, N = 3SE +/- 0.09, N = 4SE +/- 0.36, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.17, N = 2SE +/- 0.06, N = 37.4610.2118.237.2610.1618.1026.651. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q96)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q96)110501003691215SE +/- 0.03, N = 3SE +/- 0.25, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 4SE +/- 0.06, N = 3SE +/- 0.19, N = 3SE +/- 0.19, N = 35.757.1610.915.736.6410.1813.531. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q97)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q97)1105010020406080100SE +/- 0.07, N = 3SE +/- 0.17, N = 4SE +/- 0.27, N = 3SE +/- 0.06, N = 4SE +/- 0.33, N = 3SE +/- 0.11, N = 3SE +/- 0.24, N = 39.7116.9948.419.8317.2347.0878.071. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q59)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q59)11050100500816243240SE +/- 0.15, N = 2SE +/- 0.10, N = 4SE +/- 0.13, N = 3SE +/- 0.04, N = 4SE +/- 0.23, N = 2SE +/- 0.53, N = 3SE +/- 0.85, N = 3SE +/- 1.04, N = 39.0913.1024.119.1112.5125.2436.2136.061. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q93)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q93)11050100306090120150SE +/- 0.02, N = 2SE +/- 0.26, N = 4SE +/- 0.71, N = 3SE +/- 0.04, N = 3SE +/- 0.41, N = 3SE +/- 2.38, N = 3SE +/- 1.70, N = 37.7127.1585.827.7527.0785.15140.111. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q98)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q98)110501001.20152.4033.60454.8066.0075SE +/- 0.02, N = 2SE +/- 0.02, N = 4SE +/- 0.04, N = 3SE +/- 0.02, N = 4SE +/- 0.08, N = 2SE +/- 0.14, N = 2SE +/- 0.05, N = 34.875.005.164.855.045.265.341. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q99)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q99)11050100510152025SE +/- 0.22, N = 2SE +/- 0.36, N = 3SE +/- 0.29, N = 3SE +/- 0.02, N = 2SE +/- 0.16, N = 3SE +/- 0.13, N = 3SE +/- 0.64, N = 27.8310.2316.267.6210.2016.3722.451. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Comparison (Scale Factor: 10)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 10)Q01Q02Q03Q04Q05Q06Q07Q08Q09Q10Q11Q12Q13Q14Q15Q17Q18Q19Q20Q21Q22Q23Q24Q25Q26Q27Q28Q29Q30Q31Q32Q33Q34Q35Q36Q37Q38Q39Q40Q41Q42Q43Q44Q45Q46Q47Q48Q49Q50Q51Q52Q53Q54Q55Q56Q57Q58Q59Q60Q61Q62Q63Q64Q65Q66Q67Q68Q69Q70Q71Q72Q73Q74Q75Q77Q78Q79Q80Q82Q83Q84Q85Q86Q88Q89Q90Q91Q92Q93Q95Q96Q97Q98Q99Q76Q81Q87Q94306090120150SE +/- 0.14, N = 4SE +/- 0.25, N = 4SE +/- 0.03, N = 4SE +/- 0.36, N = 4SE +/- 0.37, N = 4SE +/- 0.14, N = 4SE +/- 0.32, N = 4SE +/- 0.13, N = 4SE +/- 0.10, N = 4SE +/- 0.12, N = 4SE +/- 0.27, N = 4SE +/- 0.04, N = 4SE +/- 0.16, N = 4SE +/- 0.35, N = 4SE +/- 0.21, N = 4SE +/- 0.36, N = 4SE +/- 0.12, N = 4SE +/- 0.21, N = 4SE +/- 0.03, N = 4SE +/- 0.17, N = 4SE +/- 0.40, N = 4SE +/- 0.43, N = 4SE +/- 0.11, N = 4SE +/- 0.27, N = 4SE +/- 0.27, N = 4SE +/- 0.20, N = 4SE +/- 0.21, N = 4SE +/- 0.41, N = 4SE +/- 0.06, N = 4SE +/- 0.26, N = 3SE +/- 0.25, N = 4SE +/- 0.16, N = 4SE +/- 0.22, N = 3SE +/- 0.12, N = 4SE +/- 0.13, N = 4SE +/- 0.27, N = 4SE +/- 0.28, N = 4SE +/- 0.31, N = 4SE +/- 0.11, N = 4SE +/- 0.07, N = 4SE +/- 0.06, N = 4SE +/- 0.09, N = 4SE +/- 0.04, N = 4SE +/- 0.13, N = 4SE +/- 0.16, N = 4SE +/- 0.16, N = 4SE +/- 0.10, N = 4SE +/- 0.11, N = 4SE +/- 0.25, N = 4SE +/- 0.18, N = 4SE +/- 0.10, N = 4SE +/- 0.08, N = 4SE +/- 0.07, N = 4SE +/- 0.14, N = 4SE +/- 0.11, N = 4SE +/- 0.07, N = 4SE +/- 0.09, N = 4SE +/- 0.10, N = 4SE +/- 0.34, N = 4SE +/- 0.05, N = 4SE +/- 0.10, N = 4SE +/- 0.13, N = 4SE +/- 0.32, N = 4SE +/- 0.84, N = 4SE +/- 0.18, N = 4SE +/- 0.13, N = 4SE +/- 0.14, N = 4SE +/- 0.17, N = 4SE +/- 0.14, N = 4SE +/- 0.21, N = 4SE +/- 1.21, N = 4SE +/- 0.10, N = 4SE +/- 0.13, N = 4SE +/- 0.35, N = 4SE +/- 0.24, N = 4SE +/- 0.31, N = 4SE +/- 0.14, N = 4SE +/- 0.46, N = 4SE +/- 0.22, N = 4SE +/- 0.11, N = 4SE +/- 0.07, N = 4SE +/- 0.03, N = 4SE +/- 0.04, N = 4SE +/- 0.39, N = 4SE +/- 0.10, N = 4SE +/- 0.03, N = 4SE +/- 0.02, N = 3SE +/- 0.05, N = 4SE +/- 0.26, N = 4SE +/- 0.09, N = 4SE +/- 0.25, N = 3SE +/- 0.17, N = 4SE +/- 0.02, N = 4SE +/- 0.36, N = 3SE +/- 0.21, N = 3SE +/- 0.17, N = 3SE +/- 0.72, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.36, N = 3SE +/- 0.17, N = 3SE +/- 0.31, N = 3SE +/- 0.60, N = 3SE +/- 0.30, N = 3SE +/- 0.10, N = 3SE +/- 0.14, N = 3SE +/- 0.28, N = 3SE +/- 0.09, N = 3SE +/- 0.37, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.58, N = 3SE +/- 0.19, N = 3SE +/- 0.15, N = 3SE +/- 0.21, N = 3SE +/- 0.22, N = 3SE +/- 0.05, N = 3SE +/- 0.17, N = 3SE +/- 0.14, N = 3SE +/- 0.46, N = 3SE +/- 0.64, N = 3SE +/- 0.79, N = 3SE +/- 0.29, N = 3SE +/- 0.27, N = 2SE +/- 0.51, N = 3SE +/- 0.40, N = 3SE +/- 0.16, N = 3SE +/- 0.63, N = 3SE +/- 0.14, N = 3SE +/- 0.26, N = 3SE +/- 0.46, N = 3SE +/- 0.93, N = 3SE +/- 0.63, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.20, N = 3SE +/- 0.26, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.34, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.20, N = 3SE +/- 0.22, N = 3SE +/- 0.17, N = 2SE +/- 0.15, N = 3SE +/- 0.11, N = 3SE +/- 0.42, N = 3SE +/- 0.19, N = 3SE +/- 0.14, N = 3SE +/- 0.16, N = 3SE +/- 0.34, N = 3SE +/- 0.23, N = 2SE +/- 0.51, N = 3SE +/- 0.05, N = 3SE +/- 0.13, N = 3SE +/- 0.24, N = 3SE +/- 0.51, N = 3SE +/- 0.21, N = 3SE +/- 0.16, N = 3SE +/- 0.11, N = 3SE +/- 0.27, N = 3SE +/- 0.02, N = 3SE +/- 0.32, N = 3SE +/- 0.02, N = 3SE +/- 0.40, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.38, N = 3SE +/- 0.15, N = 3SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.75, N = 3SE +/- 0.19, N = 3SE +/- 0.23, N = 3SE +/- 0.14, N = 3SE +/- 0.29, N = 3SE +/- 0.23, N = 3SE +/- 0.21, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.25, N = 2SE +/- 0.16, N = 3SE +/- 0.41, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.33, N = 3SE +/- 0.08, N = 2SE +/- 0.16, N = 3SE +/- 0.13, N = 2SE +/- 0.06, N = 3SE +/- 0.23, N = 3SE +/- 0.09, N = 311.2911.328.4850.1423.8518.8112.5811.8312.0514.1435.775.1411.8022.7610.3935.1113.7811.815.0912.5426.5733.0017.4635.3610.3212.9217.4635.8711.9118.649.7414.1011.9115.9111.9213.8217.6910.4217.687.178.698.556.549.7612.6619.1010.4918.9322.0026.328.769.7516.978.6313.0216.4813.8413.1014.217.109.199.5551.4818.6414.0333.1912.5113.8213.4413.12118.2811.1919.8027.4915.2544.1411.9148.0816.9910.749.1314.859.1717.1811.017.469.789.0727.1510.217.1616.995.0010.2312.5211.5417.669.9311.2311.639.0248.8823.3819.4012.7611.8411.8314.3335.905.1411.4322.1910.3334.6813.8111.155.0512.1026.9433.7016.7935.4710.4813.4317.5434.6911.9019.339.3813.6012.0416.5712.4813.3617.4110.7517.387.098.448.426.409.8412.4719.0810.0019.5121.9026.288.659.4617.078.7012.8016.3814.7412.5114.327.038.989.8350.3318.1213.7532.6112.8113.9713.7112.71118.0811.1519.7427.0414.5743.4011.9947.1816.6410.799.1514.569.2817.4810.787.5210.009.0127.0710.166.6417.235.0410.2012.3011.4618.0410.121. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Comparison (Scale Factor: 50)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 50)Q01Q02Q03Q04Q05Q06Q07Q08Q09Q10Q11Q12Q13Q14Q15Q17Q18Q19Q20Q21Q22Q23Q24Q25Q26Q27Q28Q29Q30Q31Q32Q33Q34Q35Q36Q37Q38Q39Q40Q41Q42Q43Q44Q45Q46Q47Q48Q49Q50Q51Q52Q53Q54Q55Q56Q57Q58Q59Q60Q62Q63Q64Q65Q66Q67Q68Q69Q70Q72Q73Q74Q75Q76Q77Q78Q79Q80Q81Q82Q83Q84Q85Q86Q87Q88Q89Q90Q91Q92Q93Q94Q95Q96Q97Q98Q99Q61Q71100200300400500SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.08, N = 3SE +/- 0.56, N = 3SE +/- 0.56, N = 3SE +/- 0.91, N = 3SE +/- 0.48, N = 3SE +/- 0.44, N = 3SE +/- 0.25, N = 3SE +/- 0.37, N = 3SE +/- 0.28, N = 3SE +/- 0.08, N = 3SE +/- 0.11, N = 3SE +/- 0.35, N = 3SE +/- 0.24, N = 3SE +/- 1.40, N = 3SE +/- 0.20, N = 3SE +/- 0.18, N = 3SE +/- 0.08, N = 3SE +/- 0.26, N = 3SE +/- 0.54, N = 3SE +/- 1.35, N = 3SE +/- 0.49, N = 3SE +/- 1.06, N = 3SE +/- 0.12, N = 3SE +/- 0.47, N = 3SE +/- 0.48, N = 3SE +/- 1.14, N = 3SE +/- 0.32, N = 3SE +/- 0.17, N = 3SE +/- 0.17, N = 3SE +/- 0.40, N = 3SE +/- 0.09, N = 3SE +/- 0.27, N = 3SE +/- 0.71, N = 3SE +/- 0.18, N = 3SE +/- 0.66, N = 3SE +/- 0.36, N = 3SE +/- 0.58, N = 3SE +/- 0.10, N = 3SE +/- 0.30, N = 3SE +/- 0.34, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.27, N = 3SE +/- 0.22, N = 3SE +/- 0.24, N = 3SE +/- 0.37, N = 3SE +/- 0.37, N = 3SE +/- 0.66, N = 3SE +/- 0.36, N = 3SE +/- 0.18, N = 3SE +/- 0.16, N = 3SE +/- 0.23, N = 3SE +/- 0.09, N = 3SE +/- 0.60, N = 3SE +/- 0.54, N = 3SE +/- 0.13, N = 3SE +/- 0.32, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 1.53, N = 3SE +/- 0.84, N = 3SE +/- 0.17, N = 2SE +/- 0.63, N = 3SE +/- 0.18, N = 3SE +/- 0.29, N = 3SE +/- 0.35, N = 3SE +/- 5.27, N = 3SE +/- 0.02, N = 2SE +/- 1.15, N = 3SE +/- 0.38, N = 3SE +/- 0.40, N = 3SE +/- 0.16, N = 3SE +/- 0.64, N = 3SE +/- 0.10, N = 3SE +/- 2.12, N = 3SE +/- 0.42, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.21, N = 3SE +/- 0.28, N = 3SE +/- 0.31, N = 3SE +/- 0.51, N = 3SE +/- 0.85, N = 3SE +/- 0.22, N = 3SE +/- 0.37, N = 3SE +/- 0.18, N = 3SE +/- 0.07, N = 3SE +/- 0.71, N = 3SE +/- 0.33, N = 3SE +/- 0.36, N = 3SE +/- 0.08, N = 3SE +/- 0.27, N = 3SE +/- 0.04, N = 3SE +/- 0.29, N = 3SE +/- 0.39, N = 2SE +/- 1.15, N = 2SE +/- 0.20, N = 3SE +/- 0.09, N = 3SE +/- 0.28, N = 3SE +/- 0.72, N = 3SE +/- 1.08, N = 3SE +/- 0.46, N = 3SE +/- 0.21, N = 3SE +/- 0.26, N = 3SE +/- 0.16, N = 3SE +/- 0.15, N = 3SE +/- 0.53, N = 3SE +/- 0.13, N = 3SE +/- 0.17, N = 3SE +/- 2.04, N = 3SE +/- 0.09, N = 3SE +/- 0.43, N = 3SE +/- 0.21, N = 3SE +/- 0.37, N = 3SE +/- 0.02, N = 3SE +/- 0.34, N = 3SE +/- 0.38, N = 3SE +/- 1.31, N = 3SE +/- 0.08, N = 3SE +/- 0.72, N = 3SE +/- 0.30, N = 3SE +/- 0.39, N = 3SE +/- 0.66, N = 3SE +/- 0.16, N = 3SE +/- 0.07, N = 3SE +/- 0.41, N = 3SE +/- 0.41, N = 3SE +/- 0.37, N = 3SE +/- 0.11, N = 3SE +/- 0.22, N = 3SE +/- 0.63, N = 3SE +/- 0.11, N = 3SE +/- 0.89, N = 3SE +/- 0.36, N = 3SE +/- 0.37, N = 3SE +/- 0.06, N = 3SE +/- 0.34, N = 3SE +/- 0.30, N = 3SE +/- 0.09, N = 3SE +/- 0.28, N = 3SE +/- 0.09, N = 3SE +/- 0.40, N = 3SE +/- 0.32, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.65, N = 3SE +/- 0.10, N = 3SE +/- 0.25, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 0.24, N = 3SE +/- 0.03, N = 3SE +/- 0.28, N = 3SE +/- 0.53, N = 3SE +/- 0.21, N = 3SE +/- 0.27, N = 3SE +/- 0.06, N = 2SE +/- 3.02, N = 3SE +/- 0.48, N = 3SE +/- 0.24, N = 3SE +/- 0.51, N = 3SE +/- 0.47, N = 3SE +/- 0.21, N = 2SE +/- 0.53, N = 3SE +/- 11.04, N = 3SE +/- 0.08, N = 3SE +/- 0.64, N = 3SE +/- 1.20, N = 3SE +/- 0.40, N = 3SE +/- 0.31, N = 3SE +/- 2.63, N = 3SE +/- 0.08, N = 3SE +/- 1.43, N = 3SE +/- 0.16, N = 3SE +/- 0.80, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.47, N = 2SE +/- 0.23, N = 3SE +/- 0.36, N = 3SE +/- 1.14, N = 3SE +/- 0.51, N = 3SE +/- 0.37, N = 3SE +/- 0.27, N = 3SE +/- 0.43, N = 3SE +/- 2.38, N = 3SE +/- 0.44, N = 3SE +/- 0.17, N = 2SE +/- 0.19, N = 3SE +/- 0.11, N = 3SE +/- 0.14, N = 2SE +/- 0.13, N = 3SE +/- 0.13, N = 3SE +/- 0.38, N = 315.8517.5514.18154.3143.1749.0921.5217.2024.1320.16103.285.2719.7875.6617.77119.3520.8718.235.2115.8036.12178.1357.15112.6516.0222.1042.77118.4115.9835.8014.4022.3117.6825.6022.1422.7643.1915.1942.827.3713.5614.177.7413.1522.2933.3416.9740.2750.0859.4613.5915.3637.7713.9320.6724.4424.3824.1123.5912.9715.01170.8542.4220.07106.6121.6820.2823.76445.1116.2997.5259.6020.5024.66145.2921.24154.5315.8640.3113.6311.6819.5912.2344.4236.3017.659.9710.9212.3585.8219.0418.2310.9148.415.1616.267.7022.2715.4117.5814.12153.7843.7447.6720.7217.2724.4620.24101.845.2119.4577.1617.59119.3121.4117.895.2715.8336.66173.1556.78109.5116.2320.6941.62117.3416.0433.5215.2922.0017.9125.0722.3922.7443.4815.1941.437.2813.2513.777.8413.4621.8733.7316.6739.3449.3658.6313.2214.9436.9613.6021.1024.7824.2025.2422.5712.6114.73165.9642.6920.62106.3022.6020.1722.95419.7916.6595.4559.3720.5924.24145.2021.04154.3715.6038.4613.2611.7020.2212.3043.6036.1417.709.8210.7313.1885.1518.9618.1010.1847.085.2616.377.6523.191. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Comparison (Scale Factor: 100)

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 100)Q01Q02Q03Q04Q05Q06Q07Q08Q09Q10Q11Q12Q13Q14Q15Q17Q18Q19Q20Q21Q22Q23Q24Q25Q26Q27Q28Q29Q30Q31Q32Q33Q34Q35Q36Q37Q38Q39Q40Q41Q42Q43Q44Q45Q46Q47Q48Q49Q50Q51Q52Q53Q54Q55Q56Q57Q58Q59Q60Q61Q62Q63Q64Q65Q66Q67Q68Q69Q70Q71Q72Q73Q74Q75Q76Q77Q78Q79Q80Q81Q82Q83Q84Q85Q86Q87Q88Q89Q90Q91Q92Q93Q94Q95Q96Q97Q98Q9950100150200250SE +/- 0.05, N = 3SE +/- 0.29, N = 3SE +/- 0.20, N = 3SE +/- 1.16, N = 3SE +/- 0.44, N = 3SE +/- 0.17, N = 3SE +/- 0.64, N = 3SE +/- 0.28, N = 3SE +/- 0.49, N = 3SE +/- 0.08, N = 3SE +/- 0.56, N = 3SE +/- 0.08, N = 3SE +/- 0.50, N = 3SE +/- 2.66, N = 3SE +/- 0.30, N = 3SE +/- 0.40, N = 3SE +/- 0.54, N = 3SE +/- 0.67, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.29, N = 3SE +/- 0.08, N = 3SE +/- 0.74, N = 3SE +/- 0.33, N = 3SE +/- 0.57, N = 3SE +/- 0.26, N = 3SE +/- 2.08, N = 3SE +/- 0.23, N = 3SE +/- 0.28, N = 3SE +/- 0.70, N = 3SE +/- 0.17, N = 3SE +/- 0.45, N = 3SE +/- 0.07, N = 3SE +/- 0.17, N = 3SE +/- 0.49, N = 3SE +/- 0.24, N = 3SE +/- 0.66, N = 3SE +/- 1.30, N = 3SE +/- 0.17, N = 2SE +/- 0.04, N = 3SE +/- 0.15, N = 3SE +/- 0.17, N = 2SE +/- 0.66, N = 3SE +/- 0.16, N = 3SE +/- 0.26, N = 3SE +/- 0.31, N = 3SE +/- 0.17, N = 3SE +/- 0.18, N = 3SE +/- 0.82, N = 3SE +/- 1.20, N = 3SE +/- 0.18, N = 3SE +/- 0.21, N = 3SE +/- 0.19, N = 3SE +/- 0.36, N = 3SE +/- 0.32, N = 3SE +/- 0.74, N = 3SE +/- 0.53, N = 3SE +/- 0.85, N = 3SE +/- 0.71, N = 3SE +/- 0.16, N = 3SE +/- 0.22, N = 3SE +/- 0.33, N = 3SE +/- 2.48, N = 3SE +/- 1.31, N = 3SE +/- 0.44, N = 3SE +/- 1.23, N = 3SE +/- 0.84, N = 3SE +/- 0.33, N = 3SE +/- 0.83, N = 3SE +/- 0.15, N = 3SE +/- 1.63, N = 3SE +/- 0.46, N = 3SE +/- 1.38, N = 3SE +/- 0.98, N = 3SE +/- 0.17, N = 3SE +/- 0.30, N = 3SE +/- 2.62, N = 3SE +/- 0.27, N = 3SE +/- 1.28, N = 3SE +/- 0.23, N = 3SE +/- 0.16, N = 3SE +/- 0.25, N = 3SE +/- 0.03, N = 3SE +/- 0.30, N = 3SE +/- 0.31, N = 3SE +/- 0.15, N = 3SE +/- 1.29, N = 3SE +/- 0.16, N = 3SE +/- 0.43, N = 3SE +/- 0.17, N = 3SE +/- 0.13, N = 3SE +/- 1.70, N = 3SE +/- 0.28, N = 3SE +/- 0.06, N = 3SE +/- 0.19, N = 3SE +/- 0.24, N = 3SE +/- 0.05, N = 3SE +/- 0.64, N = 220.1327.5519.51192.4566.7423.7429.3222.2441.1927.59121.655.2228.19101.6226.1942.9227.8825.575.3220.5760.75223.1239.9941.9720.4428.4668.1747.4719.5151.4922.6529.1723.9536.6031.0420.9967.3822.7724.087.2917.7218.7125.2216.8630.0450.0523.0044.0081.06101.7218.8720.0633.8318.2227.5931.6735.6136.2130.697.5115.6619.93151.3873.3827.68205.5631.3126.7635.1531.44135.0221.92112.4996.4229.1433.67186.0130.33100.2418.7026.0615.7513.5725.2315.5767.9755.6823.2212.1112.2116.24140.1127.9726.6513.5378.075.3422.451. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Comparison (Scale Factor: 500)

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 500)Q02Q03Q06Q07Q08Q09Q10Q12Q13Q14Q15Q17Q18Q19Q20Q21Q22Q25Q26Q27Q28Q30Q31Q32Q33Q34Q35Q36Q37Q38Q39Q41Q42Q43Q44Q45Q46Q47Q48Q52Q53Q54Q55Q56Q57Q58Q59Q60Q61Q62Q63Q66Q68Q69Q70Q71Q73Q76Q79Q82Q84Q85Q86Q87Q88Q89Q90Q9220406080100SE +/- 0.07, N = 2SE +/- 0.21, N = 2SE +/- 0.05, N = 2SE +/- 1.17, N = 2SE +/- 0.13, N = 2SE +/- 0.61, N = 2SE +/- 1.72, N = 2SE +/- 0.09, N = 2SE +/- 0.38, N = 2SE +/- 1.32, N = 3SE +/- 0.11, N = 3SE +/- 0.71, N = 3SE +/- 0.23, N = 3SE +/- 0.52, N = 3SE +/- 0.02, N = 2SE +/- 0.28, N = 3SE +/- 0.40, N = 3SE +/- 0.28, N = 3SE +/- 0.61, N = 3SE +/- 0.46, N = 3SE +/- 0.64, N = 3SE +/- 0.06, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 0.28, N = 3SE +/- 0.57, N = 3SE +/- 0.33, N = 3SE +/- 0.18, N = 3SE +/- 0.37, N = 3SE +/- 0.09, N = 3SE +/- 0.25, N = 3SE +/- 0.32, N = 3SE +/- 0.23, N = 3SE +/- 0.37, N = 3SE +/- 0.29, N = 3SE +/- 0.43, N = 3SE +/- 0.27, N = 3SE +/- 0.29, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 2SE +/- 0.34, N = 3SE +/- 0.14, N = 3SE +/- 0.61, N = 3SE +/- 1.31, N = 3SE +/- 1.04, N = 3SE +/- 0.70, N = 3SE +/- 0.17, N = 3SE +/- 0.07, N = 3SE +/- 0.31, N = 3SE +/- 0.43, N = 3SE +/- 0.26, N = 3SE +/- 0.42, N = 3SE +/- 1.37, N = 3SE +/- 0.82, N = 3SE +/- 0.37, N = 3SE +/- 0.72, N = 3SE +/- 0.49, N = 3SE +/- 0.43, N = 3SE +/- 0.08, N = 3SE +/- 0.20, N = 3SE +/- 0.13, N = 3SE +/- 0.70, N = 3SE +/- 0.43, N = 3SE +/- 0.42, N = 3SE +/- 0.31, N = 3SE +/- 0.44, N = 327.9019.4823.6127.8322.6639.8027.695.2328.72100.3626.1143.5527.7325.805.2221.0261.5041.3020.5929.8667.0418.8949.0022.5929.0422.8136.5030.7321.4068.0824.997.3217.6119.2325.0316.9029.8749.4423.1319.1419.9633.9917.9528.0531.6334.2136.0631.177.7115.6119.8627.0830.4826.0835.8830.9121.3028.5930.2726.0213.5524.6015.4068.1953.7023.4612.1016.041. (CC) gcc options: -O3 -fcommon -lm


Phoronix Test Suite v10.8.5