rk1-mainline-emmc-run, rk1-mainline-nvme, rok1, pi5-compilation, pi4-raspbian-sd

rk1-mainline-emmc testing on Ubuntu 22.04 via the Phoronix Test Suite. rk1-mainline-nvme: rk1-mainline-nvme testing on Ubuntu 22.04 via the Phoronix Test Suite. rok1: Rockchip ARMv8 Cortex-A76 testing with a Turing Machines RK1 and rockchipdrmfb on Ubuntu 22.04 via the Phoronix Test Suite. pi5-compilation: ARMv8 Cortex-A76 testing on Debian 12 via the Phoronix Test Suite. pi4-raspbian-sd: ARMv8 Cortex-A72 testing on Debian 12 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2405141-NE-RK1EMMCCO86,2405147-NE-RK1MAINLI70,2405142-NE-ROK12186375,2402267-NE-PI5COMPIL39,2402287-NE-PI4RASPBI24&cts=1&ppt=D&rdt&grr.

rk1-mainline-emmc-run, rk1-mainline-nvme, rok1, pi5-compilation, pi4-raspbian-sdProcessorMotherboardMemoryDiskGraphicsNetworkChipsetOSKernelCompilerFile-SystemScreen ResolutionVulkanDisplay Serverrk1-rok-emmcrk1-mainline-emmcpi5-raspbian-nvmerk1-mainline-nvmepi4-raspbian-sdrk1-rok-nvmerk1-rok-emmc @ 1.80GHz (4 Cores / 8 Threads)Turing Machines RK132GB500GB CT500P3SSD8 + 31GB BJTD4RrockchipdrmfbUbuntu 22.045.10.160-rockchip (aarch64)GCC 11.4.0ext41920x1080rk1-mainline-emmc @ 1.80GHz (4 Cores / 8 Threads)1000GB CT1000P3PSSD8 + 31GB BJTD4R6.7.0 (aarch64)1.3.255ARMv8 Cortex-A76 @ 2.40GHz (4 Cores)Raspberry Pi 5 Model B Rev 1.04096MB500GB CT500P3SSD8Device 1de4:0001Debian 126.1.0-rpi7-rpi-2712 (aarch64)GCC 12.2.0rk1-mainline-nvme @ 1.80GHz (4 Cores / 8 Threads)Turing Machines RK132GB500GB CT500P3SSD8 + 31GB BJTD4RUbuntu 22.046.7.0 (aarch64)1.3.255GCC 11.4.0ARMv8 Cortex-A72 @ 1.80GHz (4 Cores)BCM2835 Raspberry Pi 400 Rev 1.0Broadcom BCM27114096MB64GB SR64GDebian 126.1.0-rpi6-rpi-v8 (aarch64)X ServerGCC 12.2.0Rockchip ARMv8 Cortex-A76 @ 1.80GHz (4 Cores / 8 Threads)Turing Machines RK132GB500GB CT500P3SSD8 + 31GB BJTD4RrockchipdrmfbUbuntu 22.045.10.160-rockchip (aarch64)GCC 11.4.01920x1080OpenBenchmarking.orgCompiler Details- rk1-rok-emmc: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - rk1-mainline-emmc: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - pi5-raspbian-nvme: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - rk1-mainline-nvme: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - pi4-raspbian-sd: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - rk1-rok-nvme: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v Processor Details- rk1-rok-emmc: Scaling Governor: cpufreq-dt performance- rk1-mainline-emmc: Scaling Governor: rockchip-cpufreq ondemand- pi5-raspbian-nvme: Scaling Governor: cpufreq-dt ondemand- rk1-mainline-nvme: Scaling Governor: rockchip-cpufreq performance- pi4-raspbian-sd: Scaling Governor: cpufreq-dt ondemand- rk1-rok-nvme: Scaling Governor: cpufreq-dt performancePython Details- rk1-rok-emmc: Python 3.10.12- rk1-mainline-emmc: Python 3.10.12- pi5-raspbian-nvme: Python 3.11.2- rk1-mainline-nvme: Python 3.10.12- pi4-raspbian-sd: Python 3.11.2- rk1-rok-nvme: Python 3.10.12Security Details- rk1-rok-emmc: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - rk1-mainline-emmc: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - pi5-raspbian-nvme: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected - rk1-mainline-nvme: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected - pi4-raspbian-sd: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable + srbds: Not affected + tsx_async_abort: Not affected - rk1-rok-nvme: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable: Unprivileged eBPF enabled + srbds: Not affected + tsx_async_abort: Not affected Kernel Details- rk1-mainline-emmc: Transparent Huge Pages: madvise- rk1-mainline-nvme: Transparent Huge Pages: madvise- pi4-raspbian-sd: snd_bcm2835.enable_headphones=0 snd_bcm2835.enable_hdmi=1 snd_bcm2835.enable_hdmi=0 cfg80211.ieee80211_regdom=US

rk1-mainline-emmc-run, rk1-mainline-nvme, rok1, pi5-compilation, pi4-raspbian-sdspark-tpcds: 3000rk1-rok-emmcrk1-mainline-emmcpi5-raspbian-nvmerk1-mainline-nvmepi4-raspbian-sdrk1-rok-nvmeOpenBenchmarking.org

Apache Spark TPC-DS

Scale Factor Comparison (Q99)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q99)10050101510152025SE +/- 0.64, N = 2SE +/- 0.13, N = 3SE +/- 0.16, N = 3SE +/- 0.02, N = 2SE +/- 0.29, N = 3SE +/- 0.36, N = 3SE +/- 0.22, N = 222.4516.3710.207.6216.2610.237.831. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Comparison (Scale Factor: 100)

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 100)Q99Q98Q97Q96Q95Q94Q93Q92Q91Q90Q89Q88Q87Q86Q85Q84Q83Q82Q81Q80Q79Q78Q77Q76Q75Q74Q73Q72Q71Q70Q69Q68Q67Q66Q65Q64Q63Q62Q61Q60Q59Q58Q57Q56Q55Q54Q53Q52Q51Q50Q49Q48Q47Q46Q45Q44Q43Q42Q41Q40Q39Q38Q37Q36Q35Q34Q33Q32Q31Q30Q29Q28Q27Q26Q25Q24Q23Q22Q21Q20Q19Q18Q17Q15Q14Q13Q12Q11Q10Q09Q08Q07Q06Q05Q04Q03Q02Q0150100150200250SE +/- 0.64, N = 2SE +/- 0.05, N = 3SE +/- 0.24, N = 3SE +/- 0.19, N = 3SE +/- 0.06, N = 3SE +/- 0.28, N = 3SE +/- 1.70, N = 3SE +/- 0.13, N = 3SE +/- 0.17, N = 3SE +/- 0.43, N = 3SE +/- 0.16, N = 3SE +/- 1.29, N = 3SE +/- 0.15, N = 3SE +/- 0.31, N = 3SE +/- 0.30, N = 3SE +/- 0.03, N = 3SE +/- 0.25, N = 3SE +/- 0.16, N = 3SE +/- 0.23, N = 3SE +/- 1.28, N = 3SE +/- 0.27, N = 3SE +/- 2.62, N = 3SE +/- 0.30, N = 3SE +/- 0.17, N = 3SE +/- 0.98, N = 3SE +/- 1.38, N = 3SE +/- 0.46, N = 3SE +/- 1.63, N = 3SE +/- 0.15, N = 3SE +/- 0.83, N = 3SE +/- 0.33, N = 3SE +/- 0.84, N = 3SE +/- 1.23, N = 3SE +/- 0.44, N = 3SE +/- 1.31, N = 3SE +/- 2.48, N = 3SE +/- 0.33, N = 3SE +/- 0.22, N = 3SE +/- 0.16, N = 3SE +/- 0.71, N = 3SE +/- 0.85, N = 3SE +/- 0.53, N = 3SE +/- 0.74, N = 3SE +/- 0.32, N = 3SE +/- 0.36, N = 3SE +/- 0.19, N = 3SE +/- 0.21, N = 3SE +/- 0.18, N = 3SE +/- 1.20, N = 3SE +/- 0.82, N = 3SE +/- 0.18, N = 3SE +/- 0.17, N = 3SE +/- 0.31, N = 3SE +/- 0.26, N = 3SE +/- 0.16, N = 3SE +/- 0.66, N = 3SE +/- 0.17, N = 2SE +/- 0.15, N = 3SE +/- 0.04, N = 3SE +/- 0.17, N = 2SE +/- 1.30, N = 3SE +/- 0.66, N = 3SE +/- 0.24, N = 3SE +/- 0.49, N = 3SE +/- 0.17, N = 3SE +/- 0.07, N = 3SE +/- 0.45, N = 3SE +/- 0.17, N = 3SE +/- 0.70, N = 3SE +/- 0.28, N = 3SE +/- 0.23, N = 3SE +/- 2.08, N = 3SE +/- 0.26, N = 3SE +/- 0.57, N = 3SE +/- 0.33, N = 3SE +/- 0.74, N = 3SE +/- 0.08, N = 3SE +/- 0.29, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.67, N = 3SE +/- 0.54, N = 3SE +/- 0.40, N = 3SE +/- 0.30, N = 3SE +/- 2.66, N = 3SE +/- 0.50, N = 3SE +/- 0.08, N = 3SE +/- 0.56, N = 3SE +/- 0.08, N = 3SE +/- 0.49, N = 3SE +/- 0.28, N = 3SE +/- 0.64, N = 3SE +/- 0.17, N = 3SE +/- 0.44, N = 3SE +/- 1.16, N = 3SE +/- 0.20, N = 3SE +/- 0.29, N = 3SE +/- 0.05, N = 322.455.3478.0713.5326.6527.97140.1116.2412.2112.1123.2255.6867.9715.5725.2313.5715.7526.0618.70100.2430.33186.0133.6729.1496.42112.4921.92135.0231.4435.1526.7631.31205.5627.6873.38151.3819.9315.667.5130.6936.2135.6131.6727.5918.2233.8320.0618.87101.7281.0644.0023.0050.0530.0416.8625.2218.7117.727.2924.0822.7767.3820.9931.0436.6023.9529.1722.6551.4919.5147.4768.1728.4620.4441.9739.99223.1260.7520.575.3225.5727.8842.9226.19101.6228.195.22121.6527.5941.1922.2429.3223.7466.74192.4519.5127.5520.131. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q98)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q98)100501011.20152.4033.60454.8066.0075SE +/- 0.05, N = 3SE +/- 0.14, N = 2SE +/- 0.08, N = 2SE +/- 0.02, N = 4SE +/- 0.04, N = 3SE +/- 0.02, N = 4SE +/- 0.02, N = 25.345.265.044.855.165.004.871. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q97)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q97)1005010120406080100SE +/- 0.24, N = 3SE +/- 0.11, N = 3SE +/- 0.33, N = 3SE +/- 0.06, N = 4SE +/- 0.27, N = 3SE +/- 0.17, N = 4SE +/- 0.07, N = 378.0747.0817.239.8348.4116.999.711. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q96)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q96)100501013691215SE +/- 0.19, N = 3SE +/- 0.19, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 4SE +/- 0.08, N = 3SE +/- 0.25, N = 3SE +/- 0.03, N = 313.5310.186.645.7310.917.165.751. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q95)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q95)10050101612182430SE +/- 0.06, N = 3SE +/- 0.17, N = 2SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.36, N = 3SE +/- 0.09, N = 4SE +/- 0.08, N = 326.6518.1010.167.2618.2310.217.461. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q94)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q94)10050101714212835SE +/- 0.28, N = 3SE +/- 0.44, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 4SE +/- 0.33, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 327.9718.9610.126.0919.049.936.111. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q93)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q93)10050101306090120150SE +/- 1.70, N = 3SE +/- 2.38, N = 3SE +/- 0.41, N = 3SE +/- 0.04, N = 3SE +/- 0.71, N = 3SE +/- 0.26, N = 4SE +/- 0.02, N = 2140.1185.1527.077.7585.8227.157.711. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q92)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q92)1005010500148121620SE +/- 0.13, N = 3SE +/- 0.43, N = 3SE +/- 0.16, N = 3SE +/- 0.44, N = 3SE +/- 0.08, N = 4SE +/- 0.07, N = 3SE +/- 0.05, N = 4SE +/- 0.06, N = 316.2413.189.0116.047.7912.359.077.581. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q91)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q91)100501013691215SE +/- 0.17, N = 3SE +/- 0.27, N = 3SE +/- 0.25, N = 2SE +/- 0.06, N = 4SE +/- 0.18, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 212.2110.7310.008.1910.929.788.321. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q90)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q90)100501050013691215SE +/- 0.43, N = 3SE +/- 0.37, N = 3SE +/- 0.13, N = 3SE +/- 0.31, N = 3SE +/- 0.06, N = 4SE +/- 0.37, N = 3SE +/- 0.03, N = 4SE +/- 0.07, N = 312.119.827.5212.106.639.977.466.761. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q89)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q89)10050105001612182430SE +/- 0.16, N = 3SE +/- 0.51, N = 3SE +/- 0.06, N = 3SE +/- 0.42, N = 3SE +/- 0.10, N = 4SE +/- 0.22, N = 3SE +/- 0.10, N = 4SE +/- 0.01, N = 223.2217.7010.7823.468.8117.6511.018.701. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q88)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q88)100501050011326395265SE +/- 1.29, N = 3SE +/- 1.14, N = 3SE +/- 0.21, N = 3SE +/- 0.43, N = 3SE +/- 0.12, N = 3SE +/- 0.85, N = 3SE +/- 0.39, N = 4SE +/- 0.14, N = 255.6836.1417.4853.7011.3936.3017.1811.831. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q87)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q87)100501050011530456075SE +/- 0.15, N = 3SE +/- 0.36, N = 3SE +/- 0.23, N = 3SE +/- 0.70, N = 3SE +/- 0.05, N = 4SE +/- 0.51, N = 3SE +/- 0.72, N = 3SE +/- 0.01, N = 367.9743.6018.0468.1910.0744.4217.6610.091. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q86)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q86)1005010500148121620SE +/- 0.31, N = 3SE +/- 0.23, N = 3SE +/- 0.23, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 4SE +/- 0.31, N = 3SE +/- 0.04, N = 4SE +/- 0.03, N = 315.5712.309.2815.408.0412.239.178.131. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q85)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q85)10050105001612182430SE +/- 0.30, N = 3SE +/- 0.47, N = 2SE +/- 0.29, N = 3SE +/- 0.20, N = 3SE +/- 0.19, N = 3SE +/- 0.28, N = 3SE +/- 0.03, N = 4SE +/- 0.03, N = 325.2320.2214.5624.6011.8619.5914.8512.001. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q84)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q84)100501050013691215SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.14, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 4SE +/- 0.21, N = 3SE +/- 0.07, N = 4SE +/- 0.05, N = 313.5711.709.1513.557.3011.689.137.131. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q83)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q83)1005010148121620SE +/- 0.25, N = 3SE +/- 0.04, N = 3SE +/- 0.23, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.11, N = 4SE +/- 0.06, N = 315.7513.2610.799.2413.6310.749.211. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q82)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q82)10050105001918273645SE +/- 0.16, N = 3SE +/- 0.80, N = 3SE +/- 0.19, N = 3SE +/- 0.43, N = 3SE +/- 0.07, N = 4SE +/- 0.08, N = 3SE +/- 0.22, N = 4SE +/- 0.10, N = 226.0638.4616.6426.028.8640.3116.998.881. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q81)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q81)10050101510152025SE +/- 0.23, N = 3SE +/- 0.16, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.42, N = 3SE +/- 0.17, N = 3SE +/- 0.04, N = 318.7015.6011.468.8715.8611.548.761. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q80)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q80)10050101306090120150SE +/- 1.28, N = 3SE +/- 1.43, N = 3SE +/- 0.75, N = 3SE +/- 0.10, N = 4SE +/- 2.12, N = 3SE +/- 0.46, N = 4SE +/- 0.04, N = 3100.24154.3747.1813.52154.5348.0813.451. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q79)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q79)10050105001714212835SE +/- 0.27, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.49, N = 3SE +/- 0.06, N = 4SE +/- 0.10, N = 3SE +/- 0.14, N = 4SE +/- 0.19, N = 330.3321.0411.9930.278.4421.2411.918.511. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q78)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q78)100501014080120160200SE +/- 2.62, N = 3SE +/- 2.63, N = 3SE +/- 0.13, N = 3SE +/- 0.07, N = 4SE +/- 0.64, N = 3SE +/- 0.31, N = 4SE +/- 0.08, N = 3186.01145.2043.4014.33145.2944.1414.031. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q77)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q77)10050101816243240SE +/- 0.30, N = 3SE +/- 0.31, N = 3SE +/- 0.15, N = 3SE +/- 0.05, N = 4SE +/- 0.16, N = 3SE +/- 0.24, N = 4SE +/- 0.08, N = 333.6724.2414.5711.3924.6615.2511.241. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q76)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q76)10050105001714212835SE +/- 0.17, N = 3SE +/- 0.40, N = 3SE +/- 0.13, N = 2SE +/- 0.72, N = 3SE +/- 0.10, N = 4SE +/- 0.40, N = 3SE +/- 0.21, N = 3SE +/- 0.03, N = 229.1420.5912.3028.598.7820.5012.528.821. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q75)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q75)1005010120406080100SE +/- 0.98, N = 3SE +/- 1.20, N = 3SE +/- 0.38, N = 3SE +/- 0.13, N = 4SE +/- 0.38, N = 3SE +/- 0.35, N = 4SE +/- 0.15, N = 396.4259.3727.0414.2659.6027.4914.431. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q74)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q74)10050101306090120150SE +/- 1.38, N = 3SE +/- 0.64, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 4SE +/- 1.15, N = 3SE +/- 0.13, N = 4SE +/- 0.08, N = 3112.4995.4519.7411.9597.5219.8011.721. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q73)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q73)10050105001510152025SE +/- 0.46, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.37, N = 3SE +/- 0.05, N = 4SE +/- 0.02, N = 2SE +/- 0.10, N = 4SE +/- 0.07, N = 321.9216.6511.1521.308.3116.2911.198.301. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q72)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q72)10050101100200300400500SE +/- 1.63, N = 3SE +/- 11.04, N = 3SE +/- 0.40, N = 3SE +/- 0.25, N = 4SE +/- 5.27, N = 3SE +/- 1.21, N = 4SE +/- 0.12, N = 3135.02419.79118.0819.11445.11118.2819.611. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q71)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q71)10050105001714212835SE +/- 0.15, N = 3SE +/- 0.38, N = 3SE +/- 0.02, N = 3SE +/- 0.82, N = 3SE +/- 0.10, N = 4SE +/- 1.15, N = 2SE +/- 0.21, N = 4SE +/- 0.08, N = 331.4423.1912.7130.919.0422.2713.128.991. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q70)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q70)10050105001816243240SE +/- 0.83, N = 3SE +/- 0.53, N = 3SE +/- 0.32, N = 3SE +/- 1.37, N = 3SE +/- 0.15, N = 3SE +/- 0.35, N = 3SE +/- 0.14, N = 4SE +/- 0.01, N = 335.1522.9513.7135.8810.3523.7613.4410.291. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q69)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q69)10050105001612182430SE +/- 0.33, N = 3SE +/- 0.21, N = 2SE +/- 0.02, N = 3SE +/- 0.42, N = 3SE +/- 0.18, N = 4SE +/- 0.29, N = 3SE +/- 0.17, N = 4SE +/- 0.28, N = 326.7620.1713.9726.0810.9520.2813.8211.071. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q68)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q68)10050105001714212835SE +/- 0.84, N = 3SE +/- 0.47, N = 3SE +/- 0.27, N = 3SE +/- 0.26, N = 3SE +/- 0.07, N = 4SE +/- 0.18, N = 3SE +/- 0.14, N = 4SE +/- 0.09, N = 331.3122.6012.8130.488.5321.6812.518.461. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q67)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q67)1005010150100150200250SE +/- 1.23, N = 3SE +/- 0.51, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 4SE +/- 0.63, N = 3SE +/- 0.13, N = 4SE +/- 0.11, N = 3205.56106.3032.6112.08106.6133.1912.311. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q66)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q66)10050105001714212835SE +/- 0.44, N = 3SE +/- 0.24, N = 3SE +/- 0.16, N = 3SE +/- 0.43, N = 3SE +/- 0.13, N = 3SE +/- 0.17, N = 2SE +/- 0.18, N = 4SE +/- 0.08, N = 327.6820.6213.7527.0811.2720.0714.0311.271. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q65)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q65)100501011632486480SE +/- 1.31, N = 3SE +/- 0.48, N = 3SE +/- 0.21, N = 3SE +/- 0.06, N = 4SE +/- 0.84, N = 3SE +/- 0.84, N = 4SE +/- 0.02, N = 373.3842.6918.1210.2742.4218.6410.101. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q64)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q64)100501014080120160200SE +/- 2.48, N = 3SE +/- 3.02, N = 3SE +/- 0.51, N = 3SE +/- 0.19, N = 4SE +/- 1.53, N = 3SE +/- 0.32, N = 4SE +/- 0.18, N = 3151.38165.9650.3317.19170.8551.4817.151. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q63)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q63)10050105001510152025SE +/- 0.33, N = 3SE +/- 0.06, N = 2SE +/- 0.24, N = 3SE +/- 0.31, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 4SE +/- 0.05, N = 319.9314.739.8319.867.8815.019.557.791. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q62)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q62)1005010500148121620SE +/- 0.22, N = 3SE +/- 0.27, N = 3SE +/- 0.13, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 415.6612.618.9815.617.8312.979.197.631. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q61)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q61)10050105001246810SE +/- 0.16, N = 3SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.17, N = 3SE +/- 0.01, N = 3SE +/- 0.39, N = 2SE +/- 0.05, N = 4SE +/- 0.04, N = 37.517.657.037.716.497.707.106.541. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q60)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q60)10050105001714212835SE +/- 0.71, N = 3SE +/- 0.21, N = 3SE +/- 0.51, N = 3SE +/- 0.70, N = 3SE +/- 0.10, N = 3SE +/- 0.32, N = 3SE +/- 0.34, N = 4SE +/- 0.04, N = 330.6922.5714.3231.1710.1923.5914.2110.251. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q59)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q59)10050105001816243240SE +/- 0.85, N = 3SE +/- 0.53, N = 3SE +/- 0.23, N = 2SE +/- 1.04, N = 3SE +/- 0.04, N = 4SE +/- 0.13, N = 3SE +/- 0.10, N = 4SE +/- 0.15, N = 236.2125.2412.5136.069.1124.1113.109.091. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q58)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q58)10050105001816243240SE +/- 0.53, N = 3SE +/- 0.28, N = 3SE +/- 0.34, N = 3SE +/- 1.31, N = 3SE +/- 0.05, N = 2SE +/- 0.54, N = 3SE +/- 0.09, N = 4SE +/- 0.04, N = 235.6124.2014.7434.219.9224.3813.8410.171. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q57)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q57)10050105001714212835SE +/- 0.74, N = 3SE +/- 0.03, N = 3SE +/- 0.16, N = 3SE +/- 0.61, N = 3SE +/- 0.07, N = 4SE +/- 0.60, N = 3SE +/- 0.07, N = 4SE +/- 0.10, N = 331.6724.7816.3831.6310.7624.4416.4810.641. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q56)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q56)10050105001714212835SE +/- 0.32, N = 3SE +/- 0.24, N = 3SE +/- 0.14, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 4SE +/- 0.09, N = 3SE +/- 0.11, N = 4SE +/- 0.05, N = 327.5921.1012.8028.059.8720.6713.029.881. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q55)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q55)1005010500148121620SE +/- 0.36, N = 3SE +/- 0.12, N = 3SE +/- 0.19, N = 3SE +/- 0.34, N = 3SE +/- 0.06, N = 4SE +/- 0.23, N = 3SE +/- 0.14, N = 4SE +/- 0.03, N = 318.2213.608.7017.956.5713.938.636.801. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q54)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q54)10050105001918273645SE +/- 0.19, N = 3SE +/- 0.12, N = 3SE +/- 0.42, N = 3SE +/- 0.13, N = 2SE +/- 0.10, N = 4SE +/- 0.16, N = 3SE +/- 0.07, N = 4SE +/- 0.13, N = 333.8336.9617.0733.9910.8937.7716.9711.161. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q53)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q53)10050105001510152025SE +/- 0.21, N = 3SE +/- 0.25, N = 3SE +/- 0.11, N = 3SE +/- 0.11, N = 3SE +/- 0.07, N = 4SE +/- 0.18, N = 3SE +/- 0.08, N = 4SE +/- 0.13, N = 320.0614.949.4619.967.9015.369.757.881. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q52)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q52)10050105001510152025SE +/- 0.18, N = 3SE +/- 0.10, N = 3SE +/- 0.15, N = 3SE +/- 0.29, N = 3SE +/- 0.02, N = 4SE +/- 0.36, N = 3SE +/- 0.10, N = 4SE +/- 0.08, N = 318.8713.228.6519.146.7313.598.766.781. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q51)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q51)1005010120406080100SE +/- 1.20, N = 3SE +/- 0.65, N = 3SE +/- 0.17, N = 2SE +/- 0.19, N = 4SE +/- 0.66, N = 3SE +/- 0.18, N = 4SE +/- 0.07, N = 3101.7258.6326.2813.2259.4626.3213.301. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q50)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q50)1005010120406080100SE +/- 0.82, N = 3SE +/- 0.11, N = 3SE +/- 0.22, N = 3SE +/- 0.14, N = 4SE +/- 0.37, N = 3SE +/- 0.25, N = 4SE +/- 0.02, N = 381.0649.3621.908.7550.0822.008.561. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q49)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q49)100501011020304050SE +/- 0.18, N = 3SE +/- 0.10, N = 3SE +/- 0.20, N = 3SE +/- 0.08, N = 4SE +/- 0.37, N = 3SE +/- 0.11, N = 4SE +/- 0.08, N = 244.0039.3419.5110.7740.2718.9311.141. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q48)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q48)10050105001612182430SE +/- 0.17, N = 3SE +/- 0.32, N = 3SE +/- 0.09, N = 3SE +/- 0.27, N = 3SE +/- 0.07, N = 4SE +/- 0.24, N = 3SE +/- 0.10, N = 4SE +/- 0.05, N = 323.0016.6710.0023.137.6516.9710.497.891. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q47)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q47)100501050011122334455SE +/- 0.31, N = 3SE +/- 0.40, N = 3SE +/- 0.08, N = 3SE +/- 0.43, N = 3SE +/- 0.16, N = 4SE +/- 0.22, N = 3SE +/- 0.16, N = 4SE +/- 0.05, N = 350.0533.7319.0849.4412.4333.3419.1012.591. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q46)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q46)10050105001714212835SE +/- 0.26, N = 3SE +/- 0.09, N = 3SE +/- 0.34, N = 3SE +/- 0.29, N = 3SE +/- 0.06, N = 3SE +/- 0.27, N = 3SE +/- 0.16, N = 4SE +/- 0.11, N = 330.0421.8712.4729.878.6922.2912.668.671. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q45)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q45)1005010500148121620SE +/- 0.16, N = 3SE +/- 0.28, N = 3SE +/- 0.05, N = 3SE +/- 0.37, N = 3SE +/- 0.03, N = 4SE +/- 0.13, N = 3SE +/- 0.13, N = 4SE +/- 0.01, N = 316.8613.469.8416.907.6013.159.767.531. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q44)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q44)10050105001612182430SE +/- 0.66, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.23, N = 3SE +/- 0.03, N = 4SE +/- 0.06, N = 3SE +/- 0.04, N = 4SE +/- 0.13, N = 325.227.846.4025.038.617.746.548.641. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q43)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q43)10050105001510152025SE +/- 0.17, N = 2SE +/- 0.30, N = 3SE +/- 0.08, N = 3SE +/- 0.32, N = 3SE +/- 0.09, N = 4SE +/- 0.34, N = 3SE +/- 0.09, N = 4SE +/- 0.06, N = 318.7113.778.4219.237.1514.178.557.241. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q42)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q42)1005010500148121620SE +/- 0.15, N = 3SE +/- 0.34, N = 3SE +/- 0.06, N = 3SE +/- 0.25, N = 3SE +/- 0.03, N = 4SE +/- 0.30, N = 3SE +/- 0.06, N = 4SE +/- 0.06, N = 317.7213.258.4417.616.7213.568.696.701. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q41)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q41)10050105001246810SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 4SE +/- 0.10, N = 3SE +/- 0.07, N = 4SE +/- 0.01, N = 37.297.287.097.326.227.377.176.231. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q40)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q40)100501011020304050SE +/- 0.17, N = 2SE +/- 0.37, N = 3SE +/- 0.26, N = 3SE +/- 0.04, N = 3SE +/- 0.58, N = 3SE +/- 0.11, N = 4SE +/- 0.13, N = 324.0841.4317.388.0042.8217.688.071. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q39)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q39)10050105001612182430SE +/- 1.30, N = 3SE +/- 0.36, N = 3SE +/- 0.20, N = 3SE +/- 0.37, N = 3SE +/- 0.12, N = 4SE +/- 0.36, N = 3SE +/- 0.31, N = 4SE +/- 0.07, N = 322.7715.1910.7524.993.7215.1910.423.761. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q38)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q38)100501050011530456075SE +/- 0.66, N = 3SE +/- 0.89, N = 3SE +/- 0.11, N = 3SE +/- 0.18, N = 3SE +/- 0.05, N = 4SE +/- 0.66, N = 3SE +/- 0.28, N = 4SE +/- 0.07, N = 367.3843.4817.4168.0810.0843.1917.6910.181. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q37)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q37)10050105001510152025SE +/- 0.24, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 3SE +/- 0.33, N = 3SE +/- 0.09, N = 3SE +/- 0.18, N = 3SE +/- 0.27, N = 4SE +/- 0.05, N = 320.9922.7413.3621.405.0922.7613.825.221. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q36)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q36)10050105001714212835SE +/- 0.49, N = 3SE +/- 0.63, N = 3SE +/- 0.63, N = 3SE +/- 0.57, N = 3SE +/- 0.12, N = 3SE +/- 0.71, N = 3SE +/- 0.13, N = 4SE +/- 0.06, N = 231.0422.3912.4830.738.8322.1411.929.251. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q35)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q35)10050105001816243240SE +/- 0.17, N = 3SE +/- 0.22, N = 3SE +/- 0.93, N = 3SE +/- 0.28, N = 3SE +/- 0.08, N = 4SE +/- 0.27, N = 3SE +/- 0.12, N = 4SE +/- 0.17, N = 336.6025.0716.5736.5011.4825.6015.9111.221. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q34)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q34)10050105001612182430SE +/- 0.07, N = 3SE +/- 0.11, N = 3SE +/- 0.46, N = 3SE +/- 0.12, N = 3SE +/- 0.13, N = 2SE +/- 0.09, N = 3SE +/- 0.22, N = 3SE +/- 0.02, N = 323.9517.9112.0422.818.6117.6811.918.411. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q33)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q33)10050105001714212835SE +/- 0.45, N = 3SE +/- 0.37, N = 3SE +/- 0.26, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 4SE +/- 0.40, N = 3SE +/- 0.16, N = 4SE +/- 0.09, N = 329.1722.0013.6029.0410.0422.3114.1010.201. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q32)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q32)10050105001510152025SE +/- 0.17, N = 3SE +/- 0.41, N = 3SE +/- 0.14, N = 3SE +/- 0.33, N = 3SE +/- 0.04, N = 4SE +/- 0.17, N = 3SE +/- 0.25, N = 4SE +/- 0.07, N = 322.6515.299.3822.597.7014.409.747.681. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q31)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q31)100501050011224364860SE +/- 0.70, N = 3SE +/- 0.41, N = 3SE +/- 0.63, N = 3SE +/- 0.67, N = 3SE +/- 0.14, N = 4SE +/- 0.17, N = 3SE +/- 0.26, N = 3SE +/- 0.05, N = 351.4933.5219.3349.0012.2935.8018.6412.081. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q30)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q30)10050105001510152025SE +/- 0.28, N = 3SE +/- 0.07, N = 3SE +/- 0.16, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.32, N = 3SE +/- 0.06, N = 4SE +/- 0.05, N = 319.5116.0411.9018.899.2615.9811.919.001. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q29)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q29)10050101306090120150SE +/- 0.23, N = 3SE +/- 0.16, N = 3SE +/- 0.40, N = 3SE +/- 0.04, N = 4SE +/- 1.14, N = 3SE +/- 0.41, N = 4SE +/- 0.09, N = 347.47117.3434.6911.19118.4135.8711.631. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q28)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q28)100501050011530456075SE +/- 2.08, N = 3SE +/- 0.66, N = 3SE +/- 0.51, N = 3SE +/- 0.64, N = 3SE +/- 0.12, N = 3SE +/- 0.48, N = 3SE +/- 0.21, N = 4SE +/- 0.21, N = 368.1741.6217.5467.0411.0242.7717.4611.141. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q27)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q27)10050105001714212835SE +/- 0.26, N = 3SE +/- 0.39, N = 3SE +/- 0.27, N = 2SE +/- 0.46, N = 3SE +/- 0.05, N = 4SE +/- 0.47, N = 3SE +/- 0.20, N = 4SE +/- 0.14, N = 328.4620.6913.4329.868.9922.1012.929.121. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q26)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q26)10050105001510152025SE +/- 0.57, N = 3SE +/- 0.30, N = 3SE +/- 0.29, N = 3SE +/- 0.61, N = 3SE +/- 0.14, N = 4SE +/- 0.12, N = 3SE +/- 0.27, N = 4SE +/- 0.06, N = 320.4416.2310.4820.597.8816.0210.327.891. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q25)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q25)10050105001306090120150SE +/- 0.33, N = 3SE +/- 0.72, N = 3SE +/- 0.79, N = 3SE +/- 0.28, N = 3SE +/- 0.11, N = 4SE +/- 1.06, N = 3SE +/- 0.27, N = 4SE +/- 0.12, N = 341.97109.5135.4741.3011.27112.6535.3611.211. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q24)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q24)100501011326395265SE +/- 0.74, N = 3SE +/- 0.08, N = 3SE +/- 0.64, N = 3SE +/- 0.05, N = 4SE +/- 0.49, N = 3SE +/- 0.11, N = 4SE +/- 0.02, N = 339.9956.7816.792.6857.1517.462.721. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q23)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q23)1005010150100150200250SE +/- 0.08, N = 3SE +/- 1.31, N = 3SE +/- 0.46, N = 3SE +/- 0.23, N = 4SE +/- 1.35, N = 3SE +/- 0.43, N = 4SE +/- 0.02, N = 3223.12173.1533.708.07178.1333.008.081. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q22)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q22)100501050011428425670SE +/- 0.29, N = 3SE +/- 0.38, N = 3SE +/- 0.14, N = 3SE +/- 0.40, N = 3SE +/- 0.18, N = 4SE +/- 0.54, N = 3SE +/- 0.40, N = 4SE +/- 0.05, N = 360.7536.6626.9461.5010.4236.1226.5710.751. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q21)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q21)10050105001510152025SE +/- 0.09, N = 3SE +/- 0.34, N = 3SE +/- 0.17, N = 3SE +/- 0.28, N = 3SE +/- 0.08, N = 4SE +/- 0.26, N = 3SE +/- 0.17, N = 4SE +/- 0.03, N = 320.5715.8312.1021.027.9115.8012.547.991. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q20)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q20)100501050011.1972.3943.5914.7885.985SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 2SE +/- 0.02, N = 4SE +/- 0.08, N = 3SE +/- 0.03, N = 4SE +/- 0.04, N = 35.325.275.055.224.945.215.094.971. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q19)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q19)10050105001612182430SE +/- 0.67, N = 3SE +/- 0.37, N = 3SE +/- 0.22, N = 3SE +/- 0.52, N = 3SE +/- 0.05, N = 4SE +/- 0.18, N = 3SE +/- 0.21, N = 4SE +/- 0.09, N = 325.5717.8911.1525.808.0218.2311.818.171. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q18)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q18)10050105001714212835SE +/- 0.54, N = 3SE +/- 0.21, N = 3SE +/- 0.21, N = 3SE +/- 0.23, N = 3SE +/- 0.08, N = 4SE +/- 0.20, N = 3SE +/- 0.12, N = 4SE +/- 0.19, N = 327.8821.4113.8127.7310.5820.8713.7810.591. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q17)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q17)10050105001306090120150SE +/- 0.40, N = 3SE +/- 0.43, N = 3SE +/- 0.15, N = 3SE +/- 0.71, N = 3SE +/- 0.12, N = 4SE +/- 1.40, N = 3SE +/- 0.36, N = 4SE +/- 0.10, N = 342.92119.3134.6843.5511.99119.3535.1111.721. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q15)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q15)10050105001612182430SE +/- 0.30, N = 3SE +/- 0.09, N = 3SE +/- 0.19, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 4SE +/- 0.24, N = 3SE +/- 0.21, N = 4SE +/- 0.09, N = 326.1917.5910.3326.117.4917.7710.397.571. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q14)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q14)1005010500120406080100SE +/- 2.66, N = 3SE +/- 2.04, N = 3SE +/- 0.58, N = 3SE +/- 1.32, N = 3SE +/- 0.11, N = 4SE +/- 0.35, N = 3SE +/- 0.35, N = 4SE +/- 0.33, N = 3101.6277.1622.19100.369.0375.6622.769.011. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q13)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q13)10050105001714212835SE +/- 0.50, N = 3SE +/- 0.17, N = 3SE +/- 0.10, N = 3SE +/- 0.38, N = 2SE +/- 0.11, N = 4SE +/- 0.11, N = 3SE +/- 0.16, N = 4SE +/- 0.16, N = 328.1919.4511.4328.728.4019.7811.808.261. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q12)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q12)100501050011.18582.37163.55744.74325.929SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 2SE +/- 0.02, N = 4SE +/- 0.08, N = 3SE +/- 0.04, N = 4SE +/- 0.02, N = 35.225.215.145.234.905.275.144.951. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q11)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q11)10050101306090120150SE +/- 0.56, N = 3SE +/- 0.53, N = 3SE +/- 0.37, N = 3SE +/- 0.05, N = 4SE +/- 0.28, N = 3SE +/- 0.27, N = 4SE +/- 0.10, N = 3121.65101.8435.9012.70103.2835.7712.751. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q10)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q10)10050105001714212835SE +/- 0.08, N = 3SE +/- 0.15, N = 3SE +/- 0.09, N = 3SE +/- 1.72, N = 2SE +/- 0.16, N = 4SE +/- 0.37, N = 3SE +/- 0.12, N = 4SE +/- 0.17, N = 327.5920.2414.3327.6911.5320.1614.1411.451. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q09)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q09)10050105001918273645SE +/- 0.49, N = 3SE +/- 0.16, N = 3SE +/- 0.28, N = 3SE +/- 0.61, N = 2SE +/- 0.05, N = 4SE +/- 0.25, N = 3SE +/- 0.10, N = 4SE +/- 0.11, N = 341.1924.4611.8339.807.9024.1312.058.191. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q08)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q08)10050105001510152025SE +/- 0.28, N = 3SE +/- 0.26, N = 3SE +/- 0.14, N = 3SE +/- 0.13, N = 2SE +/- 0.01, N = 4SE +/- 0.44, N = 3SE +/- 0.13, N = 4SE +/- 0.12, N = 322.2417.2711.8422.668.8017.2011.838.751. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q07)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q07)10050105001714212835SE +/- 0.64, N = 3SE +/- 0.21, N = 3SE +/- 0.10, N = 3SE +/- 1.17, N = 2SE +/- 0.04, N = 4SE +/- 0.48, N = 3SE +/- 0.32, N = 4SE +/- 0.10, N = 329.3220.7212.7627.838.4621.5212.588.481. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q06)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q06)100501050011122334455SE +/- 0.17, N = 3SE +/- 0.46, N = 3SE +/- 0.30, N = 3SE +/- 0.05, N = 2SE +/- 0.05, N = 4SE +/- 0.91, N = 3SE +/- 0.14, N = 4SE +/- 0.03, N = 323.7447.6719.4023.619.3349.0918.819.111. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q05)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q05)100501011530456075SE +/- 0.44, N = 3SE +/- 1.08, N = 3SE +/- 0.60, N = 3SE +/- 0.11, N = 4SE +/- 0.56, N = 3SE +/- 0.37, N = 4SE +/- 0.19, N = 366.7443.7423.3811.7943.1723.8512.111. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q04)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q04)100501014080120160200SE +/- 1.16, N = 3SE +/- 0.72, N = 3SE +/- 0.31, N = 3SE +/- 0.10, N = 4SE +/- 0.56, N = 3SE +/- 0.36, N = 4SE +/- 0.22, N = 3192.45153.7848.8815.04154.3150.1415.161. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q03)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q03)10050105001510152025SE +/- 0.20, N = 3SE +/- 0.28, N = 3SE +/- 0.17, N = 3SE +/- 0.21, N = 2SE +/- 0.07, N = 4SE +/- 0.08, N = 3SE +/- 0.03, N = 4SE +/- 0.03, N = 319.5114.129.0219.486.7914.188.486.751. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q02)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q02)10050105001714212835SE +/- 0.29, N = 3SE +/- 0.09, N = 3SE +/- 0.36, N = 3SE +/- 0.07, N = 2SE +/- 0.06, N = 4SE +/- 0.12, N = 3SE +/- 0.25, N = 4SE +/- 0.14, N = 327.5517.5811.6327.909.6917.5511.329.771. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q01)

rk1-rok-nvmerk1-mainline-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q01)10050101510152025SE +/- 0.05, N = 3SE +/- 0.20, N = 3SE +/- 0.02, N = 3SE +/- 0.10, N = 4SE +/- 0.04, N = 3SE +/- 0.14, N = 4SE +/- 0.10, N = 320.1315.4111.238.9815.8511.298.931. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Comparison (Scale Factor: 50)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 50)Q71Q61Q99Q98Q97Q96Q95Q94Q93Q92Q91Q90Q89Q88Q87Q86Q85Q84Q83Q82Q81Q80Q79Q78Q77Q76Q75Q74Q73Q72Q70Q69Q68Q67Q66Q65Q64Q63Q62Q60Q59Q58Q57Q56Q55Q54Q53Q52Q51Q50Q49Q48Q47Q46Q45Q44Q43Q42Q41Q40Q39Q38Q37Q36Q35Q34Q33Q32Q31Q30Q29Q28Q27Q26Q25Q24Q23Q22Q21Q20Q19Q18Q17Q15Q14Q13Q12Q11Q10Q09Q08Q07Q06Q05Q04Q03Q02Q01100200300400500SE +/- 1.15, N = 2SE +/- 0.39, N = 2SE +/- 0.29, N = 3SE +/- 0.04, N = 3SE +/- 0.27, N = 3SE +/- 0.08, N = 3SE +/- 0.36, N = 3SE +/- 0.33, N = 3SE +/- 0.71, N = 3SE +/- 0.07, N = 3SE +/- 0.18, N = 3SE +/- 0.37, N = 3SE +/- 0.22, N = 3SE +/- 0.85, N = 3SE +/- 0.51, N = 3SE +/- 0.31, N = 3SE +/- 0.28, N = 3SE +/- 0.21, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.42, N = 3SE +/- 2.12, N = 3SE +/- 0.10, N = 3SE +/- 0.64, N = 3SE +/- 0.16, N = 3SE +/- 0.40, N = 3SE +/- 0.38, N = 3SE +/- 1.15, N = 3SE +/- 0.02, N = 2SE +/- 5.27, N = 3SE +/- 0.35, N = 3SE +/- 0.29, N = 3SE +/- 0.18, N = 3SE +/- 0.63, N = 3SE +/- 0.17, N = 2SE +/- 0.84, N = 3SE +/- 1.53, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.32, N = 3SE +/- 0.13, N = 3SE +/- 0.54, N = 3SE +/- 0.60, N = 3SE +/- 0.09, N = 3SE +/- 0.23, N = 3SE +/- 0.16, N = 3SE +/- 0.18, N = 3SE +/- 0.36, N = 3SE +/- 0.66, N = 3SE +/- 0.37, N = 3SE +/- 0.37, N = 3SE +/- 0.24, N = 3SE +/- 0.22, N = 3SE +/- 0.27, N = 3SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 0.34, N = 3SE +/- 0.30, N = 3SE +/- 0.10, N = 3SE +/- 0.58, N = 3SE +/- 0.36, N = 3SE +/- 0.66, N = 3SE +/- 0.18, N = 3SE +/- 0.71, N = 3SE +/- 0.27, N = 3SE +/- 0.09, N = 3SE +/- 0.40, N = 3SE +/- 0.17, N = 3SE +/- 0.17, N = 3SE +/- 0.32, N = 3SE +/- 1.14, N = 3SE +/- 0.48, N = 3SE +/- 0.47, N = 3SE +/- 0.12, N = 3SE +/- 1.06, N = 3SE +/- 0.49, N = 3SE +/- 1.35, N = 3SE +/- 0.54, N = 3SE +/- 0.26, N = 3SE +/- 0.08, N = 3SE +/- 0.18, N = 3SE +/- 0.20, N = 3SE +/- 1.40, N = 3SE +/- 0.24, N = 3SE +/- 0.35, N = 3SE +/- 0.11, N = 3SE +/- 0.08, N = 3SE +/- 0.28, N = 3SE +/- 0.37, N = 3SE +/- 0.25, N = 3SE +/- 0.44, N = 3SE +/- 0.48, N = 3SE +/- 0.91, N = 3SE +/- 0.56, N = 3SE +/- 0.56, N = 3SE +/- 0.08, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.38, N = 3SE +/- 0.13, N = 3SE +/- 0.13, N = 3SE +/- 0.14, N = 2SE +/- 0.11, N = 3SE +/- 0.19, N = 3SE +/- 0.17, N = 2SE +/- 0.44, N = 3SE +/- 2.38, N = 3SE +/- 0.43, N = 3SE +/- 0.27, N = 3SE +/- 0.37, N = 3SE +/- 0.51, N = 3SE +/- 1.14, N = 3SE +/- 0.36, N = 3SE +/- 0.23, N = 3SE +/- 0.47, N = 2SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.80, N = 3SE +/- 0.16, N = 3SE +/- 1.43, N = 3SE +/- 0.08, N = 3SE +/- 2.63, N = 3SE +/- 0.31, N = 3SE +/- 0.40, N = 3SE +/- 1.20, N = 3SE +/- 0.64, N = 3SE +/- 0.08, N = 3SE +/- 11.04, N = 3SE +/- 0.53, N = 3SE +/- 0.21, N = 2SE +/- 0.47, N = 3SE +/- 0.51, N = 3SE +/- 0.24, N = 3SE +/- 0.48, N = 3SE +/- 3.02, N = 3SE +/- 0.06, N = 2SE +/- 0.27, N = 3SE +/- 0.21, N = 3SE +/- 0.53, N = 3SE +/- 0.28, N = 3SE +/- 0.03, N = 3SE +/- 0.24, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 0.25, N = 3SE +/- 0.10, N = 3SE +/- 0.65, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.32, N = 3SE +/- 0.40, N = 3SE +/- 0.09, N = 3SE +/- 0.28, N = 3SE +/- 0.09, N = 3SE +/- 0.30, N = 3SE +/- 0.34, N = 3SE +/- 0.06, N = 3SE +/- 0.37, N = 3SE +/- 0.36, N = 3SE +/- 0.89, N = 3SE +/- 0.11, N = 3SE +/- 0.63, N = 3SE +/- 0.22, N = 3SE +/- 0.11, N = 3SE +/- 0.37, N = 3SE +/- 0.41, N = 3SE +/- 0.41, N = 3SE +/- 0.07, N = 3SE +/- 0.16, N = 3SE +/- 0.66, N = 3SE +/- 0.39, N = 3SE +/- 0.30, N = 3SE +/- 0.72, N = 3SE +/- 0.08, N = 3SE +/- 1.31, N = 3SE +/- 0.38, N = 3SE +/- 0.34, N = 3SE +/- 0.02, N = 3SE +/- 0.37, N = 3SE +/- 0.21, N = 3SE +/- 0.43, N = 3SE +/- 0.09, N = 3SE +/- 2.04, N = 3SE +/- 0.17, N = 3SE +/- 0.13, N = 3SE +/- 0.53, N = 3SE +/- 0.15, N = 3SE +/- 0.16, N = 3SE +/- 0.26, N = 3SE +/- 0.21, N = 3SE +/- 0.46, N = 3SE +/- 1.08, N = 3SE +/- 0.72, N = 3SE +/- 0.28, N = 3SE +/- 0.09, N = 3SE +/- 0.20, N = 322.277.7016.265.1648.4110.9118.2319.0485.8212.3510.929.9717.6536.3044.4212.2319.5911.6813.6340.3115.86154.5321.24145.2924.6620.5059.6097.5216.29445.1123.7620.2821.68106.6120.0742.42170.8515.0112.9723.5924.1124.3824.4420.6713.9337.7715.3613.5959.4650.0840.2716.9733.3422.2913.157.7414.1713.567.3742.8215.1943.1922.7622.1425.6017.6822.3114.4035.8015.98118.4142.7722.1016.02112.6557.15178.1336.1215.805.2118.2320.87119.3517.7775.6619.785.27103.2820.1624.1317.2021.5249.0943.17154.3114.1817.5515.8523.197.6516.375.2647.0810.1818.1018.9685.1513.1810.739.8217.7036.1443.6012.3020.2211.7013.2638.4615.60154.3721.04145.2024.2420.5959.3795.4516.65419.7922.9520.1722.60106.3020.6242.69165.9614.7312.6122.5725.2424.2024.7821.1013.6036.9614.9413.2258.6349.3639.3416.6733.7321.8713.467.8413.7713.257.2841.4315.1943.4822.7422.3925.0717.9122.0015.2933.5216.04117.3441.6220.6916.23109.5156.78173.1536.6615.835.2717.8921.41119.3117.5977.1619.455.21101.8420.2424.4617.2720.7247.6743.74153.7814.1217.5815.411. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Comparison (Scale Factor: 10)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 10)Q94Q87Q81Q76Q99Q98Q97Q96Q95Q93Q92Q91Q90Q89Q88Q86Q85Q84Q83Q82Q80Q79Q78Q77Q75Q74Q73Q72Q71Q70Q69Q68Q67Q66Q65Q64Q63Q62Q61Q60Q59Q58Q57Q56Q55Q54Q53Q52Q51Q50Q49Q48Q47Q46Q45Q44Q43Q42Q41Q40Q39Q38Q37Q36Q35Q34Q33Q32Q31Q30Q29Q28Q27Q26Q25Q24Q23Q22Q21Q20Q19Q18Q17Q15Q14Q13Q12Q11Q10Q09Q08Q07Q06Q05Q04Q03Q02Q01306090120150SE +/- 0.08, N = 3SE +/- 0.72, N = 3SE +/- 0.17, N = 3SE +/- 0.21, N = 3SE +/- 0.36, N = 3SE +/- 0.02, N = 4SE +/- 0.17, N = 4SE +/- 0.25, N = 3SE +/- 0.09, N = 4SE +/- 0.26, N = 4SE +/- 0.05, N = 4SE +/- 0.02, N = 3SE +/- 0.03, N = 4SE +/- 0.10, N = 4SE +/- 0.39, N = 4SE +/- 0.04, N = 4SE +/- 0.03, N = 4SE +/- 0.07, N = 4SE +/- 0.11, N = 4SE +/- 0.22, N = 4SE +/- 0.46, N = 4SE +/- 0.14, N = 4SE +/- 0.31, N = 4SE +/- 0.24, N = 4SE +/- 0.35, N = 4SE +/- 0.13, N = 4SE +/- 0.10, N = 4SE +/- 1.21, N = 4SE +/- 0.21, N = 4SE +/- 0.14, N = 4SE +/- 0.17, N = 4SE +/- 0.14, N = 4SE +/- 0.13, N = 4SE +/- 0.18, N = 4SE +/- 0.84, N = 4SE +/- 0.32, N = 4SE +/- 0.13, N = 4SE +/- 0.10, N = 4SE +/- 0.05, N = 4SE +/- 0.34, N = 4SE +/- 0.10, N = 4SE +/- 0.09, N = 4SE +/- 0.07, N = 4SE +/- 0.11, N = 4SE +/- 0.14, N = 4SE +/- 0.07, N = 4SE +/- 0.08, N = 4SE +/- 0.10, N = 4SE +/- 0.18, N = 4SE +/- 0.25, N = 4SE +/- 0.11, N = 4SE +/- 0.10, N = 4SE +/- 0.16, N = 4SE +/- 0.16, N = 4SE +/- 0.13, N = 4SE +/- 0.04, N = 4SE +/- 0.09, N = 4SE +/- 0.06, N = 4SE +/- 0.07, N = 4SE +/- 0.11, N = 4SE +/- 0.31, N = 4SE +/- 0.28, N = 4SE +/- 0.27, N = 4SE +/- 0.13, N = 4SE +/- 0.12, N = 4SE +/- 0.22, N = 3SE +/- 0.16, N = 4SE +/- 0.25, N = 4SE +/- 0.26, N = 3SE +/- 0.06, N = 4SE +/- 0.41, N = 4SE +/- 0.21, N = 4SE +/- 0.20, N = 4SE +/- 0.27, N = 4SE +/- 0.27, N = 4SE +/- 0.11, N = 4SE +/- 0.43, N = 4SE +/- 0.40, N = 4SE +/- 0.17, N = 4SE +/- 0.03, N = 4SE +/- 0.21, N = 4SE +/- 0.12, N = 4SE +/- 0.36, N = 4SE +/- 0.21, N = 4SE +/- 0.35, N = 4SE +/- 0.16, N = 4SE +/- 0.04, N = 4SE +/- 0.27, N = 4SE +/- 0.12, N = 4SE +/- 0.10, N = 4SE +/- 0.13, N = 4SE +/- 0.32, N = 4SE +/- 0.14, N = 4SE +/- 0.37, N = 4SE +/- 0.36, N = 4SE +/- 0.03, N = 4SE +/- 0.25, N = 4SE +/- 0.14, N = 4SE +/- 0.09, N = 3SE +/- 0.23, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 2SE +/- 0.16, N = 3SE +/- 0.08, N = 2SE +/- 0.33, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.41, N = 3SE +/- 0.16, N = 3SE +/- 0.25, N = 2SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 3SE +/- 0.23, N = 3SE +/- 0.29, N = 3SE +/- 0.14, N = 3SE +/- 0.23, N = 3SE +/- 0.19, N = 3SE +/- 0.75, N = 3SE +/- 0.05, N = 3SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 0.38, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 0.40, N = 3SE +/- 0.02, N = 3SE +/- 0.32, N = 3SE +/- 0.02, N = 3SE +/- 0.27, N = 3SE +/- 0.11, N = 3SE +/- 0.16, N = 3SE +/- 0.21, N = 3SE +/- 0.51, N = 3SE +/- 0.24, N = 3SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.51, N = 3SE +/- 0.23, N = 2SE +/- 0.34, N = 3SE +/- 0.16, N = 3SE +/- 0.14, N = 3SE +/- 0.19, N = 3SE +/- 0.42, N = 3SE +/- 0.11, N = 3SE +/- 0.15, N = 3SE +/- 0.17, N = 2SE +/- 0.22, N = 3SE +/- 0.20, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.34, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.26, N = 3SE +/- 0.20, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 3SE +/- 0.63, N = 3SE +/- 0.93, N = 3SE +/- 0.46, N = 3SE +/- 0.26, N = 3SE +/- 0.14, N = 3SE +/- 0.63, N = 3SE +/- 0.16, N = 3SE +/- 0.40, N = 3SE +/- 0.51, N = 3SE +/- 0.27, N = 2SE +/- 0.29, N = 3SE +/- 0.79, N = 3SE +/- 0.64, N = 3SE +/- 0.46, N = 3SE +/- 0.14, N = 3SE +/- 0.17, N = 3SE +/- 0.05, N = 3SE +/- 0.22, N = 3SE +/- 0.21, N = 3SE +/- 0.15, N = 3SE +/- 0.19, N = 3SE +/- 0.58, N = 3SE +/- 0.10, N = 3SE +/- 0.03, N = 3SE +/- 0.37, N = 3SE +/- 0.09, N = 3SE +/- 0.28, N = 3SE +/- 0.14, N = 3SE +/- 0.10, N = 3SE +/- 0.30, N = 3SE +/- 0.60, N = 3SE +/- 0.31, N = 3SE +/- 0.17, N = 3SE +/- 0.36, N = 3SE +/- 0.02, N = 39.9317.6611.5412.5210.235.0016.997.1610.2127.159.079.787.4611.0117.189.1714.859.1310.7416.9948.0811.9144.1415.2527.4919.8011.19118.2813.1213.4413.8212.5133.1914.0318.6451.489.559.197.1014.2113.1013.8416.4813.028.6316.979.758.7626.3222.0018.9310.4919.1012.669.766.548.558.697.1717.6810.4217.6913.8211.9215.9111.9114.109.7418.6411.9135.8717.4612.9210.3235.3617.4633.0026.5712.545.0911.8113.7835.1110.3922.7611.805.1435.7714.1412.0511.8312.5818.8123.8550.148.4811.3211.2910.1218.0411.4612.3010.205.0417.236.6410.1627.079.0110.007.5210.7817.489.2814.569.1510.7916.6447.1811.9943.4014.5727.0419.7411.15118.0812.7113.7113.9712.8132.6113.7518.1250.339.838.987.0314.3212.5114.7416.3812.808.7017.079.468.6526.2821.9019.5110.0019.0812.479.846.408.428.447.0917.3810.7517.4113.3612.4816.5712.0413.609.3819.3311.9034.6917.5413.4310.4835.4716.7933.7026.9412.105.0511.1513.8134.6810.3322.1911.435.1435.9014.3311.8311.8412.7619.4023.3848.889.0211.6311.231. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Comparison (Scale Factor: 500)

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 500)Q92Q90Q89Q88Q87Q86Q85Q84Q82Q79Q76Q73Q71Q70Q69Q68Q66Q63Q62Q61Q60Q59Q58Q57Q56Q55Q54Q53Q52Q48Q47Q46Q45Q44Q43Q42Q41Q39Q38Q37Q36Q35Q34Q33Q32Q31Q30Q28Q27Q26Q25Q22Q21Q20Q19Q18Q17Q15Q14Q13Q12Q10Q09Q08Q07Q06Q03Q0220406080100SE +/- 0.44, N = 3SE +/- 0.31, N = 3SE +/- 0.42, N = 3SE +/- 0.43, N = 3SE +/- 0.70, N = 3SE +/- 0.13, N = 3SE +/- 0.20, N = 3SE +/- 0.08, N = 3SE +/- 0.43, N = 3SE +/- 0.49, N = 3SE +/- 0.72, N = 3SE +/- 0.37, N = 3SE +/- 0.82, N = 3SE +/- 1.37, N = 3SE +/- 0.42, N = 3SE +/- 0.26, N = 3SE +/- 0.43, N = 3SE +/- 0.31, N = 3SE +/- 0.07, N = 3SE +/- 0.17, N = 3SE +/- 0.70, N = 3SE +/- 1.04, N = 3SE +/- 1.31, N = 3SE +/- 0.61, N = 3SE +/- 0.14, N = 3SE +/- 0.34, N = 3SE +/- 0.13, N = 2SE +/- 0.11, N = 3SE +/- 0.29, N = 3SE +/- 0.27, N = 3SE +/- 0.43, N = 3SE +/- 0.29, N = 3SE +/- 0.37, N = 3SE +/- 0.23, N = 3SE +/- 0.32, N = 3SE +/- 0.25, N = 3SE +/- 0.09, N = 3SE +/- 0.37, N = 3SE +/- 0.18, N = 3SE +/- 0.33, N = 3SE +/- 0.57, N = 3SE +/- 0.28, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.06, N = 3SE +/- 0.64, N = 3SE +/- 0.46, N = 3SE +/- 0.61, N = 3SE +/- 0.28, N = 3SE +/- 0.40, N = 3SE +/- 0.28, N = 3SE +/- 0.02, N = 2SE +/- 0.52, N = 3SE +/- 0.23, N = 3SE +/- 0.71, N = 3SE +/- 0.11, N = 3SE +/- 1.32, N = 3SE +/- 0.38, N = 2SE +/- 0.09, N = 2SE +/- 1.72, N = 2SE +/- 0.61, N = 2SE +/- 0.13, N = 2SE +/- 1.17, N = 2SE +/- 0.05, N = 2SE +/- 0.21, N = 2SE +/- 0.07, N = 216.0412.1023.4653.7068.1915.4024.6013.5526.0230.2728.5921.3030.9135.8826.0830.4827.0819.8615.617.7131.1736.0634.2131.6328.0517.9533.9919.9619.1423.1349.4429.8716.9025.0319.2317.617.3224.9968.0821.4030.7336.5022.8129.0422.5949.0018.8967.0429.8620.5941.3061.5021.025.2225.8027.7343.5526.11100.3628.725.2327.6939.8022.6627.8323.6119.4827.901. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Comparison (Scale Factor: 1)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Comparison (Scale Factor: 1)Q99Q98Q93Q59Q97Q96Q95Q94Q92Q91Q90Q89Q88Q87Q86Q85Q84Q83Q82Q81Q80Q79Q78Q77Q76Q75Q74Q73Q72Q71Q70Q69Q68Q67Q66Q65Q64Q63Q62Q61Q60Q58Q57Q56Q55Q54Q53Q52Q51Q50Q49Q48Q47Q46Q45Q44Q43Q42Q41Q40Q39Q38Q37Q36Q35Q34Q33Q32Q31Q30Q29Q28Q27Q26Q25Q24Q23Q22Q21Q20Q19Q18Q17Q16Q15Q14Q13Q12Q11Q10Q09Q08Q07Q06Q05Q04Q03Q02Q01510152025SE +/- 0.22, N = 2SE +/- 0.02, N = 2SE +/- 0.02, N = 2SE +/- 0.15, N = 2SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 2SE +/- 0.07, N = 3SE +/- 0.01, N = 2SE +/- 0.14, N = 2SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 2SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.19, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 2SE +/- 0.15, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.28, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.18, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 2SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.13, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 2SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 3SE +/- 0.01, N = 3SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.13, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 2SE +/- 0.17, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.09, N = 3SE +/- 0.21, N = 3SE +/- 0.14, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.19, N = 3SE +/- 0.10, N = 3SE +/- 0.16, N = 3SE +/- 0.09, N = 3SE +/- 0.33, N = 3SE +/- 0.16, N = 3SE +/- 0.02, N = 3SE +/- 0.10, N = 3SE +/- 0.17, N = 3SE +/- 0.11, N = 3SE +/- 0.12, N = 3SE +/- 0.10, N = 3SE +/- 0.03, N = 3SE +/- 0.19, N = 3SE +/- 0.22, N = 3SE +/- 0.03, N = 3SE +/- 0.14, N = 3SE +/- 0.10, N = 3SE +/- 0.02, N = 2SE +/- 0.02, N = 4SE +/- 0.04, N = 3SE +/- 0.04, N = 4SE +/- 0.06, N = 4SE +/- 0.03, N = 4SE +/- 0.04, N = 3SE +/- 0.03, N = 4SE +/- 0.08, N = 4SE +/- 0.06, N = 4SE +/- 0.06, N = 4SE +/- 0.10, N = 4SE +/- 0.12, N = 3SE +/- 0.05, N = 4SE +/- 0.11, N = 4SE +/- 0.19, N = 3SE +/- 0.05, N = 4SE +/- 0.02, N = 3SE +/- 0.07, N = 4SE +/- 0.08, N = 3SE +/- 0.10, N = 4SE +/- 0.06, N = 4SE +/- 0.07, N = 4SE +/- 0.05, N = 4SE +/- 0.10, N = 4SE +/- 0.13, N = 4SE +/- 0.05, N = 4SE +/- 0.05, N = 4SE +/- 0.25, N = 4SE +/- 0.10, N = 4SE +/- 0.15, N = 3SE +/- 0.18, N = 4SE +/- 0.07, N = 4SE +/- 0.13, N = 4SE +/- 0.13, N = 3SE +/- 0.06, N = 4SE +/- 0.19, N = 4SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 2SE +/- 0.07, N = 4SE +/- 0.05, N = 4SE +/- 0.06, N = 4SE +/- 0.10, N = 4SE +/- 0.07, N = 4SE +/- 0.02, N = 4SE +/- 0.19, N = 4SE +/- 0.14, N = 4SE +/- 0.08, N = 4SE +/- 0.07, N = 4SE +/- 0.16, N = 4SE +/- 0.06, N = 3SE +/- 0.03, N = 4SE +/- 0.03, N = 4SE +/- 0.09, N = 4SE +/- 0.03, N = 4SE +/- 0.05, N = 4SE +/- 0.04, N = 3SE +/- 0.12, N = 4SE +/- 0.05, N = 4SE +/- 0.09, N = 3SE +/- 0.12, N = 3SE +/- 0.08, N = 4SE +/- 0.13, N = 2SE +/- 0.09, N = 4SE +/- 0.04, N = 4SE +/- 0.14, N = 4SE +/- 0.07, N = 3SE +/- 0.04, N = 4SE +/- 0.12, N = 3SE +/- 0.05, N = 4SE +/- 0.14, N = 4SE +/- 0.11, N = 4SE +/- 0.05, N = 4SE +/- 0.23, N = 4SE +/- 0.18, N = 4SE +/- 0.08, N = 4SE +/- 0.02, N = 4SE +/- 0.05, N = 4SE +/- 0.08, N = 4SE +/- 0.12, N = 4SE +/- 0.10, N = 4SE +/- 0.02, N = 4SE +/- 0.11, N = 4SE +/- 0.11, N = 4SE +/- 0.02, N = 4SE +/- 0.05, N = 4SE +/- 0.16, N = 4SE +/- 0.05, N = 4SE +/- 0.01, N = 4SE +/- 0.04, N = 4SE +/- 0.05, N = 4SE +/- 0.11, N = 4SE +/- 0.10, N = 4SE +/- 0.07, N = 4SE +/- 0.06, N = 4SE +/- 0.10, N = 47.834.877.719.099.715.757.466.117.588.326.768.7011.8310.098.1312.007.139.218.888.7613.458.5114.0311.248.8214.4311.728.3019.618.9910.2911.078.4612.3111.2710.1017.157.797.636.5410.2510.1710.649.886.8011.167.886.7813.308.5611.147.8912.598.677.538.647.246.706.238.073.7610.185.229.2511.228.4110.207.6812.089.0011.6311.149.127.8911.212.728.0810.757.994.978.1710.5911.726.317.579.018.264.9512.7511.458.198.758.489.1112.1115.166.759.778.937.624.857.759.119.835.737.266.097.798.196.638.8111.3910.078.0411.867.309.248.868.8713.528.4414.3311.398.7814.2611.958.3119.119.0410.3510.958.5312.0811.2710.2717.197.887.836.4910.199.9210.769.876.5710.897.906.7313.228.7510.777.6512.438.697.608.617.156.726.228.003.7210.085.098.8311.488.6110.047.7012.299.2611.1911.028.997.8811.272.688.0710.427.914.948.0210.5811.996.297.499.038.404.9012.7011.537.908.808.469.3311.7915.046.799.698.981. (CC) gcc options: -O3 -fcommon -lm

Apache Spark TPC-DS

Scale Factor Comparison (Q16)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-DS 3.5Scale Factor Comparison (Q16)1246810SE +/- 0.16, N = 3SE +/- 0.10, N = 46.316.291. (CC) gcc options: -O3 -fcommon -lm

Timed Linux Kernel Compilation

Build Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build Comparisonallmodconfigdefconfig2K4K6K8K10KSE +/- 4.42, N = 3SE +/- 1.10, N = 3SE +/- 1.62, N = 3SE +/- 1.28, N = 3SE +/- 1.83, N = 3SE +/- 5.72, N = 3SE +/- 2.80, N = 3SE +/- 2.04, N = 3SE +/- 14.83, N = 3SE +/- 9.15, N = 35759.511199.615536.031160.505375.951138.205371.021131.979463.571904.55

Timed Node.js Compilation

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 19.8.1ComparisonTime To Compile7001400210028003500SE +/- 2.91, N = 3SE +/- 1.20, N = 3SE +/- 3.73, N = 3SE +/- 0.29, N = 33378.823261.913289.073283.24

Timed GCC Compilation

Comparison

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed GCC Compilation 13.2ComparisonTime To Compile9001800270036004500SE +/- 12.28, N = 34406.83

Timed LLVM Compilation

Build System Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System ComparisonNinjaUnix Makefiles8001600240032004000SE +/- 5.47, N = 3SE +/- 5.63, N = 3SE +/- 1.73, N = 3SE +/- 3.39, N = 3SE +/- 3.31, N = 3SE +/- 6.63, N = 3SE +/- 1.23, N = 3SE +/- 2.47, N = 33662.543722.373524.423577.043480.733524.743468.303511.13

Timed Gem5 Compilation

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 23.0.1ComparisonTime To Compile5001000150020002500SE +/- 3.08, N = 3SE +/- 0.90, N = 3SE +/- 2.55, N = 3SE +/- 0.96, N = 32329.032257.242222.422220.18

Apache CouchDB

Bulk Size Comparison (Inserts: 3000 - Rounds: 30)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Bulk Size Comparison (Inserts: 3000 - Rounds: 30)3005001005001000150020002500SE +/- 14.88, N = 5SE +/- 0.87, N = 3SE +/- 1.11, N = 3SE +/- 2.19, N = 3SE +/- 1.95, N = 3SE +/- 0.84, N = 3SE +/- 31.00, N = 9SE +/- 11.33, N = 3SE +/- 1.88, N = 3SE +/- 2.59, N = 3SE +/- 13.77, N = 3SE +/- 10.18, N = 31412.822261.83887.891314.732158.52860.531492.532083.07855.611444.002140.74871.541. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Inserts Comparison (Bulk Size: 300 - - Rounds: 30)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Inserts Comparison (Bulk Size: 300 - - Rounds: 30)3000100030060090012001500SE +/- 14.88, N = 5SE +/- 2.78, N = 3SE +/- 2.19, N = 3SE +/- 3.79, N = 3SE +/- 31.00, N = 9SE +/- 1.83, N = 3SE +/- 2.59, N = 3SE +/- 0.91, N = 31412.82377.971314.73366.671492.53384.071444.00394.741. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Rounds Comparison (Bulk Size: 300 - Inserts: 3000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 300 - Inserts: 3000)3030060090012001500SE +/- 14.88, N = 5SE +/- 2.19, N = 3SE +/- 31.00, N = 9SE +/- 2.59, N = 31412.821314.731492.531444.001. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Inserts Comparison (Bulk Size: 500 - - Rounds: 30)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Inserts Comparison (Bulk Size: 500 - - Rounds: 30)300010005001000150020002500SE +/- 0.87, N = 3SE +/- 0.74, N = 3SE +/- 1.95, N = 3SE +/- 0.51, N = 3SE +/- 11.33, N = 3SE +/- 3.77, N = 3SE +/- 13.77, N = 3SE +/- 2.58, N = 32261.83464.692158.52438.302083.07676.092140.74679.401. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Rounds Comparison (Bulk Size: 500 - Inserts: 3000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 500 - Inserts: 3000)305001000150020002500SE +/- 0.87, N = 3SE +/- 1.95, N = 3SE +/- 11.33, N = 3SE +/- 13.77, N = 32261.832158.522083.072140.741. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Inserts Comparison (Bulk Size: 100 - - Rounds: 30)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Inserts Comparison (Bulk Size: 100 - - Rounds: 30)300010002004006008001000SE +/- 1.11, N = 3SE +/- 3.82, N = 9SE +/- 0.84, N = 3SE +/- 2.31, N = 3SE +/- 1.88, N = 3SE +/- 2.80, N = 9SE +/- 10.18, N = 3SE +/- 2.59, N = 6887.89262.44860.53247.76855.61266.25871.54258.521. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Rounds Comparison (Bulk Size: 100 - Inserts: 3000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 100 - Inserts: 3000)302004006008001000SE +/- 1.11, N = 3SE +/- 0.84, N = 3SE +/- 1.88, N = 3SE +/- 10.18, N = 3887.89860.53855.61871.541. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Bulk Size Comparison (Inserts: 1000 - Rounds: 30)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Bulk Size Comparison (Inserts: 1000 - Rounds: 30)100500300150300450600750SE +/- 3.82, N = 9SE +/- 0.74, N = 3SE +/- 2.78, N = 3SE +/- 2.31, N = 3SE +/- 0.51, N = 3SE +/- 3.79, N = 3SE +/- 2.80, N = 9SE +/- 3.77, N = 3SE +/- 1.83, N = 3SE +/- 2.59, N = 6SE +/- 2.58, N = 3SE +/- 0.91, N = 3262.44464.69377.97247.76438.30366.67266.25676.09384.07258.52679.40394.741. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Rounds Comparison (Bulk Size: 100 - Inserts: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 100 - Inserts: 1000)3060120180240300SE +/- 3.82, N = 9SE +/- 2.31, N = 3SE +/- 2.80, N = 9SE +/- 2.59, N = 6262.44247.76266.25258.521. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Rounds Comparison (Bulk Size: 500 - Inserts: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 500 - Inserts: 1000)30150300450600750SE +/- 0.74, N = 3SE +/- 0.51, N = 3SE +/- 3.77, N = 3SE +/- 2.58, N = 3464.69438.30676.09679.401. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache CouchDB

Rounds Comparison (Bulk Size: 300 - Inserts: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Rounds Comparison (Bulk Size: 300 - Inserts: 1000)3090180270360450SE +/- 2.78, N = 3SE +/- 3.79, N = 3SE +/- 1.83, N = 3SE +/- 0.91, N = 3377.97366.67384.07394.741. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Timed Godot Game Engine Compilation

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 4.0ComparisonTime To Compile8001600240032004000SE +/- 7.67, N = 3SE +/- 4.62, N = 3SE +/- 4.83, N = 3SE +/- 6.78, N = 3SE +/- 3.05, N = 31922.641852.591835.921844.363498.30

Apache Spark

Row Count Comparison (Partitions: 100 - Broadcast Inner Join Test Time)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Broadcast Inner Join Test Time)40000000200000001000000100000004080120160200SE +/- 2.32, N = 3SE +/- 0.43, N = 3SE +/- 0.10, N = 3SE +/- 0.71, N = 3SE +/- 0.60, N = 3SE +/- 0.55, N = 3SE +/- 0.07, N = 5SE +/- 0.21, N = 3SE +/- 0.19, N = 3SE +/- 0.09, N = 4SE +/- 0.25, N = 3SE +/- 0.59, N = 3SE +/- 0.08, N = 3SE +/- 0.62, N = 3159.0179.215.6944.26150.0574.605.4542.8582.035.7247.1073.605.5043.19

Apache Spark

Partitions Comparison (Row Count: 40000000 - - Broadcast Inner Join Test Time)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Broadcast Inner Join Test Time)100100020005004080120160200SE +/- 2.32, N = 3SE +/- 0.25, N = 3SE +/- 1.89, N = 3SE +/- 0.85, N = 3SE +/- 0.60, N = 3SE +/- 1.46, N = 3SE +/- 0.50, N = 3SE +/- 0.76, N = 3159.01158.24157.25157.08150.05147.55148.66147.55

Apache Spark

Comparison (Row Count: 40000000 - Partitions: 100)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 40000000 - Partitions: 100)Broadcast Inner Join Test TimeInner Join Test TimeRepartition Test TimeGroup By Test TimeCalculate Pi Benchmark Using DataframeCalculate Pi BenchmarkSHA-512 Benchmark Time160320480640800SE +/- 2.32, N = 3SE +/- 1.75, N = 3SE +/- 1.31, N = 3SE +/- 2.29, N = 3SE +/- 0.23, N = 3SE +/- 1.80, N = 3SE +/- 0.84, N = 3SE +/- 0.60, N = 3SE +/- 1.45, N = 3SE +/- 0.42, N = 3SE +/- 3.33, N = 3SE +/- 0.10, N = 3SE +/- 0.68, N = 3SE +/- 0.82, N = 3SE +/- 0.05, N = 3SE +/- 8.88, N = 3SE +/- 0.34, N = 3SE +/- 0.38, N = 3SE +/- 0.87, N = 3SE +/- 0.58, N = 3159.01157.88137.2887.3232.08694.62190.03150.05152.87131.3888.0131.79581.19178.8933.63724.99195.4531.57579.98177.81

Apache Spark

Row Count Comparison (Partitions: 100 - Inner Join Test Time)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Inner Join Test Time)4000000020000000100000010000000306090120150SE +/- 1.752337079, N = 3SE +/- 0.323667212, N = 3SE +/- 0.004165140, N = 3SE +/- 0.120293064, N = 3SE +/- 1.445788055, N = 3SE +/- 0.475686548, N = 3SE +/- 0.044993077, N = 5SE +/- 1.372283254, N = 3SE +/- 0.574015178, N = 3SE +/- 0.134671456, N = 4SE +/- 0.257232291, N = 3SE +/- 1.129567495, N = 3SE +/- 0.294062371, N = 3SE +/- 1.642152192, N = 3157.88000000080.9000000006.25000000043.580000000152.87255721976.8700000006.04000000043.71000000083.9800000006.59000000047.52000000075.6800000006.54000000043.880000000

Apache Spark

Partitions Comparison (Row Count: 40000000 - - Inner Join Test Time)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Inner Join Test Time)100100020005004080120160200SE +/- 1.75, N = 3SE +/- 1.92, N = 3SE +/- 1.46, N = 3SE +/- 0.39, N = 3SE +/- 1.45, N = 3SE +/- 1.83, N = 3SE +/- 1.01, N = 3SE +/- 1.02, N = 3157.88162.01159.12158.11152.87151.54151.60152.21

Apache Spark

Row Count Comparison (Partitions: 100 - Repartition Test Time)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Repartition Test Time)4000000020000000100000010000000306090120150SE +/- 1.31, N = 3SE +/- 0.33, N = 3SE +/- 0.08, N = 3SE +/- 0.18, N = 3SE +/- 0.42, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 5SE +/- 0.43, N = 3SE +/- 0.55, N = 3SE +/- 0.03, N = 4SE +/- 0.56, N = 3SE +/- 2.01, N = 3SE +/- 0.07, N = 3SE +/- 0.76, N = 3137.2871.598.7938.29131.3868.128.7537.0774.329.0841.2872.358.6238.58

Apache Spark

Partitions Comparison (Row Count: 40000000 - - Repartition Test Time)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Repartition Test Time)10010002000500306090120150SE +/- 1.31, N = 3SE +/- 0.83, N = 3SE +/- 0.91, N = 3SE +/- 0.58, N = 3SE +/- 0.42, N = 3SE +/- 0.93, N = 3SE +/- 0.77, N = 3SE +/- 0.84, N = 3137.28138.87137.45138.04131.38131.43131.39131.53

Apache Spark

Row Count Comparison (Partitions: 100 - Group By Test Time)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Group By Test Time)400000002000000010000001000000020406080100SE +/- 2.29, N = 3SE +/- 0.32, N = 3SE +/- 0.13, N = 3SE +/- 0.25, N = 3SE +/- 3.33, N = 3SE +/- 0.47, N = 3SE +/- 0.08, N = 5SE +/- 0.24, N = 3SE +/- 0.45, N = 3SE +/- 0.02, N = 4SE +/- 0.30, N = 3SE +/- 0.73, N = 3SE +/- 0.13, N = 3SE +/- 3.06, N = 387.3235.518.8123.5088.0134.419.0923.9037.119.0725.0534.668.7526.62

Apache Spark

Partitions Comparison (Row Count: 40000000 - - Group By Test Time)

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Group By Test Time)1001000200050020406080100SE +/- 2.29, N = 3SE +/- 2.33, N = 3SE +/- 4.77, N = 3SE +/- 4.05, N = 3SE +/- 3.33, N = 3SE +/- 0.85, N = 3SE +/- 3.36, N = 3SE +/- 1.17, N = 387.3288.0283.8789.2388.0179.6081.6182.35

Apache Spark

Row Count Comparison (Partitions: 1000 - Broadcast Inner Join Test Time)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Broadcast Inner Join Test Time)4000000020000000100000001000000306090120150SE +/- 0.25, N = 3SE +/- 0.09, N = 3SE +/- 0.16, N = 3SE +/- 0.12, N = 3SE +/- 1.46, N = 3SE +/- 0.20, N = 3SE +/- 0.36, N = 3SE +/- 0.06, N = 3SE +/- 0.51, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.83, N = 3SE +/- 1.25, N = 3SE +/- 0.06, N = 4158.2480.6441.986.99147.5576.6639.227.0584.0143.477.2975.9640.906.90

Apache Spark

Comparison (Row Count: 40000000 - Partitions: 1000)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 40000000 - Partitions: 1000)Broadcast Inner Join Test TimeInner Join Test TimeRepartition Test TimeGroup By Test TimeCalculate Pi Benchmark Using DataframeCalculate Pi BenchmarkSHA-512 Benchmark Time160320480640800SE +/- 0.25, N = 3SE +/- 1.92, N = 3SE +/- 0.83, N = 3SE +/- 2.33, N = 3SE +/- 0.16, N = 3SE +/- 6.51, N = 3SE +/- 0.13, N = 3SE +/- 1.46, N = 3SE +/- 1.83, N = 3SE +/- 0.93, N = 3SE +/- 0.85, N = 3SE +/- 0.10, N = 3SE +/- 1.66, N = 3SE +/- 0.48, N = 3SE +/- 0.22, N = 3SE +/- 14.94, N = 3SE +/- 0.54, N = 3SE +/- 0.16, N = 3SE +/- 0.56, N = 3SE +/- 0.77, N = 3158.24162.01138.8788.0232.40697.90183.35147.55151.54131.4379.6031.61581.60172.1933.51721.00189.7331.54581.69172.45

Apache Spark

Row Count Comparison (Partitions: 1000 - Inner Join Test Time)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Inner Join Test Time)40000000200000001000000010000004080120160200SE +/- 1.923212084, N = 3SE +/- 0.420756743, N = 3SE +/- 0.136942862, N = 3SE +/- 0.035374915, N = 3SE +/- 1.834767926, N = 3SE +/- 0.524371080, N = 3SE +/- 0.211182878, N = 3SE +/- 0.108422107, N = 3SE +/- 0.315382741, N = 3SE +/- 0.399790551, N = 3SE +/- 0.105150363, N = 3SE +/- 0.855084002, N = 3SE +/- 0.557375853, N = 3SE +/- 0.633875719, N = 4162.01000000081.35000000044.0000000008.010000000151.54386199779.29000000041.4900000007.81000000085.12000000045.6000000008.33000000078.42000000043.3000000008.630000000

Apache Spark

Row Count Comparison (Partitions: 1000 - Repartition Test Time)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Repartition Test Time)4000000020000000100000001000000306090120150SE +/- 0.83, N = 3SE +/- 0.23, N = 3SE +/- 0.22, N = 3SE +/- 0.07, N = 3SE +/- 0.93, N = 3SE +/- 0.20, N = 3SE +/- 0.31, N = 3SE +/- 0.18, N = 3SE +/- 0.23, N = 3SE +/- 0.23, N = 3SE +/- 0.02, N = 3SE +/- 1.03, N = 3SE +/- 0.54, N = 3SE +/- 0.07, N = 4138.8771.7038.6110.05131.4368.5436.729.9575.1839.9610.0672.9839.319.74

Apache Spark

Row Count Comparison (Partitions: 1000 - Group By Test Time)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Group By Test Time)400000002000000010000000100000020406080100SE +/- 2.33, N = 3SE +/- 0.15, N = 3SE +/- 0.28, N = 3SE +/- 0.02, N = 3SE +/- 0.85, N = 3SE +/- 0.44, N = 3SE +/- 0.20, N = 3SE +/- 0.09, N = 3SE +/- 0.79, N = 3SE +/- 0.35, N = 3SE +/- 0.03, N = 3SE +/- 2.03, N = 3SE +/- 0.36, N = 3SE +/- 0.08, N = 488.0235.2722.2911.1079.6034.7022.6211.1837.3123.8911.3935.8322.4410.93

Apache Spark

Row Count Comparison (Partitions: 2000 - Broadcast Inner Join Test Time)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Broadcast Inner Join Test Time)4000000010000002000000010000000306090120150SE +/- 1.89, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.28, N = 3SE +/- 0.50, N = 3SE +/- 0.27, N = 3SE +/- 0.89, N = 3SE +/- 0.13, N = 3SE +/- 0.18, N = 3SE +/- 0.57, N = 3SE +/- 0.27, N = 3SE +/- 0.13, N = 9SE +/- 0.24, N = 3157.258.0481.2542.90148.668.4177.5641.168.5883.9444.598.3740.93

Apache Spark

Comparison (Row Count: 40000000 - Partitions: 2000)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 40000000 - Partitions: 2000)Broadcast Inner Join Test TimeInner Join Test TimeRepartition Test TimeGroup By Test TimeCalculate Pi Benchmark Using DataframeCalculate Pi BenchmarkSHA-512 Benchmark Time150300450600750SE +/- 1.89, N = 3SE +/- 1.46, N = 3SE +/- 0.91, N = 3SE +/- 4.77, N = 3SE +/- 0.31, N = 3SE +/- 8.50, N = 3SE +/- 0.21, N = 3SE +/- 0.50, N = 3SE +/- 1.01, N = 3SE +/- 0.77, N = 3SE +/- 3.36, N = 3SE +/- 0.14, N = 3SE +/- 1.28, N = 3SE +/- 0.47, N = 3SE +/- 0.06, N = 3SE +/- 16.56, N = 3SE +/- 0.40, N = 3SE +/- 0.10, N = 3SE +/- 0.49, N = 3SE +/- 0.42, N = 3157.25159.12137.4583.8732.20695.17185.51148.66151.60131.3981.6131.32579.55175.2433.79710.71192.8131.65580.86175.84

Apache Spark

Row Count Comparison (Partitions: 2000 - Inner Join Test Time)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Inner Join Test Time)40000000100000020000000100000004080120160200SE +/- 1.46, N = 3SE +/- 0.09, N = 3SE +/- 0.31, N = 3SE +/- 0.04, N = 3SE +/- 1.01, N = 3SE +/- 0.40, N = 3SE +/- 0.05, N = 3SE +/- 0.15, N = 3SE +/- 0.10, N = 3SE +/- 0.28, N = 3SE +/- 0.21, N = 3SE +/- 0.50, N = 9SE +/- 1.45, N = 3159.1210.6883.6445.74151.6010.8980.4144.2310.6986.4347.6711.0647.61

Apache Spark

Row Count Comparison (Partitions: 2000 - Repartition Test Time)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Repartition Test Time)4000000010000002000000010000000306090120150SE +/- 0.91, N = 3SE +/- 0.04, N = 3SE +/- 0.20, N = 3SE +/- 0.21, N = 3SE +/- 0.77, N = 3SE +/- 0.16, N = 3SE +/- 0.14, N = 3SE +/- 0.08, N = 3SE +/- 0.18, N = 3SE +/- 0.46, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 9SE +/- 0.66, N = 3137.4510.7172.2839.22131.3910.8569.0937.9411.0175.4440.5010.5739.33

Apache Spark

Row Count Comparison (Partitions: 2000 - Group By Test Time)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Group By Test Time)400000001000000200000001000000020406080100SE +/- 4.77, N = 3SE +/- 0.09, N = 3SE +/- 0.46, N = 3SE +/- 0.13, N = 3SE +/- 3.36, N = 3SE +/- 0.23, N = 3SE +/- 0.41, N = 3SE +/- 0.39, N = 3SE +/- 0.15, N = 3SE +/- 0.10, N = 3SE +/- 0.28, N = 3SE +/- 0.13, N = 9SE +/- 0.22, N = 383.8712.8636.7224.0981.6113.3137.1624.1313.0237.3524.8512.8324.10

Apache Spark

Row Count Comparison (Partitions: 500 - Broadcast Inner Join Test Time)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Broadcast Inner Join Test Time)4000000020000000100000001000000306090120150SE +/- 0.852271154, N = 3SE +/- 0.489603948, N = 3SE +/- 0.236232308, N = 3SE +/- 0.103211248, N = 3SE +/- 0.764058299, N = 3SE +/- 0.730826056, N = 3SE +/- 0.448087864, N = 3SE +/- 0.486110869, N = 3SE +/- 0.300364443, N = 3SE +/- 0.236866720, N = 3SE +/- 0.094366471, N = 3SE +/- 0.043071403, N = 3SE +/- 0.416062930, N = 3SE +/- 0.063047733, N = 3157.08000000080.77000000040.9500000006.290000000147.54853119476.27000000038.3500000006.51000000083.53000000042.6800000006.62000000075.23000000039.1600000006.120000000

Apache Spark

Comparison (Row Count: 40000000 - Partitions: 500)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 40000000 - Partitions: 500)Broadcast Inner Join Test TimeInner Join Test TimeRepartition Test TimeGroup By Test TimeCalculate Pi Benchmark Using DataframeCalculate Pi BenchmarkSHA-512 Benchmark Time160320480640800SE +/- 0.85, N = 3SE +/- 0.39, N = 3SE +/- 0.58, N = 3SE +/- 4.05, N = 3SE +/- 0.36, N = 3SE +/- 4.60, N = 3SE +/- 0.55, N = 3SE +/- 0.76, N = 3SE +/- 1.02, N = 3SE +/- 0.84, N = 3SE +/- 1.17, N = 3SE +/- 0.09, N = 3SE +/- 0.55, N = 3SE +/- 1.56, N = 3SE +/- 0.10, N = 3SE +/- 6.99, N = 3SE +/- 0.26, N = 3SE +/- 0.11, N = 3SE +/- 0.86, N = 3SE +/- 0.48, N = 3157.08158.11138.0489.2331.96690.62183.20147.55152.21131.5382.3531.71579.01172.6933.77728.26189.3931.51580.30172.06

Apache Spark

Row Count Comparison (Partitions: 500 - Inner Join Test Time)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Inner Join Test Time)4000000020000000100000001000000306090120150SE +/- 0.391834664, N = 3SE +/- 0.747944666, N = 3SE +/- 0.391685283, N = 3SE +/- 0.103943425, N = 3SE +/- 1.021947894, N = 3SE +/- 0.097366593, N = 3SE +/- 0.324188438, N = 3SE +/- 0.043852959, N = 3SE +/- 0.562607380, N = 3SE +/- 0.422261678, N = 3SE +/- 0.056766652, N = 3SE +/- 0.488163973, N = 3SE +/- 0.798930107, N = 3SE +/- 0.517942458, N = 3158.11000000080.99000000042.5400000007.010000000152.20748539777.63000000040.2400000007.03000000083.84000000044.6800000007.26000000078.03000000042.4300000007.530000000

Apache Spark

Row Count Comparison (Partitions: 500 - Repartition Test Time)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Repartition Test Time)4000000020000000100000001000000306090120150SE +/- 0.575990239, N = 3SE +/- 0.119615928, N = 3SE +/- 0.263873750, N = 3SE +/- 0.076523207, N = 3SE +/- 0.835252655, N = 3SE +/- 0.310887433, N = 3SE +/- 0.254871419, N = 3SE +/- 0.069154351, N = 3SE +/- 0.150029474, N = 3SE +/- 0.579061882, N = 3SE +/- 0.037643391, N = 3SE +/- 0.840434214, N = 3SE +/- 1.074726167, N = 3SE +/- 0.101989022, N = 3138.04000000071.30000000038.2100000009.100000000131.53113267767.86000000036.4400000009.21000000073.22000000040.1600000009.46000000070.90000000038.9200000009.000000000

Apache Spark

Row Count Comparison (Partitions: 500 - Group By Test Time)

rk1-mainline-nvmerk1-rok-nvmerk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Group By Test Time)400000002000000010000000100000020406080100SE +/- 4.05, N = 3SE +/- 0.72, N = 3SE +/- 0.51, N = 3SE +/- 0.19, N = 3SE +/- 1.17, N = 3SE +/- 0.13, N = 3SE +/- 0.17, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.42, N = 3SE +/- 0.09, N = 3SE +/- 4.59, N = 3SE +/- 1.78, N = 3SE +/- 0.15, N = 389.2336.3722.379.9582.3535.9922.3810.0337.0023.2810.1339.2623.829.84

Apache Spark

Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark Using Dataframe)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark Using Dataframe)4000000020000000100000010000000816243240SE +/- 0.05, N = 3SE +/- 0.32, N = 3SE +/- 0.12, N = 4SE +/- 0.10, N = 3SE +/- 0.23, N = 3SE +/- 0.23, N = 3SE +/- 0.26, N = 3SE +/- 0.09, N = 3SE +/- 0.38, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.29, N = 3SE +/- 0.10, N = 3SE +/- 0.18, N = 3SE +/- 0.09, N = 5SE +/- 0.06, N = 333.6333.7333.7634.0232.0832.2432.1432.3531.5731.8131.8431.4931.7931.6231.6331.97

Apache Spark

Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark Using Dataframe)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark Using Dataframe)10050010002000816243240SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.22, N = 3SE +/- 0.06, N = 3SE +/- 0.23, N = 3SE +/- 0.36, N = 3SE +/- 0.16, N = 3SE +/- 0.31, N = 3SE +/- 0.38, N = 3SE +/- 0.11, N = 3SE +/- 0.16, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.14, N = 333.6333.7733.5133.7932.0831.9632.4032.2031.5731.5131.5431.6531.7931.7131.6131.32

Apache Spark

Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - Calculate Pi Benchmark)4000000020000000100000010000000160320480640800SE +/- 8.88, N = 3SE +/- 8.94, N = 3SE +/- 9.68, N = 4SE +/- 3.83, N = 3SE +/- 1.80, N = 3SE +/- 8.48, N = 3SE +/- 1.77, N = 3SE +/- 7.97, N = 3SE +/- 0.87, N = 3SE +/- 1.38, N = 3SE +/- 1.54, N = 3SE +/- 1.47, N = 3SE +/- 0.68, N = 3SE +/- 3.74, N = 3SE +/- 0.46, N = 5SE +/- 0.70, N = 3724.99713.91727.52722.90694.62694.61694.41681.48579.98580.52581.45581.85581.19582.87581.85580.29

Apache Spark

Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - Calculate Pi Benchmark)10050010002000160320480640800SE +/- 8.88, N = 3SE +/- 6.99, N = 3SE +/- 14.94, N = 3SE +/- 16.56, N = 3SE +/- 1.80, N = 3SE +/- 4.60, N = 3SE +/- 6.51, N = 3SE +/- 8.50, N = 3SE +/- 0.87, N = 3SE +/- 0.86, N = 3SE +/- 0.56, N = 3SE +/- 0.49, N = 3SE +/- 0.68, N = 3SE +/- 0.55, N = 3SE +/- 1.66, N = 3SE +/- 1.28, N = 3724.99728.26721.00710.71694.62690.62697.90695.17579.98580.30581.69580.86581.19579.01581.60579.55

Apache Spark

Row Count Comparison (Partitions: 100 - SHA-512 Benchmark Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 100 - SHA-512 Benchmark Time)40000000200000001000000100000004080120160200SE +/- 0.34, N = 3SE +/- 0.22, N = 3SE +/- 0.11, N = 4SE +/- 0.32, N = 3SE +/- 0.84, N = 3SE +/- 0.34, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.58, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.82, N = 3SE +/- 0.67, N = 3SE +/- 0.10, N = 5SE +/- 0.39, N = 3195.4596.6810.0157.05190.0393.799.5055.28177.8188.819.3452.69178.8989.489.5652.88

Apache Spark

Partitions Comparison (Row Count: 40000000 - - SHA-512 Benchmark Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 40000000 - - SHA-512 Benchmark Time)100500100020004080120160200SE +/- 0.34, N = 3SE +/- 0.26, N = 3SE +/- 0.54, N = 3SE +/- 0.40, N = 3SE +/- 0.84, N = 3SE +/- 0.55, N = 3SE +/- 0.13, N = 3SE +/- 0.21, N = 3SE +/- 0.58, N = 3SE +/- 0.48, N = 3SE +/- 0.77, N = 3SE +/- 0.42, N = 3SE +/- 0.82, N = 3SE +/- 1.56, N = 3SE +/- 0.48, N = 3SE +/- 0.47, N = 3195.45189.39189.73192.81190.03183.20183.35185.51177.81172.06172.45175.84178.89172.69172.19175.24

Apache Spark

Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark Using Dataframe)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark Using Dataframe)4000000020000000100000001000000816243240SE +/- 0.10, N = 3SE +/- 0.25, N = 3SE +/- 0.13, N = 3SE +/- 0.16, N = 3SE +/- 0.36, N = 3SE +/- 0.22, N = 3SE +/- 0.05, N = 3SE +/- 0.16, N = 3SE +/- 0.11, N = 3SE +/- 0.15, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 333.7733.7233.8933.7631.9631.8432.1732.2731.5131.7631.7931.7931.7131.7431.8131.72

Apache Spark

Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - Calculate Pi Benchmark)4000000020000000100000001000000160320480640800SE +/- 6.99, N = 3SE +/- 17.41, N = 3SE +/- 3.66, N = 3SE +/- 10.10, N = 3SE +/- 4.60, N = 3SE +/- 4.56, N = 3SE +/- 3.78, N = 3SE +/- 3.62, N = 3SE +/- 0.86, N = 3SE +/- 0.79, N = 3SE +/- 1.02, N = 3SE +/- 0.64, N = 3SE +/- 0.55, N = 3SE +/- 0.67, N = 3SE +/- 0.62, N = 3SE +/- 1.70, N = 3728.26714.05692.06733.90690.62683.57684.23685.12580.30581.12579.55580.99579.01583.11581.78579.16

Apache Spark

Row Count Comparison (Partitions: 500 - SHA-512 Benchmark Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 500 - SHA-512 Benchmark Time)40000000200000001000000010000004080120160200SE +/- 0.260000987, N = 3SE +/- 0.307771793, N = 3SE +/- 0.109148903, N = 3SE +/- 0.075456756, N = 3SE +/- 0.553867494, N = 3SE +/- 0.105154004, N = 3SE +/- 0.088475323, N = 3SE +/- 0.073904401, N = 3SE +/- 0.477080995, N = 3SE +/- 0.160687224, N = 3SE +/- 0.112654588, N = 3SE +/- 0.026873455, N = 3SE +/- 1.561648800, N = 3SE +/- 0.331996595, N = 3SE +/- 0.195921788, N = 3SE +/- 0.114204323, N = 3189.39000000099.64000000052.62000000011.230000000183.20000000096.85000000050.73000000010.430000000172.06000000090.56000000047.8700000009.890000000172.69004833191.24000000048.84000000010.480000000

Apache Spark

Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark Using Dataframe)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark Using Dataframe)4000000020000000100000001000000816243240SE +/- 0.22, N = 3SE +/- 0.19, N = 3SE +/- 0.18, N = 3SE +/- 0.08, N = 3SE +/- 0.16, N = 3SE +/- 0.15, N = 3SE +/- 0.32, N = 3SE +/- 0.10, N = 3SE +/- 0.16, N = 3SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 4SE +/- 0.10, N = 3SE +/- 0.32, N = 3SE +/- 0.26, N = 3SE +/- 0.08, N = 333.5133.8134.0033.3932.4032.0532.2432.3631.5431.7531.6631.8831.6131.2231.3631.54

Apache Spark

Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - Calculate Pi Benchmark)4000000020000000100000001000000160320480640800SE +/- 14.94, N = 3SE +/- 11.19, N = 3SE +/- 5.58, N = 3SE +/- 1.88, N = 3SE +/- 6.51, N = 3SE +/- 2.66, N = 3SE +/- 4.78, N = 3SE +/- 1.43, N = 3SE +/- 0.56, N = 3SE +/- 0.66, N = 3SE +/- 1.40, N = 3SE +/- 0.54, N = 4SE +/- 1.66, N = 3SE +/- 1.10, N = 3SE +/- 0.29, N = 3SE +/- 2.32, N = 3721.00722.93722.36717.10697.90687.06690.24695.32581.69579.19580.37580.24581.60580.24580.46583.50

Apache Spark

Row Count Comparison (Partitions: 1000 - SHA-512 Benchmark Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 1000 - SHA-512 Benchmark Time)40000000200000001000000010000004080120160200SE +/- 0.54, N = 3SE +/- 0.20, N = 3SE +/- 0.22, N = 3SE +/- 0.14, N = 3SE +/- 0.13, N = 3SE +/- 0.20, N = 3SE +/- 0.11, N = 3SE +/- 0.09, N = 3SE +/- 0.77, N = 3SE +/- 0.29, N = 3SE +/- 0.15, N = 3SE +/- 0.12, N = 4SE +/- 0.48, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3189.73100.7353.5211.38183.3595.9251.6411.18172.4591.3949.2110.78172.1992.4249.4511.14

Apache Spark

Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark Using Dataframe)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark Using Dataframe)4000000010000002000000010000000816243240SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.14, N = 3SE +/- 0.31, N = 3SE +/- 0.23, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 3SE +/- 0.09, N = 9SE +/- 0.10, N = 3SE +/- 0.14, N = 3SE +/- 0.14, N = 3SE +/- 0.12, N = 3SE +/- 0.15, N = 3SE +/- 0.04, N = 333.7933.7933.9133.9632.2032.0332.2131.9231.6531.5631.6131.6631.3231.6831.6631.58

Apache Spark

Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - Calculate Pi Benchmark)4000000010000002000000010000000160320480640800SE +/- 16.56, N = 3SE +/- 5.14, N = 3SE +/- 22.40, N = 3SE +/- 13.31, N = 3SE +/- 8.50, N = 3SE +/- 8.22, N = 3SE +/- 2.10, N = 3SE +/- 6.18, N = 3SE +/- 0.49, N = 3SE +/- 0.47, N = 9SE +/- 1.08, N = 3SE +/- 0.41, N = 3SE +/- 1.28, N = 3SE +/- 0.55, N = 3SE +/- 0.28, N = 3SE +/- 0.51, N = 3710.71733.77723.32711.60695.17690.63681.91699.96580.86580.68579.87581.17579.55582.61581.10577.92

Apache Spark

Row Count Comparison (Partitions: 2000 - SHA-512 Benchmark Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count Comparison (Partitions: 2000 - SHA-512 Benchmark Time)40000000100000020000000100000004080120160200SE +/- 0.40, N = 3SE +/- 0.14, N = 3SE +/- 0.14, N = 3SE +/- 0.39, N = 3SE +/- 0.21, N = 3SE +/- 0.11, N = 3SE +/- 0.37, N = 3SE +/- 0.34, N = 3SE +/- 0.42, N = 3SE +/- 0.12, N = 9SE +/- 0.02, N = 3SE +/- 0.36, N = 3SE +/- 0.47, N = 3SE +/- 0.11, N = 3SE +/- 0.11, N = 3SE +/- 0.24, N = 3192.8112.96101.1555.17185.5112.5597.6553.04175.8412.6391.9650.80175.2412.8892.1951.09

Apache Spark

Partitions Comparison (Row Count: 1000000 - - Broadcast Inner Join Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Broadcast Inner Join Test Time)20001001000500246810SE +/- 0.18, N = 3SE +/- 0.09, N = 4SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.01, N = 3SE +/- 0.10, N = 3SE +/- 0.12, N = 3SE +/- 0.10, N = 3SE +/- 0.13, N = 9SE +/- 0.08, N = 3SE +/- 0.06, N = 4SE +/- 0.06, N = 3SE +/- 0.27, N = 3SE +/- 0.07, N = 5SE +/- 0.06, N = 3SE +/- 0.49, N = 38.585.727.296.628.045.696.996.298.375.506.906.128.415.457.056.51

Apache Spark

Comparison (Row Count: 1000000 - Partitions: 2000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 1000000 - Partitions: 2000)Broadcast Inner Join Test TimeInner Join Test TimeRepartition Test TimeGroup By Test TimeCalculate Pi Benchmark Using DataframeCalculate Pi BenchmarkSHA-512 Benchmark Time160320480640800SE +/- 0.177939327, N = 3SE +/- 0.098619535, N = 3SE +/- 0.181687585, N = 3SE +/- 0.146972816, N = 3SE +/- 0.013599313, N = 3SE +/- 5.138863712, N = 3SE +/- 0.139768323, N = 3SE +/- 0.011049874, N = 3SE +/- 0.094249006, N = 3SE +/- 0.042552140, N = 3SE +/- 0.090717982, N = 3SE +/- 0.230080533, N = 3SE +/- 8.221686317, N = 3SE +/- 0.112867497, N = 3SE +/- 0.128969955, N = 9SE +/- 0.501143304, N = 9SE +/- 0.039688685, N = 9SE +/- 0.134671941, N = 9SE +/- 0.090240232, N = 9SE +/- 0.468273880, N = 9SE +/- 0.121232499, N = 9SE +/- 0.269877699, N = 3SE +/- 0.401879123, N = 3SE +/- 0.155773144, N = 3SE +/- 0.230601906, N = 3SE +/- 0.123827132, N = 3SE +/- 0.548006604, N = 3SE +/- 0.113414449, N = 38.58000000010.69000000011.01000000013.02000000033.790000000733.77000000012.9600000008.04000000010.68000000010.71000000012.86000000032.030000000690.63000000012.5500000008.37000000011.06000000010.57000000012.83000000031.560000000580.68000000012.6300000008.41000000010.89000000010.85000000013.31000000031.680000000582.61489470712.880000000

Apache Spark

Partitions Comparison (Row Count: 1000000 - - Inner Join Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Inner Join Test Time)200010010005003691215SE +/- 0.10, N = 3SE +/- 0.13, N = 4SE +/- 0.11, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.50, N = 9SE +/- 0.29, N = 3SE +/- 0.63, N = 4SE +/- 0.52, N = 3SE +/- 0.40, N = 3SE +/- 0.04, N = 5SE +/- 0.11, N = 3SE +/- 0.04, N = 310.696.598.337.2610.686.258.017.0111.066.548.637.5310.896.047.817.03

Apache Spark

Partitions Comparison (Row Count: 1000000 - - Repartition Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Repartition Test Time)200010010005003691215SE +/- 0.18, N = 3SE +/- 0.03, N = 4SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 9SE +/- 0.07, N = 3SE +/- 0.07, N = 4SE +/- 0.10, N = 3SE +/- 0.16, N = 3SE +/- 0.03, N = 5SE +/- 0.18, N = 3SE +/- 0.07, N = 311.019.0810.069.4610.718.7910.059.1010.578.629.749.0010.858.759.959.21

Apache Spark

Partitions Comparison (Row Count: 1000000 - - Group By Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Group By Test Time)200010010005003691215SE +/- 0.15, N = 3SE +/- 0.02, N = 4SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.02, N = 3SE +/- 0.19, N = 3SE +/- 0.13, N = 9SE +/- 0.13, N = 3SE +/- 0.08, N = 4SE +/- 0.15, N = 3SE +/- 0.23, N = 3SE +/- 0.08, N = 5SE +/- 0.09, N = 3SE +/- 0.09, N = 313.029.0711.3910.1312.868.8111.109.9512.838.7510.939.8413.319.0911.1810.03

Apache Spark

Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark Using Dataframe)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark Using Dataframe)20001001000500816243240SE +/- 0.01, N = 3SE +/- 0.12, N = 4SE +/- 0.08, N = 3SE +/- 0.16, N = 3SE +/- 0.23, N = 3SE +/- 0.26, N = 3SE +/- 0.10, N = 3SE +/- 0.16, N = 3SE +/- 0.09, N = 9SE +/- 0.04, N = 3SE +/- 0.05, N = 4SE +/- 0.02, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 5SE +/- 0.08, N = 3SE +/- 0.02, N = 333.7933.7633.3933.7632.0332.1432.3632.2731.5631.8431.8831.7931.6831.6331.5431.72

Apache Spark

Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - Calculate Pi Benchmark)20001001000500160320480640800SE +/- 5.14, N = 3SE +/- 9.68, N = 4SE +/- 1.88, N = 3SE +/- 10.10, N = 3SE +/- 8.22, N = 3SE +/- 1.77, N = 3SE +/- 1.43, N = 3SE +/- 3.62, N = 3SE +/- 0.47, N = 9SE +/- 1.54, N = 3SE +/- 0.54, N = 4SE +/- 0.64, N = 3SE +/- 0.55, N = 3SE +/- 0.46, N = 5SE +/- 2.32, N = 3SE +/- 1.70, N = 3733.77727.52717.10733.90690.63694.41695.32685.12580.68581.45580.24580.99582.61581.85583.50579.16

Apache Spark

Partitions Comparison (Row Count: 1000000 - - SHA-512 Benchmark Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 1000000 - - SHA-512 Benchmark Time)200010010005003691215SE +/- 0.14, N = 3SE +/- 0.11, N = 4SE +/- 0.14, N = 3SE +/- 0.08, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 9SE +/- 0.09, N = 3SE +/- 0.12, N = 4SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 5SE +/- 0.01, N = 3SE +/- 0.11, N = 312.9610.0111.3811.2312.559.5011.1810.4312.639.3410.789.8912.889.5611.1410.48

Apache Spark

Partitions Comparison (Row Count: 20000000 - - Broadcast Inner Join Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Broadcast Inner Join Test Time)2000100050010020406080100SE +/- 0.57, N = 3SE +/- 0.51, N = 3SE +/- 0.30, N = 3SE +/- 0.19, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.49, N = 3SE +/- 0.43, N = 3SE +/- 0.89, N = 3SE +/- 0.20, N = 3SE +/- 0.73, N = 3SE +/- 0.55, N = 3SE +/- 0.83, N = 3SE +/- 0.04, N = 3SE +/- 0.59, N = 383.9484.0183.5382.0381.2580.6480.7779.2177.5676.6676.2774.6075.9675.2373.60

Apache Spark

Comparison (Row Count: 20000000 - Partitions: 2000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 20000000 - Partitions: 2000)Broadcast Inner Join Test TimeInner Join Test TimeRepartition Test TimeGroup By Test TimeCalculate Pi Benchmark Using DataframeCalculate Pi BenchmarkSHA-512 Benchmark Time160320480640800SE +/- 0.57, N = 3SE +/- 0.28, N = 3SE +/- 0.46, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 22.40, N = 3SE +/- 0.14, N = 3SE +/- 0.08, N = 3SE +/- 0.31, N = 3SE +/- 0.20, N = 3SE +/- 0.46, N = 3SE +/- 0.09, N = 3SE +/- 2.10, N = 3SE +/- 0.37, N = 3SE +/- 0.89, N = 3SE +/- 0.05, N = 3SE +/- 0.14, N = 3SE +/- 0.41, N = 3SE +/- 0.15, N = 3SE +/- 0.28, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 1.08, N = 3SE +/- 0.02, N = 383.9486.4375.4437.3533.91723.32101.1581.2583.6472.2836.7232.21681.9197.6577.5680.4169.0937.1631.66581.1092.1931.61579.8791.96

Apache Spark

Partitions Comparison (Row Count: 20000000 - - Inner Join Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Inner Join Test Time)2000100050010020406080100SE +/- 0.28, N = 3SE +/- 0.32, N = 3SE +/- 0.56, N = 3SE +/- 0.57, N = 3SE +/- 0.31, N = 3SE +/- 0.42, N = 3SE +/- 0.75, N = 3SE +/- 0.32, N = 3SE +/- 0.05, N = 3SE +/- 0.52, N = 3SE +/- 0.10, N = 3SE +/- 0.48, N = 3SE +/- 0.86, N = 3SE +/- 0.49, N = 3SE +/- 1.13, N = 386.4385.1283.8483.9883.6481.3580.9980.9080.4179.2977.6376.8778.4278.0375.68

Apache Spark

Partitions Comparison (Row Count: 20000000 - - Repartition Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Repartition Test Time)2000100050010020406080100SE +/- 0.46, N = 3SE +/- 0.23, N = 3SE +/- 0.15, N = 3SE +/- 0.55, N = 3SE +/- 0.20, N = 3SE +/- 0.23, N = 3SE +/- 0.12, N = 3SE +/- 0.33, N = 3SE +/- 0.14, N = 3SE +/- 0.20, N = 3SE +/- 0.31, N = 3SE +/- 0.15, N = 3SE +/- 1.03, N = 3SE +/- 0.84, N = 3SE +/- 2.01, N = 375.4475.1873.2274.3272.2871.7071.3071.5969.0968.5467.8668.1272.9870.9072.35

Apache Spark

Partitions Comparison (Row Count: 20000000 - - Group By Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-nvmerk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Group By Test Time)20001000500100918273645SE +/- 0.10, N = 3SE +/- 0.79, N = 3SE +/- 0.10, N = 3SE +/- 0.45, N = 3SE +/- 0.46, N = 3SE +/- 0.15, N = 3SE +/- 0.72, N = 3SE +/- 0.32, N = 3SE +/- 0.41, N = 3SE +/- 0.44, N = 3SE +/- 0.13, N = 3SE +/- 0.47, N = 3SE +/- 2.03, N = 3SE +/- 4.59, N = 3SE +/- 0.73, N = 337.3537.3137.0037.1136.7235.2736.3735.5137.1634.7035.9934.4135.8339.2634.66

Apache Spark

Comparison (Row Count: 20000000 - Partitions: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 20000000 - Partitions: 1000)Broadcast Inner Join Test TimeInner Join Test TimeRepartition Test TimeGroup By Test TimeCalculate Pi Benchmark Using DataframeCalculate Pi BenchmarkSHA-512 Benchmark Time160320480640800SE +/- 0.51, N = 3SE +/- 0.32, N = 3SE +/- 0.23, N = 3SE +/- 0.79, N = 3SE +/- 0.19, N = 3SE +/- 11.19, N = 3SE +/- 0.20, N = 3SE +/- 0.09, N = 3SE +/- 0.42, N = 3SE +/- 0.23, N = 3SE +/- 0.15, N = 3SE +/- 0.15, N = 3SE +/- 2.66, N = 3SE +/- 0.20, N = 3SE +/- 0.83, N = 3SE +/- 0.86, N = 3SE +/- 1.03, N = 3SE +/- 2.03, N = 3SE +/- 0.14, N = 3SE +/- 0.66, N = 3SE +/- 0.29, N = 3SE +/- 0.20, N = 3SE +/- 0.52, N = 3SE +/- 0.20, N = 3SE +/- 0.44, N = 3SE +/- 0.32, N = 3SE +/- 1.10, N = 3SE +/- 0.10, N = 384.0185.1275.1837.3133.81722.93100.7380.6481.3571.7035.2732.05687.0695.9275.9678.4272.9835.8331.75579.1991.3976.6679.2968.5434.7031.22580.2492.42

Apache Spark

Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark Using Dataframe)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark Using Dataframe)10005001002000816243240SE +/- 0.19, N = 3SE +/- 0.25, N = 3SE +/- 0.32, N = 3SE +/- 0.11, N = 3SE +/- 0.15, N = 3SE +/- 0.22, N = 3SE +/- 0.23, N = 3SE +/- 0.09, N = 3SE +/- 0.14, N = 3SE +/- 0.15, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.32, N = 3SE +/- 0.10, N = 3SE +/- 0.18, N = 3SE +/- 0.15, N = 333.8133.7233.7333.9132.0531.8432.2432.2131.7531.7631.8131.6131.2231.7431.6231.66

Apache Spark

Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - Calculate Pi Benchmark)10005001002000160320480640800SE +/- 11.19, N = 3SE +/- 17.41, N = 3SE +/- 8.94, N = 3SE +/- 22.40, N = 3SE +/- 2.66, N = 3SE +/- 4.56, N = 3SE +/- 8.48, N = 3SE +/- 2.10, N = 3SE +/- 0.66, N = 3SE +/- 0.79, N = 3SE +/- 1.38, N = 3SE +/- 1.08, N = 3SE +/- 1.10, N = 3SE +/- 0.67, N = 3SE +/- 3.74, N = 3SE +/- 0.28, N = 3722.93714.05713.91723.32687.06683.57694.61681.91579.19581.12580.52579.87580.24583.11582.87581.10

Apache Spark

Partitions Comparison (Row Count: 20000000 - - SHA-512 Benchmark Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 20000000 - - SHA-512 Benchmark Time)1000500100200020406080100SE +/- 0.20, N = 3SE +/- 0.31, N = 3SE +/- 0.22, N = 3SE +/- 0.14, N = 3SE +/- 0.20, N = 3SE +/- 0.11, N = 3SE +/- 0.34, N = 3SE +/- 0.37, N = 3SE +/- 0.29, N = 3SE +/- 0.16, N = 3SE +/- 0.12, N = 3SE +/- 0.02, N = 3SE +/- 0.10, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.11, N = 3100.7399.6496.68101.1595.9296.8593.7997.6591.3990.5688.8191.9692.4291.2489.4892.19

Apache Spark

Comparison (Row Count: 20000000 - Partitions: 500)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 20000000 - Partitions: 500)Broadcast Inner Join Test TimeInner Join Test TimeRepartition Test TimeGroup By Test TimeCalculate Pi Benchmark Using DataframeCalculate Pi BenchmarkSHA-512 Benchmark Time150300450600750SE +/- 0.30, N = 3SE +/- 0.56, N = 3SE +/- 0.15, N = 3SE +/- 0.10, N = 3SE +/- 0.25, N = 3SE +/- 17.41, N = 3SE +/- 0.31, N = 3SE +/- 0.49, N = 3SE +/- 0.75, N = 3SE +/- 0.12, N = 3SE +/- 0.72, N = 3SE +/- 0.22, N = 3SE +/- 4.56, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.49, N = 3SE +/- 0.84, N = 3SE +/- 4.59, N = 3SE +/- 0.15, N = 3SE +/- 0.79, N = 3SE +/- 0.16, N = 3SE +/- 0.73, N = 3SE +/- 0.10, N = 3SE +/- 0.31, N = 3SE +/- 0.13, N = 3SE +/- 0.10, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 383.5383.8473.2237.0033.72714.0599.6480.7780.9971.3036.3731.84683.5796.8575.2378.0370.9039.2631.76581.1290.5676.2777.6367.8635.9931.74583.1191.24

Apache Spark

Comparison (Row Count: 20000000 - Partitions: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 20000000 - Partitions: 100)Broadcast Inner Join Test TimeInner Join Test TimeRepartition Test TimeGroup By Test TimeCalculate Pi Benchmark Using DataframeCalculate Pi BenchmarkSHA-512 Benchmark Time150300450600750SE +/- 0.19, N = 3SE +/- 0.57, N = 3SE +/- 0.55, N = 3SE +/- 0.45, N = 3SE +/- 0.32, N = 3SE +/- 8.94, N = 3SE +/- 0.22, N = 3SE +/- 0.43, N = 3SE +/- 0.32, N = 3SE +/- 0.33, N = 3SE +/- 0.32, N = 3SE +/- 0.23, N = 3SE +/- 8.48, N = 3SE +/- 0.34, N = 3SE +/- 0.59, N = 3SE +/- 1.13, N = 3SE +/- 2.01, N = 3SE +/- 0.73, N = 3SE +/- 0.07, N = 3SE +/- 1.38, N = 3SE +/- 0.12, N = 3SE +/- 0.55, N = 3SE +/- 0.48, N = 3SE +/- 0.15, N = 3SE +/- 0.47, N = 3SE +/- 0.18, N = 3SE +/- 3.74, N = 3SE +/- 0.67, N = 382.0383.9874.3237.1133.73713.9196.6879.2180.9071.5935.5132.24694.6193.7973.6075.6872.3534.6631.81580.5288.8174.6076.8768.1234.4131.62582.8789.48

Apache Spark

Comparison (Row Count: 1000000 - Partitions: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 1000000 - Partitions: 100)Broadcast Inner Join Test TimeInner Join Test TimeRepartition Test TimeGroup By Test TimeCalculate Pi Benchmark Using DataframeCalculate Pi BenchmarkSHA-512 Benchmark Time160320480640800SE +/- 0.085253143, N = 4SE +/- 0.134671456, N = 4SE +/- 0.025356347, N = 4SE +/- 0.023541873, N = 4SE +/- 0.122562063, N = 4SE +/- 9.681628257, N = 4SE +/- 0.113137090, N = 4SE +/- 0.102452612, N = 3SE +/- 0.004165140, N = 3SE +/- 0.084920457, N = 3SE +/- 0.129389851, N = 3SE +/- 0.257940983, N = 3SE +/- 1.768265132, N = 3SE +/- 0.038555282, N = 3SE +/- 0.076264083, N = 3SE +/- 0.294062371, N = 3SE +/- 0.070931558, N = 3SE +/- 0.130013375, N = 3SE +/- 0.039099097, N = 3SE +/- 1.541717417, N = 3SE +/- 0.093919752, N = 3SE +/- 0.069228259, N = 5SE +/- 0.044993077, N = 5SE +/- 0.034264151, N = 5SE +/- 0.081615689, N = 5SE +/- 0.089037280, N = 5SE +/- 0.461842438, N = 5SE +/- 0.101368246, N = 55.7200000006.5900000009.0800000009.07000000033.760000000727.52000000010.0100000005.6900000006.2500000008.7900000008.81000000032.140000000694.4100000009.5000000005.5000000006.5400000008.6200000008.75000000031.840000000581.4500000009.3400000005.4500000006.0400000008.7500000009.09000000031.630000000581.8522107859.560000000

Apache Spark

Partitions Comparison (Row Count: 10000000 - - Broadcast Inner Join Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Broadcast Inner Join Test Time)100200010005001122334455SE +/- 0.25, N = 3SE +/- 0.27, N = 3SE +/- 0.09, N = 3SE +/- 0.24, N = 3SE +/- 0.71, N = 3SE +/- 0.28, N = 3SE +/- 0.16, N = 3SE +/- 0.24, N = 3SE +/- 0.62, N = 3SE +/- 0.24, N = 3SE +/- 1.25, N = 3SE +/- 0.42, N = 3SE +/- 0.21, N = 3SE +/- 0.13, N = 3SE +/- 0.36, N = 3SE +/- 0.45, N = 347.1044.5943.4742.6844.2642.9041.9840.9543.1940.9340.9039.1642.8541.1639.2238.35

Apache Spark

Comparison (Row Count: 10000000 - Partitions: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 10000000 - Partitions: 100)Broadcast Inner Join Test TimeInner Join Test TimeRepartition Test TimeGroup By Test TimeCalculate Pi Benchmark Using DataframeCalculate Pi BenchmarkSHA-512 Benchmark Time160320480640800SE +/- 0.25, N = 3SE +/- 0.26, N = 3SE +/- 0.56, N = 3SE +/- 0.30, N = 3SE +/- 0.10, N = 3SE +/- 3.83, N = 3SE +/- 0.32, N = 3SE +/- 0.71, N = 3SE +/- 0.12, N = 3SE +/- 0.18, N = 3SE +/- 0.25, N = 3SE +/- 0.09, N = 3SE +/- 7.97, N = 3SE +/- 0.14, N = 3SE +/- 0.62, N = 3SE +/- 1.64, N = 3SE +/- 0.76, N = 3SE +/- 3.06, N = 3SE +/- 0.29, N = 3SE +/- 1.47, N = 3SE +/- 0.05, N = 3SE +/- 0.21, N = 3SE +/- 1.37, N = 3SE +/- 0.43, N = 3SE +/- 0.24, N = 3SE +/- 0.06, N = 3SE +/- 0.70, N = 3SE +/- 0.39, N = 347.1047.5241.2825.0534.02722.9057.0544.2643.5838.2923.5032.35681.4855.2843.1943.8838.5826.6231.49581.8552.6942.8543.7137.0723.9031.97580.2952.88

Apache Spark

Partitions Comparison (Row Count: 10000000 - - Inner Join Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Inner Join Test Time)100200010005001122334455SE +/- 0.26, N = 3SE +/- 0.21, N = 3SE +/- 0.40, N = 3SE +/- 0.42, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.39, N = 3SE +/- 1.64, N = 3SE +/- 1.45, N = 3SE +/- 0.56, N = 3SE +/- 0.80, N = 3SE +/- 1.37, N = 3SE +/- 0.15, N = 3SE +/- 0.21, N = 3SE +/- 0.32, N = 347.5247.6745.6044.6843.5845.7444.0042.5443.8847.6143.3042.4343.7144.2341.4940.24

Apache Spark

Partitions Comparison (Row Count: 10000000 - - Repartition Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Repartition Test Time)10020001000500918273645SE +/- 0.56, N = 3SE +/- 0.03, N = 3SE +/- 0.23, N = 3SE +/- 0.58, N = 3SE +/- 0.18, N = 3SE +/- 0.21, N = 3SE +/- 0.22, N = 3SE +/- 0.26, N = 3SE +/- 0.76, N = 3SE +/- 0.66, N = 3SE +/- 0.54, N = 3SE +/- 1.07, N = 3SE +/- 0.43, N = 3SE +/- 0.08, N = 3SE +/- 0.31, N = 3SE +/- 0.25, N = 341.2840.5039.9640.1638.2939.2238.6138.2138.5839.3339.3138.9237.0737.9436.7236.44

Apache Spark

Partitions Comparison (Row Count: 10000000 - - Group By Test Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Group By Test Time)10020001000500612182430SE +/- 0.30, N = 3SE +/- 0.28, N = 3SE +/- 0.35, N = 3SE +/- 0.42, N = 3SE +/- 0.25, N = 3SE +/- 0.13, N = 3SE +/- 0.28, N = 3SE +/- 0.51, N = 3SE +/- 3.06, N = 3SE +/- 0.22, N = 3SE +/- 0.36, N = 3SE +/- 1.78, N = 3SE +/- 0.24, N = 3SE +/- 0.39, N = 3SE +/- 0.20, N = 3SE +/- 0.17, N = 325.0524.8523.8923.2823.5024.0922.2922.3726.6224.1022.4423.8223.9024.1322.6222.38

Apache Spark

Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark Using Dataframe)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark Using Dataframe)10020001000500816243240SE +/- 0.10, N = 3SE +/- 0.14, N = 3SE +/- 0.18, N = 3SE +/- 0.13, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 0.32, N = 3SE +/- 0.05, N = 3SE +/- 0.29, N = 3SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.11, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.26, N = 3SE +/- 0.05, N = 334.0233.9634.0033.8932.3531.9232.2432.1731.4931.6631.6631.7931.9731.5831.3631.81

Apache Spark

Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - Calculate Pi Benchmark)10020001000500160320480640800SE +/- 3.83, N = 3SE +/- 13.31, N = 3SE +/- 5.58, N = 3SE +/- 3.66, N = 3SE +/- 7.97, N = 3SE +/- 6.18, N = 3SE +/- 4.78, N = 3SE +/- 3.78, N = 3SE +/- 1.47, N = 3SE +/- 0.41, N = 3SE +/- 1.40, N = 3SE +/- 1.02, N = 3SE +/- 0.70, N = 3SE +/- 0.51, N = 3SE +/- 0.29, N = 3SE +/- 0.62, N = 3722.90711.60722.36692.06681.48699.96690.24684.23581.85581.17580.37579.55580.29577.92580.46581.78

Apache Spark

Partitions Comparison (Row Count: 10000000 - - SHA-512 Benchmark Time)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Partitions Comparison (Row Count: 10000000 - - SHA-512 Benchmark Time)100200010005001326395265SE +/- 0.32, N = 3SE +/- 0.39, N = 3SE +/- 0.22, N = 3SE +/- 0.11, N = 3SE +/- 0.14, N = 3SE +/- 0.34, N = 3SE +/- 0.11, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.36, N = 3SE +/- 0.15, N = 3SE +/- 0.11, N = 3SE +/- 0.39, N = 3SE +/- 0.24, N = 3SE +/- 0.05, N = 3SE +/- 0.20, N = 357.0555.1753.5252.6255.2853.0451.6450.7352.6950.8049.2147.8752.8851.0949.4548.84

Apache Spark

Comparison (Row Count: 10000000 - Partitions: 2000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 10000000 - Partitions: 2000)Broadcast Inner Join Test TimeInner Join Test TimeRepartition Test TimeGroup By Test TimeCalculate Pi Benchmark Using DataframeCalculate Pi BenchmarkSHA-512 Benchmark Time150300450600750SE +/- 0.27, N = 3SE +/- 0.21, N = 3SE +/- 0.03, N = 3SE +/- 0.28, N = 3SE +/- 0.14, N = 3SE +/- 13.31, N = 3SE +/- 0.39, N = 3SE +/- 0.28, N = 3SE +/- 0.04, N = 3SE +/- 0.21, N = 3SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 6.18, N = 3SE +/- 0.34, N = 3SE +/- 0.24, N = 3SE +/- 1.45, N = 3SE +/- 0.66, N = 3SE +/- 0.22, N = 3SE +/- 0.14, N = 3SE +/- 0.41, N = 3SE +/- 0.36, N = 3SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 3SE +/- 0.39, N = 3SE +/- 0.04, N = 3SE +/- 0.51, N = 3SE +/- 0.24, N = 344.5947.6740.5024.8533.96711.6055.1742.9045.7439.2224.0931.92699.9653.0440.9347.6139.3324.1031.66581.1750.8041.1644.2337.9424.1331.58577.9251.09

Apache Spark

Comparison (Row Count: 10000000 - Partitions: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 10000000 - Partitions: 1000)Broadcast Inner Join Test TimeInner Join Test TimeRepartition Test TimeGroup By Test TimeCalculate Pi Benchmark Using DataframeCalculate Pi BenchmarkSHA-512 Benchmark Time160320480640800SE +/- 0.09, N = 3SE +/- 0.40, N = 3SE +/- 0.23, N = 3SE +/- 0.35, N = 3SE +/- 0.18, N = 3SE +/- 5.58, N = 3SE +/- 0.22, N = 3SE +/- 0.16, N = 3SE +/- 0.14, N = 3SE +/- 0.22, N = 3SE +/- 0.28, N = 3SE +/- 0.32, N = 3SE +/- 4.78, N = 3SE +/- 0.11, N = 3SE +/- 1.25, N = 3SE +/- 0.56, N = 3SE +/- 0.54, N = 3SE +/- 0.36, N = 3SE +/- 0.04, N = 3SE +/- 1.40, N = 3SE +/- 0.15, N = 3SE +/- 0.36, N = 3SE +/- 0.21, N = 3SE +/- 0.31, N = 3SE +/- 0.20, N = 3SE +/- 0.26, N = 3SE +/- 0.29, N = 3SE +/- 0.05, N = 343.4745.6039.9623.8934.00722.3653.5241.9844.0038.6122.2932.24690.2451.6440.9043.3039.3122.4431.66580.3749.2139.2241.4936.7222.6231.36580.4649.45

Apache Spark

Comparison (Row Count: 10000000 - Partitions: 500)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 10000000 - Partitions: 500)Broadcast Inner Join Test TimeInner Join Test TimeRepartition Test TimeGroup By Test TimeCalculate Pi Benchmark Using DataframeCalculate Pi BenchmarkSHA-512 Benchmark Time150300450600750SE +/- 0.24, N = 3SE +/- 0.42, N = 3SE +/- 0.58, N = 3SE +/- 0.42, N = 3SE +/- 0.13, N = 3SE +/- 3.66, N = 3SE +/- 0.11, N = 3SE +/- 0.24, N = 3SE +/- 0.39, N = 3SE +/- 0.26, N = 3SE +/- 0.51, N = 3SE +/- 0.05, N = 3SE +/- 3.78, N = 3SE +/- 0.09, N = 3SE +/- 0.42, N = 3SE +/- 0.80, N = 3SE +/- 1.07, N = 3SE +/- 1.78, N = 3SE +/- 0.11, N = 3SE +/- 1.02, N = 3SE +/- 0.11, N = 3SE +/- 0.45, N = 3SE +/- 0.32, N = 3SE +/- 0.25, N = 3SE +/- 0.17, N = 3SE +/- 0.05, N = 3SE +/- 0.62, N = 3SE +/- 0.20, N = 342.6844.6840.1623.2833.89692.0652.6240.9542.5438.2122.3732.17684.2350.7339.1642.4338.9223.8231.79579.5547.8738.3540.2436.4422.3831.81581.7848.84

Apache Spark

Comparison (Row Count: 1000000 - Partitions: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 1000000 - Partitions: 1000)Broadcast Inner Join Test TimeInner Join Test TimeRepartition Test TimeGroup By Test TimeCalculate Pi Benchmark Using DataframeCalculate Pi BenchmarkSHA-512 Benchmark Time150300450600750SE +/- 0.04, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 1.88, N = 3SE +/- 0.14, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.10, N = 3SE +/- 1.43, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 4SE +/- 0.63, N = 4SE +/- 0.07, N = 4SE +/- 0.08, N = 4SE +/- 0.05, N = 4SE +/- 0.54, N = 4SE +/- 0.12, N = 4SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.18, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 2.32, N = 3SE +/- 0.01, N = 37.298.3310.0611.3933.39717.1011.386.998.0110.0511.1032.36695.3211.186.908.639.7410.9331.88580.2410.787.057.819.9511.1831.54583.5011.14

Apache Spark

Comparison (Row Count: 1000000 - Partitions: 500)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Comparison (Row Count: 1000000 - Partitions: 500)Broadcast Inner Join Test TimeInner Join Test TimeRepartition Test TimeGroup By Test TimeCalculate Pi Benchmark Using DataframeCalculate Pi BenchmarkSHA-512 Benchmark Time160320480640800SE +/- 0.094366471, N = 3SE +/- 0.056766652, N = 3SE +/- 0.037643391, N = 3SE +/- 0.085288962, N = 3SE +/- 0.158253119, N = 3SE +/- 10.096513371, N = 3SE +/- 0.075456756, N = 3SE +/- 0.103211248, N = 3SE +/- 0.103943425, N = 3SE +/- 0.076523207, N = 3SE +/- 0.188967987, N = 3SE +/- 0.155432056, N = 3SE +/- 3.616590948, N = 3SE +/- 0.073904401, N = 3SE +/- 0.063047733, N = 3SE +/- 0.517942458, N = 3SE +/- 0.101989022, N = 3SE +/- 0.152630685, N = 3SE +/- 0.017302603, N = 3SE +/- 0.635610275, N = 3SE +/- 0.026873455, N = 3SE +/- 0.486110869, N = 3SE +/- 0.043852959, N = 3SE +/- 0.069154351, N = 3SE +/- 0.086808001, N = 3SE +/- 0.016927629, N = 3SE +/- 1.696546131, N = 3SE +/- 0.114204323, N = 36.6200000007.2600000009.46000000010.13000000033.760000000733.90000000011.2300000006.2900000007.0100000009.1000000009.95000000032.270000000685.12000000010.4300000006.1200000007.5300000009.0000000009.84000000031.790000000580.9900000009.8900000006.5100000007.0300000009.21000000010.03000000031.720000000579.16066724010.480000000

Stockfish

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 15ComparisonTotal Time1.1M2.2M3.3M4.4M5.5MSE +/- 385132.57, N = 9SE +/- 121318.23, N = 9SE +/- 138882.38, N = 7SE +/- 88074.41, N = 9SE +/- 38968.66, N = 9SE +/- 21647.79, N = 95271840487374748637654326446311657211366601. (CXX) g++ options: -lgcov -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -flto -flto=jobserver

ClickHouse

Comparison

rk1-mainline-nvmerk1-rok-nvmeOpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5Comparison100M Rows Hits Dataset, Third Run100M Rows Hits Dataset, Second Run100M Rows Hits Dataset, First Run / Cold Cache1020304050SE +/- 0.37, N = 3SE +/- 0.67, N = 3SE +/- 0.56, N = 3SE +/- 0.71, N = 3SE +/- 0.32, N = 3SE +/- 0.29, N = 345.7246.1543.4541.8141.3738.83

etcd

Test Comparison (Connections: 50 - Clients: 100 - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 50 - Clients: 100 - Average Latency)RANGEPUT3691215SE +/- 0.23, N = 9SE +/- 0.57, N = 9SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.31, N = 9SE +/- 0.55, N = 9SE +/- 0.05, N = 6SE +/- 0.00, N = 312.211.35.65.512.411.15.65.6

etcd

Connections Comparison (Test: RANGE - - Clients: 100 - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Connections Comparison (Test: RANGE - - Clients: 100 - Average Latency)5050010048121620SE +/- 0.23, N = 9SE +/- 0.31, N = 6SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.31, N = 9SE +/- 0.26, N = 9SE +/- 0.15, N = 3SE +/- 0.05, N = 6SE +/- 0.00, N = 3SE +/- 0.03, N = 312.212.613.55.66.05.912.413.614.05.66.26.2

etcd

Clients Comparison (Test: RANGE - Connections: 50 - - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 50 - - Average Latency)10010001428425670SE +/- 0.23, N = 9SE +/- 1.90, N = 9SE +/- 0.06, N = 3SE +/- 0.22, N = 3SE +/- 0.31, N = 9SE +/- 1.59, N = 12SE +/- 0.05, N = 6SE +/- 0.07, N = 312.261.85.629.712.452.65.631.0

etcd

Comparison (Test: RANGE - Connections: 50 - Clients: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 50 - Clients: 100)Average Latency3691215SE +/- 0.23, N = 9SE +/- 0.06, N = 3SE +/- 0.31, N = 9SE +/- 0.05, N = 612.25.612.45.6

etcd

Test Comparison (Connections: 50 - Clients: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 50 - Clients: 100)RANGEPUT4K8K12K16K20KSE +/- 162.99, N = 9SE +/- 548.13, N = 9SE +/- 149.49, N = 3SE +/- 103.48, N = 3SE +/- 213.67, N = 9SE +/- 580.79, N = 9SE +/- 170.29, N = 6SE +/- 13.84, N = 38177.719019.7917702.5917919.748026.129143.0117733.5817625.64

etcd

Connections Comparison (Test: RANGE - - Clients: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Connections Comparison (Test: RANGE - - Clients: 100)505001004K8K12K16K20KSE +/- 162.99, N = 9SE +/- 186.80, N = 6SE +/- 43.16, N = 3SE +/- 149.49, N = 3SE +/- 32.79, N = 3SE +/- 92.45, N = 3SE +/- 213.67, N = 9SE +/- 157.07, N = 9SE +/- 90.88, N = 3SE +/- 170.29, N = 6SE +/- 51.80, N = 3SE +/- 51.41, N = 38177.717871.697344.5817702.5916375.1916784.838026.127311.147054.6217733.5815844.2115796.44

etcd

Clients Comparison (Test: RANGE - Connections: 50)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 50)10010007K14K21K28K35KSE +/- 162.99, N = 9SE +/- 428.03, N = 9SE +/- 149.49, N = 3SE +/- 208.41, N = 3SE +/- 213.67, N = 9SE +/- 466.92, N = 12SE +/- 170.29, N = 6SE +/- 55.90, N = 38177.7115862.1217702.5932275.158026.1218635.5017733.5830789.21

etcd

Test Comparison (Connections: 500 - Clients: 100 - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 500 - Clients: 100 - Average Latency)PUTRANGE3691215SE +/- 0.25, N = 9SE +/- 0.31, N = 6SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.26, N = 9SE +/- 0.26, N = 9SE +/- 0.06, N = 3SE +/- 0.00, N = 312.812.65.96.013.213.66.16.2

etcd

Connections Comparison (Test: PUT - - Clients: 100 - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Connections Comparison (Test: PUT - - Clients: 100 - Average Latency)500501003691215SE +/- 0.25, N = 9SE +/- 0.57, N = 9SE +/- 0.15, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.26, N = 9SE +/- 0.55, N = 9SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.00, N = 3SE +/- 0.09, N = 312.811.313.25.95.55.913.211.113.46.15.66.2

etcd

Clients Comparison (Test: PUT - Connections: 500 - - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 500 - - Average Latency)10010001530456075SE +/- 0.25, N = 9SE +/- 0.71, N = 3SE +/- 0.06, N = 3SE +/- 0.00, N = 3SE +/- 0.26, N = 9SE +/- 0.73, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 312.867.85.940.613.258.76.141.9

etcd

Comparison (Test: PUT - Connections: 500 - Clients: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 500 - Clients: 100)Average Latency3691215SE +/- 0.25, N = 9SE +/- 0.06, N = 3SE +/- 0.26, N = 9SE +/- 0.06, N = 312.85.913.26.1

etcd

Test Comparison (Connections: 500 - Clients: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 500 - Clients: 100)PUTRANGE4K8K12K16K20KSE +/- 154.99, N = 9SE +/- 186.80, N = 6SE +/- 210.10, N = 3SE +/- 32.79, N = 3SE +/- 162.97, N = 9SE +/- 157.07, N = 9SE +/- 107.83, N = 3SE +/- 51.80, N = 37773.687871.6916740.4516375.197555.487311.1416067.2715844.21

etcd

Connections Comparison (Test: PUT - - Clients: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Connections Comparison (Test: PUT - - Clients: 100)500501004K8K12K16K20KSE +/- 154.99, N = 9SE +/- 548.13, N = 9SE +/- 78.80, N = 3SE +/- 210.10, N = 3SE +/- 103.48, N = 3SE +/- 121.87, N = 3SE +/- 162.97, N = 9SE +/- 580.79, N = 9SE +/- 59.42, N = 3SE +/- 107.83, N = 3SE +/- 13.84, N = 3SE +/- 230.09, N = 37773.689019.797525.0016740.4517919.7416623.407555.489143.017417.3216067.2717625.6416034.33

etcd

Clients Comparison (Test: PUT - Connections: 500)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 500)10010005K10K15K20K25KSE +/- 154.99, N = 9SE +/- 131.09, N = 3SE +/- 210.10, N = 3SE +/- 6.47, N = 3SE +/- 162.97, N = 9SE +/- 178.58, N = 3SE +/- 107.83, N = 3SE +/- 76.06, N = 37773.6813947.8716740.4522994.387555.4816043.0016067.2721936.54

etcd

Clients Comparison (Test: PUT - Connections: 50 - - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 50 - - Average Latency)10010001326395265SE +/- 0.57, N = 9SE +/- 1.79, N = 9SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.55, N = 9SE +/- 1.66, N = 12SE +/- 0.00, N = 3SE +/- 0.12, N = 311.359.05.529.911.150.35.630.9

etcd

Comparison (Test: PUT - Connections: 50 - Clients: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 50 - Clients: 100)Average Latency3691215SE +/- 0.57, N = 9SE +/- 0.03, N = 3SE +/- 0.55, N = 9SE +/- 0.00, N = 311.35.511.15.6

etcd

Clients Comparison (Test: PUT - Connections: 50)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 50)10010007K14K21K28K35KSE +/- 548.13, N = 9SE +/- 452.84, N = 9SE +/- 103.48, N = 3SE +/- 166.43, N = 3SE +/- 580.79, N = 9SE +/- 523.12, N = 12SE +/- 13.84, N = 3SE +/- 97.60, N = 39019.7916573.1917919.7432076.419143.0119495.9717625.6430813.77

etcd

Clients Comparison (Test: RANGE - Connections: 500 - - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 500 - - Average Latency)10010001530456075SE +/- 0.31, N = 6SE +/- 0.98, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.26, N = 9SE +/- 1.51, N = 6SE +/- 0.00, N = 3SE +/- 0.06, N = 312.669.26.040.713.659.86.242.2

etcd

Comparison (Test: RANGE - Connections: 500 - Clients: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 500 - Clients: 100)Average Latency3691215SE +/- 0.31, N = 6SE +/- 0.03, N = 3SE +/- 0.26, N = 9SE +/- 0.00, N = 312.66.013.66.2

etcd

Clients Comparison (Test: RANGE - Connections: 500)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 500)10010005K10K15K20K25KSE +/- 186.80, N = 6SE +/- 181.75, N = 3SE +/- 32.79, N = 3SE +/- 44.26, N = 3SE +/- 157.07, N = 9SE +/- 379.06, N = 6SE +/- 51.80, N = 3SE +/- 41.44, N = 37871.6913685.5916375.1922948.347311.1415827.1215844.2121829.11

etcd

Test Comparison (Connections: 100 - Clients: 1000 - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 100 - Clients: 1000 - Average Latency)RANGEPUT1428425670SE +/- 2.12, N = 9SE +/- 1.82, N = 9SE +/- 0.15, N = 3SE +/- 0.12, N = 3SE +/- 1.57, N = 12SE +/- 1.74, N = 12SE +/- 0.18, N = 3SE +/- 0.13, N = 364.463.031.631.753.550.932.732.6

etcd

Connections Comparison (Test: RANGE - - Clients: 1000 - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Connections Comparison (Test: RANGE - - Clients: 1000 - Average Latency)100505001530456075SE +/- 2.12, N = 9SE +/- 1.90, N = 9SE +/- 0.98, N = 3SE +/- 0.15, N = 3SE +/- 0.22, N = 3SE +/- 0.12, N = 3SE +/- 1.57, N = 12SE +/- 1.59, N = 12SE +/- 1.51, N = 6SE +/- 0.18, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 364.461.869.231.629.740.753.552.659.832.731.042.2

etcd

Clients Comparison (Test: RANGE - Connections: 100 - - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 100 - - Average Latency)10001001428425670SE +/- 2.12, N = 9SE +/- 0.09, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 1.57, N = 12SE +/- 0.15, N = 3SE +/- 0.18, N = 3SE +/- 0.03, N = 364.413.531.65.953.514.032.76.2

etcd

Comparison (Test: RANGE - Connections: 100 - Clients: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 100 - Clients: 1000)Average Latency1428425670SE +/- 2.12, N = 9SE +/- 0.15, N = 3SE +/- 1.57, N = 12SE +/- 0.18, N = 364.431.653.532.7

etcd

Test Comparison (Connections: 100 - Clients: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 100 - Clients: 1000)RANGEPUT6K12K18K24K30KSE +/- 438.82, N = 9SE +/- 392.03, N = 9SE +/- 136.35, N = 3SE +/- 119.58, N = 3SE +/- 414.34, N = 12SE +/- 530.09, N = 12SE +/- 123.00, N = 3SE +/- 97.95, N = 315177.0515482.1330214.1030106.8418202.3619163.3528883.9528950.57

etcd

Connections Comparison (Test: RANGE - - Clients: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Connections Comparison (Test: RANGE - - Clients: 1000)100505007K14K21K28K35KSE +/- 438.82, N = 9SE +/- 428.03, N = 9SE +/- 181.75, N = 3SE +/- 136.35, N = 3SE +/- 208.41, N = 3SE +/- 44.26, N = 3SE +/- 414.34, N = 12SE +/- 466.92, N = 12SE +/- 379.06, N = 6SE +/- 123.00, N = 3SE +/- 55.90, N = 3SE +/- 41.44, N = 315177.0515862.1213685.5930214.1032275.1522948.3418202.3618635.5015827.1228883.9530789.2121829.11

etcd

Clients Comparison (Test: RANGE - Connections: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: RANGE - Connections: 100)10001006K12K18K24K30KSE +/- 438.82, N = 9SE +/- 43.16, N = 3SE +/- 136.35, N = 3SE +/- 92.45, N = 3SE +/- 414.34, N = 12SE +/- 90.88, N = 3SE +/- 123.00, N = 3SE +/- 51.41, N = 315177.057344.5830214.1016784.8318202.367054.6228883.9515796.44

etcd

Connections Comparison (Test: PUT - - Clients: 1000 - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Connections Comparison (Test: PUT - - Clients: 1000 - Average Latency)100505001530456075SE +/- 1.82, N = 9SE +/- 1.79, N = 9SE +/- 0.71, N = 3SE +/- 0.12, N = 3SE +/- 0.18, N = 3SE +/- 0.00, N = 3SE +/- 1.74, N = 12SE +/- 1.66, N = 12SE +/- 0.73, N = 3SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 0.21, N = 363.059.067.831.729.940.650.950.358.732.630.941.9

etcd

Clients Comparison (Test: PUT - Connections: 100 - - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 100 - - Average Latency)10001001428425670SE +/- 1.82, N = 9SE +/- 0.15, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 1.74, N = 12SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 0.09, N = 363.013.231.75.950.913.432.66.2

etcd

Comparison (Test: PUT - Connections: 100 - Clients: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 100 - Clients: 1000)Average Latency1428425670SE +/- 1.82, N = 9SE +/- 0.12, N = 3SE +/- 1.74, N = 12SE +/- 0.13, N = 363.031.750.932.6

etcd

Connections Comparison (Test: PUT - - Clients: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Connections Comparison (Test: PUT - - Clients: 1000)100505007K14K21K28K35KSE +/- 392.03, N = 9SE +/- 452.84, N = 9SE +/- 131.09, N = 3SE +/- 119.58, N = 3SE +/- 166.43, N = 3SE +/- 6.47, N = 3SE +/- 530.09, N = 12SE +/- 523.12, N = 12SE +/- 178.58, N = 3SE +/- 97.95, N = 3SE +/- 97.60, N = 3SE +/- 76.06, N = 315482.1316573.1913947.8730106.8432076.4122994.3819163.3519495.9716043.0028950.5730813.7721936.54

etcd

Clients Comparison (Test: PUT - Connections: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Clients Comparison (Test: PUT - Connections: 100)10001006K12K18K24K30KSE +/- 392.03, N = 9SE +/- 78.80, N = 3SE +/- 119.58, N = 3SE +/- 121.87, N = 3SE +/- 530.09, N = 12SE +/- 59.42, N = 3SE +/- 97.95, N = 3SE +/- 230.09, N = 315482.137525.0030106.8416623.4019163.357417.3228950.5716034.33

etcd

Test Comparison (Connections: 50 - Clients: 1000 - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 50 - Clients: 1000 - Average Latency)RANGEPUT1428425670SE +/- 1.90, N = 9SE +/- 1.79, N = 9SE +/- 0.22, N = 3SE +/- 0.18, N = 3SE +/- 1.59, N = 12SE +/- 1.66, N = 12SE +/- 0.07, N = 3SE +/- 0.12, N = 361.859.029.729.952.650.331.030.9

etcd

Comparison (Test: RANGE - Connections: 50 - Clients: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 50 - Clients: 1000)Average Latency1428425670SE +/- 1.90, N = 9SE +/- 0.22, N = 3SE +/- 1.59, N = 12SE +/- 0.07, N = 361.829.752.631.0

etcd

Test Comparison (Connections: 50 - Clients: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 50 - Clients: 1000)RANGEPUT7K14K21K28K35KSE +/- 428.03, N = 9SE +/- 452.84, N = 9SE +/- 208.41, N = 3SE +/- 166.43, N = 3SE +/- 466.92, N = 12SE +/- 523.12, N = 12SE +/- 55.90, N = 3SE +/- 97.60, N = 315862.1216573.1932275.1532076.4118635.5019495.9730789.2130813.77

etcd

Comparison (Test: PUT - Connections: 50 - Clients: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 50 - Clients: 1000)Average Latency1326395265SE +/- 1.79, N = 9SE +/- 0.18, N = 3SE +/- 1.66, N = 12SE +/- 0.12, N = 359.029.950.330.9

etcd

Test Comparison (Connections: 100 - Clients: 100 - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 100 - Clients: 100 - Average Latency)RANGEPUT48121620SE +/- 0.09, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.15, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 313.513.25.95.914.013.46.26.2

etcd

Comparison (Test: RANGE - Connections: 100 - Clients: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 100 - Clients: 100)Average Latency48121620SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 313.55.914.06.2

etcd

Test Comparison (Connections: 100 - Clients: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 100 - Clients: 100)RANGEPUT4K8K12K16K20KSE +/- 43.16, N = 3SE +/- 78.80, N = 3SE +/- 92.45, N = 3SE +/- 121.87, N = 3SE +/- 90.88, N = 3SE +/- 59.42, N = 3SE +/- 51.41, N = 3SE +/- 230.09, N = 37344.587525.0016784.8316623.407054.627417.3215796.4416034.33

etcd

Comparison (Test: PUT - Connections: 100 - Clients: 100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 100 - Clients: 100)Average Latency3691215SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 313.25.913.46.2

etcd

Test Comparison (Connections: 500 - Clients: 1000 - Average Latency)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test Comparison (Connections: 500 - Clients: 1000 - Average Latency)RANGEPUT1530456075SE +/- 0.98, N = 3SE +/- 0.71, N = 3SE +/- 0.12, N = 3SE +/- 0.00, N = 3SE +/- 1.51, N = 6SE +/- 0.73, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 369.267.840.740.659.858.742.241.9

etcd

Comparison (Test: RANGE - Connections: 500 - Clients: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: RANGE - Connections: 500 - Clients: 1000)Average Latency1530456075SE +/- 0.98, N = 3SE +/- 0.12, N = 3SE +/- 1.51, N = 6SE +/- 0.06, N = 369.240.759.842.2

etcd

Test Comparison (Connections: 500 - Clients: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test Comparison (Connections: 500 - Clients: 1000)RANGEPUT5K10K15K20K25KSE +/- 181.75, N = 3SE +/- 131.09, N = 3SE +/- 44.26, N = 3SE +/- 6.47, N = 3SE +/- 379.06, N = 6SE +/- 178.58, N = 3SE +/- 41.44, N = 3SE +/- 76.06, N = 313685.5913947.8722948.3422994.3815827.1216043.0021829.1121936.54

etcd

Comparison (Test: PUT - Connections: 500 - Clients: 1000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Comparison (Test: PUT - Connections: 500 - Clients: 1000)Average Latency1530456075SE +/- 0.71, N = 3SE +/- 0.00, N = 3SE +/- 0.73, N = 3SE +/- 0.21, N = 367.840.658.741.9

Build2

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterBuild2 0.15ComparisonTime To Compile2004006008001000SE +/- 1.02, N = 3SE +/- 2.62, N = 3SE +/- 2.22, N = 3SE +/- 3.79, N = 3SE +/- 4.32, N = 3688.05673.85668.87669.641064.90

Stargate Digital Audio Workstation

Sample Rate Comparison (Buffer Size: 512)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate Comparison (Buffer Size: 512)19200048000044100960000.17930.35860.53790.71720.8965SE +/- 0.000865, N = 3SE +/- 0.000670, N = 3SE +/- 0.000792, N = 3SE +/- 0.000635, N = 3SE +/- 0.000291, N = 3SE +/- 0.000207, N = 3SE +/- 0.000393, N = 3SE +/- 0.000167, N = 3SE +/- 0.000095, N = 3SE +/- 0.006668, N = 12SE +/- 0.006662, N = 12SE +/- 0.000630, N = 3SE +/- 0.000288, N = 3SE +/- 0.003804, N = 3SE +/- 0.010750, N = 3SE +/- 0.000529, N = 3SE +/- 0.000076, N = 3SE +/- 0.000305, N = 3SE +/- 0.000267, N = 3SE +/- 0.000135, N = 30.3643850.7437710.7757920.5491470.3732820.7642510.7970650.5633470.3928780.7477070.7762970.5912680.3917290.7620930.7705080.5902210.1451090.3218430.3355090.2255671. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Buffer Size Comparison (Sample Rate: 192000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Buffer Size Comparison (Sample Rate: 192000)51210240.08870.17740.26610.35480.4435SE +/- 0.000865, N = 3SE +/- 0.000191, N = 3SE +/- 0.000291, N = 3SE +/- 0.000285, N = 3SE +/- 0.000095, N = 3SE +/- 0.003917, N = 3SE +/- 0.000288, N = 3SE +/- 0.000760, N = 3SE +/- 0.000076, N = 3SE +/- 0.000090, N = 30.3643850.3815700.3732820.3907500.3928780.3911850.3917290.3942900.1451090.1666061. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate Comparison (Buffer Size: 1024)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate Comparison (Buffer Size: 1024)19200096000480000441000.18480.36960.55440.73920.924SE +/- 0.000191, N = 3SE +/- 0.000339, N = 3SE +/- 0.000798, N = 3SE +/- 0.000604, N = 3SE +/- 0.000285, N = 3SE +/- 0.000195, N = 3SE +/- 0.001050, N = 3SE +/- 0.000098, N = 3SE +/- 0.003917, N = 3SE +/- 0.003479, N = 3SE +/- 0.000633, N = 3SE +/- 0.000730, N = 3SE +/- 0.000760, N = 3SE +/- 0.005146, N = 9SE +/- 0.000443, N = 3SE +/- 0.000258, N = 3SE +/- 0.000090, N = 3SE +/- 0.000279, N = 3SE +/- 0.000131, N = 3SE +/- 0.000223, N = 30.3815700.5708350.7656160.7972600.3907500.5852210.7859610.8213730.3911850.5586620.7678290.8005280.3942900.5763900.7668230.8000440.1666060.2521970.3481210.3624481. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Buffer Size Comparison (Sample Rate: 96000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Buffer Size Comparison (Sample Rate: 96000)10245120.1330.2660.3990.5320.665SE +/- 0.000339, N = 3SE +/- 0.000635, N = 3SE +/- 0.000195, N = 3SE +/- 0.000167, N = 3SE +/- 0.003479, N = 3SE +/- 0.000630, N = 3SE +/- 0.005146, N = 9SE +/- 0.000529, N = 3SE +/- 0.000279, N = 3SE +/- 0.000135, N = 30.5708350.5491470.5852210.5633470.5586620.5912680.5763900.5902210.2521970.2255671. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Buffer Size Comparison (Sample Rate: 480000)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Buffer Size Comparison (Sample Rate: 480000)51210240.17680.35360.53040.70720.884SE +/- 0.000670, N = 3SE +/- 0.000798, N = 3SE +/- 0.000207, N = 3SE +/- 0.001050, N = 3SE +/- 0.006668, N = 12SE +/- 0.000633, N = 3SE +/- 0.003804, N = 3SE +/- 0.000443, N = 3SE +/- 0.000305, N = 3SE +/- 0.000131, N = 30.7437710.7656160.7642510.7859610.7477070.7678290.7620930.7668230.3218430.3481211. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Buffer Size Comparison (Sample Rate: 44100)

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Buffer Size Comparison (Sample Rate: 44100)51210240.18480.36960.55440.73920.924SE +/- 0.000792, N = 3SE +/- 0.000604, N = 3SE +/- 0.000393, N = 3SE +/- 0.000098, N = 3SE +/- 0.006662, N = 12SE +/- 0.000730, N = 3SE +/- 0.010750, N = 3SE +/- 0.000258, N = 3SE +/- 0.000267, N = 3SE +/- 0.000223, N = 30.7757920.7972600.7970650.8213730.7762970.8005280.7705080.8000440.3355090.3624481. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

asmFish

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgNodes/second, More Is BetterasmFish 2018-07-23Comparison1024 Hash Memory, 26 Depth2M4M6M8M10MSE +/- 75549.20, N = 6SE +/- 43781.35, N = 3SE +/- 65797.59, N = 9SE +/- 44374.95, N = 3SE +/- 34823.82, N = 375838568005820781721077211592767131

LeelaChessZero

Backend Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend ComparisonBLAS246810SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.11, N = 9SE +/- 0.00, N = 3SE +/- 0.00, N = 35566711. (CXX) g++ options: -flto -pthread

Timed GDB GNU Debugger Compilation

Comparison

rk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed GDB GNU Debugger Compilation 10.2ComparisonTime To Compile90180270360450SE +/- 1.39, N = 3SE +/- 1.63, N = 3249.25393.65

Timed PHP Compilation

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed PHP Compilation 8.1.9ComparisonTime To Compile110220330440550SE +/- 4.51, N = 3SE +/- 1.19, N = 3SE +/- 2.82, N = 3SE +/- 2.08, N = 3SE +/- 1.64, N = 3364.44334.21346.68343.16519.40

Timed FFmpeg Compilation

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.1ComparisonTime To Compile2004006008001000SE +/- 0.50, N = 3SE +/- 0.58, N = 3SE +/- 0.84, N = 3SE +/- 0.36, N = 3SE +/- 0.09, N = 3SE +/- 1.65, N = 3209.95200.28196.60194.15349.94971.00

Timed Erlang/OTP Compilation

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Erlang/OTP Compilation 25.0ComparisonTime To Compile90180270360450SE +/- 0.61, N = 3SE +/- 0.12, N = 3SE +/- 0.77, N = 3SE +/- 0.74, N = 3SE +/- 0.17, N = 3310.70298.12301.84330.42405.21

m-queens

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is Betterm-queens 1.2ComparisonTime To Solve120240360480600SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.33, N = 3216.46206.45206.26206.40316.59567.491. (CXX) g++ options: -fopenmp -O2 -march=native

Timed CPython Compilation

Build Configuration Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed CPython Compilation 3.10.6Build Configuration ComparisonReleased Build, PGO + LTO OptimizedDefault2004006008001000784.3066.13744.6059.76764.7260.52783.8761.47862.0293.78

Apache Spark TPC-H

Scale Factor Comparison (Q22)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q22)10.73261.46522.19782.93043.663SE +/- 0.05419067, N = 3SE +/- 0.40940044, N = 82.635502583.25603971

Apache Spark TPC-H

Comparison (Scale Factor: 1)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Comparison (Scale Factor: 1)Q22Q21Q20Q19Q18Q17Q16Q15Q14Q13Q12Q11Q10Q09Q08Q07Q06Q05Q04Q03Q02Q01Geometric Mean Of All Queries48121620SE +/- 0.05419067, N = 3SE +/- 0.45650715, N = 3SE +/- 0.16740673, N = 3SE +/- 0.08247514, N = 3SE +/- 0.02944973, N = 3SE +/- 0.11188602, N = 3SE +/- 0.04807800, N = 3SE +/- 0.01587727, N = 3SE +/- 0.09844103, N = 3SE +/- 0.05404231, N = 3SE +/- 0.07812445, N = 3SE +/- 0.00889576, N = 3SE +/- 0.12475642, N = 3SE +/- 0.03195754, N = 3SE +/- 0.07990249, N = 3SE +/- 0.01424190, N = 3SE +/- 0.06400088, N = 3SE +/- 0.08288138, N = 3SE +/- 0.15831346, N = 3SE +/- 0.17085945, N = 3SE +/- 0.06585723, N = 3SE +/- 0.17776740, N = 3SE +/- 0.02205715, N = 3SE +/- 0.40940044, N = 8SE +/- 0.09251555, N = 8SE +/- 0.02853109, N = 8SE +/- 0.04107179, N = 8SE +/- 0.15655408, N = 8SE +/- 0.05677966, N = 8SE +/- 0.04873253, N = 8SE +/- 0.02096419, N = 8SE +/- 0.08797017, N = 8SE +/- 0.02994103, N = 8SE +/- 0.07037349, N = 8SE +/- 0.02504461, N = 8SE +/- 0.08702141, N = 8SE +/- 0.06360940, N = 8SE +/- 0.01870892, N = 8SE +/- 0.12029949, N = 8SE +/- 0.02204410, N = 8SE +/- 0.06264325, N = 8SE +/- 0.15490647, N = 8SE +/- 0.07160103, N = 8SE +/- 0.10497115, N = 8SE +/- 0.10385415, N = 8SE +/- 0.03832583, N = 82.6355025818.002487184.955533353.456161108.852170947.480081882.365291433.733936313.483763383.309991524.411468982.229465095.488646358.098931315.125953205.678459013.144960966.451014206.352845996.219260695.121564718.991113984.703943663.2560397116.831480504.598659943.266044208.634209877.148795842.378982933.521971973.417816823.002522234.261494312.230567375.450984967.734836885.013944215.712453192.872663116.250915595.946094636.013409675.176648268.898104674.58796121

Apache Spark TPC-H

Scale Factor Comparison (Q21)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q21)148121620SE +/- 0.46, N = 3SE +/- 0.09, N = 818.0016.83

Apache Spark TPC-H

Scale Factor Comparison (Q20)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q20)11.1152.233.3454.465.575SE +/- 0.16740673, N = 3SE +/- 0.02853109, N = 84.955533354.59865994

Apache Spark TPC-H

Scale Factor Comparison (Q19)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q19)10.77761.55522.33283.11043.888SE +/- 0.08247514, N = 3SE +/- 0.04107179, N = 83.456161103.26604420

Apache Spark TPC-H

Scale Factor Comparison (Q18)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q18)1246810SE +/- 0.02944973, N = 3SE +/- 0.15655408, N = 88.852170948.63420987

Apache Spark TPC-H

Scale Factor Comparison (Q17)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q17)1246810SE +/- 0.11188602, N = 3SE +/- 0.05677966, N = 87.480081887.14879584

Apache Spark TPC-H

Scale Factor Comparison (Q16)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q16)10.53531.07061.60592.14122.6765SE +/- 0.04807800, N = 3SE +/- 0.04873253, N = 82.365291432.37898293

Apache Spark TPC-H

Scale Factor Comparison (Q15)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q15)10.84011.68022.52033.36044.2005SE +/- 0.01587727, N = 3SE +/- 0.02096419, N = 83.733936313.52197197

Apache Spark TPC-H

Scale Factor Comparison (Q14)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q14)10.78381.56762.35143.13523.919SE +/- 0.09844103, N = 3SE +/- 0.08797017, N = 83.483763383.41781682

Apache Spark TPC-H

Scale Factor Comparison (Q13)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q13)10.74471.48942.23412.97883.7235SE +/- 0.05404231, N = 3SE +/- 0.02994103, N = 83.309991523.00252223

Apache Spark TPC-H

Scale Factor Comparison (Q12)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q12)10.99261.98522.97783.97044.963SE +/- 0.07812445, N = 3SE +/- 0.07037349, N = 84.411468984.26149431

Apache Spark TPC-H

Scale Factor Comparison (Q11)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q11)10.50191.00381.50572.00762.5095SE +/- 0.00889576, N = 3SE +/- 0.02504461, N = 82.229465092.23056737

Apache Spark TPC-H

Scale Factor Comparison (Q10)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q10)11.23492.46983.70474.93966.1745SE +/- 0.12475642, N = 3SE +/- 0.08702141, N = 85.488646355.45098496

Apache Spark TPC-H

Scale Factor Comparison (Q09)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q09)1246810SE +/- 0.03195754, N = 3SE +/- 0.06360940, N = 88.098931317.73483688

Apache Spark TPC-H

Scale Factor Comparison (Q08)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q08)11.15332.30663.45994.61325.7665SE +/- 0.07990249, N = 3SE +/- 0.01870892, N = 85.125953205.01394421

Apache Spark TPC-H

Scale Factor Comparison (Q07)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q07)11.28532.57063.85595.14126.4265SE +/- 0.01424190, N = 3SE +/- 0.12029949, N = 85.678459015.71245319

Apache Spark TPC-H

Scale Factor Comparison (Q06)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q06)10.70761.41522.12282.83043.538SE +/- 0.06400088, N = 3SE +/- 0.02204410, N = 83.144960962.87266311

Apache Spark TPC-H

Scale Factor Comparison (Q05)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q05)1246810SE +/- 0.08288138, N = 3SE +/- 0.06264325, N = 86.451014206.25091559

Apache Spark TPC-H

Scale Factor Comparison (Q04)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q04)1246810SE +/- 0.15831346, N = 3SE +/- 0.15490647, N = 86.352845995.94609463

Apache Spark TPC-H

Scale Factor Comparison (Q03)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q03)1246810SE +/- 0.17085945, N = 3SE +/- 0.07160103, N = 86.219260696.01340967

Apache Spark TPC-H

Scale Factor Comparison (Q02)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q02)11.16472.32943.49414.65885.8235SE +/- 0.06585723, N = 3SE +/- 0.10497115, N = 85.121564715.17664826

Apache Spark TPC-H

Scale Factor Comparison (Q01)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Q01)13691215SE +/- 0.17776740, N = 3SE +/- 0.10385415, N = 88.991113988.89810467

Apache Spark TPC-H

Scale Factor Comparison (Geometric Mean Of All Queries)

rk1-mainline-emmcrk1-rok-emmcOpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor Comparison (Geometric Mean Of All Queries)11.05842.11683.17524.23365.292SE +/- 0.02205715, N = 3SE +/- 0.03832583, N = 84.703943664.58796121

FLAC Audio Encoding

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterFLAC Audio Encoding 1.4ComparisonWAV To FLAC20406080100SE +/- 0.33, N = 25SE +/- 0.14, N = 5SE +/- 0.55, N = 25SE +/- 0.02, N = 5SE +/- 0.45, N = 554.3145.3351.6043.5190.291. (CXX) g++ options: -O3 -fvisibility=hidden -logg -lm

Timed Wasmer Compilation

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Wasmer Compilation 2.3ComparisonTime To Compile80160240320400SE +/- 0.59, N = 3SE +/- 0.10, N = 3SE +/- 1.67, N = 3SE +/- 1.65, N = 3SE +/- 0.79, N = 3215.92204.89198.46188.16372.861. (CC) gcc options: -ldl -lgcc_s -lutil -lrt -lpthread -lm -lc -pie -nodefaultlibs

WavPack Audio Encoding

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcpi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterWavPack Audio Encoding 5.3ComparisonWAV To WavPack4080120160200SE +/- 0.07, N = 5SE +/- 0.13, N = 5SE +/- 0.05, N = 5SE +/- 0.08, N = 5104.0499.6294.62188.001. (CXX) g++ options: -rdynamic

Timed Eigen Compilation

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Eigen Compilation 3.3.9ComparisonTime To Compile4080120160200SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 2.34, N = 3SE +/- 1.77, N = 3SE +/- 0.03, N = 3173.21166.90192.10202.51166.00

Timed MPlayer Compilation

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed MPlayer Compilation 1.5ComparisonTime To Compile60120180240300SE +/- 0.66, N = 3SE +/- 1.17, N = 3SE +/- 1.75, N = 3SE +/- 1.68, N = 3SE +/- 0.06, N = 3158.06152.52148.87150.11254.69

Timed ImageMagick Compilation

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterTimed ImageMagick Compilation 6.9.0ComparisonTime To Compile50100150200250SE +/- 0.66, N = 3SE +/- 0.50, N = 3SE +/- 0.41, N = 3SE +/- 0.43, N = 3SE +/- 0.49, N = 3120.10115.09114.08112.86211.59

Opus Codec Encoding

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterOpus Codec Encoding 1.4ComparisonWAV To Opus Encode306090120150SE +/- 0.17, N = 5SE +/- 0.02, N = 5SE +/- 0.31, N = 5SE +/- 0.02, N = 5SE +/- 0.17, N = 571.5067.6265.4564.44129.791. (CXX) g++ options: -O3 -fvisibility=hidden -logg -lm

N-Queens

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterN-Queens 1.0ComparisonElapsed Time20406080100SE +/- 0.70, N = 15SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 359.4855.7656.1856.2463.00109.661. (CC) gcc options: -static -fopenmp -O3 -march=native

Monkey Audio Encoding

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterMonkey Audio Encoding 3.99.6ComparisonWAV To APE1122334455SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.66, N = 2520.2819.4818.5718.6746.561. (CXX) g++ options: -O3 -pedantic -rdynamic -lrt

Timed Apache Compilation

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterTimed Apache Compilation 2.4.41ComparisonTime To Compile50100150200250SE +/- 0.16, N = 3SE +/- 0.22, N = 3SE +/- 0.26, N = 3SE +/- 0.38, N = 3SE +/- 0.37, N = 3SE +/- 0.49, N = 360.6359.3259.1659.7677.31223.03

SQLite

Threads / Copies Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies Comparison1816243240SE +/- 0.28, N = 15SE +/- 0.11, N = 3SE +/- 0.35, N = 3SE +/- 0.04, N = 336.0731.2836.3033.271. (CC) gcc options: -O2 -lreadline -ltermcap -lz -lm

LevelDB

Benchmark Comparison

rk1-mainline-emmcrk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgMB/s, More Is BetterLevelDB 1.23Benchmark ComparisonSequential FillOverwriteRandom FillFill Sync48121620SE +/- 0.12, N = 3SE +/- 0.11, N = 15SE +/- 0.11, N = 10SE +/- 0.01, N = 15SE +/- 0.03, N = 3SE +/- 0.06, N = 5SE +/- 0.03, N = 3SE +/- 0.01, N = 15SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.00, N = 315.014.214.30.35.85.55.60.36.05.85.80.21. (CXX) g++ options: -fno-exceptions -fno-rtti -O3 -lgmock -lgtest -lsnappy

LevelDB

Benchmark Comparison

rk1-mainline-emmcrk1-rok-emmcrk1-rok-nvmeOpenBenchmarking.orgMicroseconds Per Op, Fewer Is BetterLevelDB 1.23Benchmark ComparisonSequential FillRandom DeleteOverwriteRandom FillSeek RandomFill SyncHot ReadRandom Read8001600240032004000SE +/- 0.405, N = 3SE +/- 0.132, N = 3SE +/- 0.512, N = 15SE +/- 0.486, N = 10SE +/- 0.148, N = 15SE +/- 124.904, N = 15SE +/- 0.032, N = 3SE +/- 0.043, N = 3SE +/- 0.648, N = 3SE +/- 1.094, N = 3SE +/- 1.898, N = 5SE +/- 0.770, N = 3SE +/- 0.013, N = 3SE +/- 80.483, N = 15SE +/- 0.014, N = 3SE +/- 0.015, N = 3SE +/- 0.569, N = 3SE +/- 0.861, N = 3SE +/- 0.482, N = 3SE +/- 1.262, N = 3SE +/- 0.008, N = 3SE +/- 9.836, N = 3SE +/- 0.015, N = 3SE +/- 0.015, N = 359.03155.52762.01361.5506.3763015.6464.5934.606149.853142.858156.267153.4936.2753224.4744.5204.497147.151139.647149.216150.3526.2733817.4294.5174.5021. (CXX) g++ options: -fno-exceptions -fno-rtti -O3 -lgmock -lgtest -lsnappy

LAME MP3 Encoding

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi4-raspbian-sdOpenBenchmarking.orgSeconds, Fewer Is BetterLAME MP3 Encoding 3.100ComparisonWAV To MP3612182430SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 313.0512.5011.8911.9624.371. (CC) gcc options: -O3 -ffast-math -funroll-loops -fschedule-insns2 -fbranch-count-reg -fforce-addr -pipe -lncurses -lm

TSCP

Comparison

rk1-mainline-emmcrk1-mainline-nvmerk1-rok-emmcrk1-rok-nvmepi5-raspbian-nvmepi4-raspbian-sdOpenBenchmarking.orgNodes Per Second, More Is BetterTSCP 1.81ComparisonAI Chess Performance200K400K600K800K1000KSE +/- 370.48, N = 5SE +/- 1140.25, N = 5SE +/- 238.60, N = 5SE +/- 239.20, N = 5SE +/- 350.28, N = 5SE +/- 463.49, N = 57385077724868109218121178877794454711. (CC) gcc options: -O3 -march=native


Phoronix Test Suite v10.8.5